Anant Corporation Blog: Our research, knowledge, thoughts, and recommendations about building and managing online business platforms.
Spark,Mesos, Akka, Cassandra, Kafka, Kubernetes? If you don’t already know what these mean and you have no goal or objective to make software that works at a global level, then you don’t need to be reading this article at all. Seriously, it’ll be a waste of your time. These technologies, now open sourced, originated from the extremely high-end university research laboratories of the University of Berkeley and the halls of high-tech companies such as Google, Twitter, LinkedIn, and Facebook. They were built for different purposes for their creators but now being available to the public, they have been flourishing on their own in the wild ether of the Internet. Why would any CIO, CTO, CMO, or a CEO consider these technologies?
As a returning Summer Apprentice, I do not see my last two summers as two separate experiences. Instead, I see them as one journey, split into two parts – one of which could not be as valuable without the other. Last summer, I was introduced to the very foundations of a business to answer the basic questions “what is a company?” or “what makes a company successful?” From a learning standpoint, working at a startup was the best way to answer these questions. In a single meeting, I could have a sales / marketing employee sit next to me, a business analyst two chairs away, and the CEO right across my face. Learning the ins-and-outs of a company couldn’t have been more informative and effective than working side-by-side with such a variety of roles within the company.
The state of the world’s information systems are changing and so should your data processing habits. As the cloud takes precedence in IT environments, different systems that run the modern enterprise are not on the same network or system. These systems have data that business users need to leverage on a day to day and sometimes on an immediate basis.
As big data evolves, we have seen movements from batch processing to micro-batches, to stream processing. All of this is great but folks still need to connect the internet together somehow to access the data.
This presentation was delivered by CEO, Rahul Singh, at The George Washington University to the Data Wranglers DC Meetup on data processing. It outlines the challenge of the current state of business and explains that asynchronous processing is the way to manage the growing sources and volume of business information.
The discussion outlined four main points:
• Thoughts of why “Asynchronous” is the Future
• Discussion about Batch, Micro-Batch, Streaming
• Difference between a Queue / Enterprise Service Bus
• Proposed Architecture for Asynchronous Data Processing
Take a look at the slide presented below.