Business Platform Team

Anant Corporation Blog: Our research, knowledge, thoughts, and recommendations about building and managing online business platforms.

Tag Archives: asynchronous


Asynchronous Data Processing

Asynchronous Data is data that is not combined or aligned when it is sent or received. In this type of transmission, signals are sent between the computers and external systems or vice versa in an asynchronous manner. But why does this matter and how can people benefit from it?

Continue reading
Real Time Business Platforms

Scaling Business Platform Performance with Spark, Mesos, Akka, Cassandra, Kafka, Kubernetes – Part 1/6

Spark,Mesos, Akka, Cassandra, Kafka, Kubernetes? If you don’t already know what these mean and you have no goal or objective to make software that works at a global level, then you don’t need to be reading this article at all. Seriously, it’ll be a waste of your time. These technologies, now open sourced, originated from the extremely high-end university research laboratories of the University of Berkeley and the halls of high-tech companies such as Google, Twitter, LinkedIn, and Facebook. They were built for different purposes for their creators but now being available to the public, they have been flourishing on their own in the wild ether of the Internet. Why would any CIO, CTO, CMO, or a CEO consider these technologies?

Continue reading

A Summer of Learning and Collaborating

As a returning Summer Apprentice, I do not see my last two summers as two separate experiences. Instead, I see them as one journey, split into two parts – one of which could not be as valuable without the other. Last summer, I was introduced to the very foundations of a business to answer the basic questions “what is a company?” or “what makes a company successful?” From a learning standpoint, working at a startup was the best way to answer these questions. In a single meeting, I could have a sales/marketing employee sit next to me, a business analyst two chairs away, and the CEO right across my face. Learning the ins-and-outs of a company couldn’t have been more informative and effective than working side-by-side with such a variety of roles within the company.

Continue reading

The Swarm of Sources

Reactive Manifesto, The Next VisiCalc, and Future of Business Technology

Thanks to some of our great partnerships, our firm has recently consulted at University of Michigan, Cisco, Intuit, and Kroger and at several government agencies on business information and enterprise technology. Even though we don’t directly create consumer technology or applications, eventually all consumer technologies have a backend enterprise technology that makes it work because a consumer technology company backed by crappy technology for the enterprise is bad for business.

I’ve been sensing a shift in business information for a while. Business information, the frequency it’s created at, the number of sources it comes from is only increasing, exponentially if not logarithmically. This means, that businesses, and subsequently end-users need to rely on real-time data processing and analysis of this information. The businesses that embrace the “reactive manifesto” of how to build software and technology are going to succeed in the new world where data is coming from millions of people through their mobile devices, processes through applications and software processes, information through global data sources and APIs, and systems in the form of servers and things all over the globe. The “swarm” of sources is mind-boggling.

The Swarm of Sources

The Swarm of Sources

The first business response to all this business information is: let’s bring it all together to analyze it and visualize it. That’s horseshit. Even with the big data technologies out there today, it is wasteful to try to process all of it at the same time. That’s like trying to understand how the universe works at every second. The better response is to understand what’s happening and react to it at the moment in the context that it is important.

This reactive methodology of building large infrastructure can help businesses react to new IoT initiatives, integrating with numerous business software to run the modern enterprise, and partnering with other modern enterprises. Whatever you see out there in apps, devices, sites, and APIs has to be managed in the back. The reason for silicon brains is stronger when you just can’t do it with carbon brains. Technology has to get better faster through iterative machine learning in order keep up with the amount of data that’s being created.

Commercial organizations are being thrown sledgehammers to solve things by vendors such as Oracle, Cloudera, MapR, DataBricks, etc. Although these products are great, they are more like Personal Computers .. but without the real “Killer App.” They aren’t solving industry-specific / vertical problems. Consulting companies waste inordinate time & materials costs to get it “right.” What people need are “lego block” software so that non-technical folks can self-service their information needs without hiring a team of data analyst, data engineer, data architect, data scientist, data visualizer, and of course a project manager. (If you do need a team today, Anant provides an elastic team with all of those skills for the same investment per month as a part-time or full-time employee. Message me or my team.)

I believe the major breakthrough that will change the experience for business technology users is going to be system design tools that help them get what they want without knowing how to program. I don’t know what it will look like, but we need a VisiCalc for the new age, and no it’s not Google Spreadsheets. It’s something else altogether. It’s something that will fix the yearning for a tool that helps people mashup and leverage various gradients between structured and unstructured data in dynamic knowledge pages that always keeps us up to date on what we care about. A machine that learns what we need to know and summarizes it for us, but also allows us to manipulate the knowledge even if it is being created in 10 different systems.

Asynchronous Data Processing

The state of the world’s information systems are changing and so should your data processing habits. As the cloud takes precedence in IT environments, different systems that run the modern enterprise are not on the same network or system. These systems have data that business users need to leverage on a day to day and sometimes on an immediate basis.

As big data evolves, we have seen movements from batch processing to micro-batches, to stream processing. All of this is great but folks still need to connect the internet together somehow to access the data.

 

2016-07-13 19.21.22

This presentation was delivered by CEO, Rahul Singh, at The George Washington University to the Data Wranglers DC Meetup on data processing. It outlines the challenge of the current state of business and explains that asynchronous processing is the way to manage the growing sources and volume of business information.

The discussion outlined four main points:

• Thoughts of why “Asynchronous” is the Future

• Discussion about Batch, Micro-Batch, Streaming

• Difference between a Queue / Enterprise Service Bus

• Proposed Architecture for Asynchronous Data Processing

 

Take a look at the slide presented below.

 

Data Wranglers DC is a professional group that meets monthly to discuss topics including open data, data gathering, data munging, and the creation, storage and maintenance of datasets. We combine presentations with hands-on workshops, always seeking to make our data munging lives easier. No experience necessary – just bring your interest.