Business Platform Team

In this article, we are going to build a simple Extract, Transform, and Load (ETL) data pipeline using Apache Airflow, and Cassandra. Airflow is going to be the orchestration tool and we are going to load our data into Apache Cassandra. Apache Airflow is an open-source project that was developed at Airbnb in 2015, and Apache Cassandra was a database that was created at Facebook and was later open-sourced to the public. The focus is going to be on writing to Cassandra using the Cassandra-Airflow provider.

In this blog, we discuss workflow orchestration using Cadence and Cassandra. We went through the problems that Cadence workflows help to solve in microservices developments. Also, we looked at the way Cadence is designed that allows us to solve these types of problems. Interestingly, we went a step forward by setting up Cadence locally using Docker images, and we created a simple Cadence workflow to show how Cadence works.

In Apache Cassandra Lunch #75: Getting Started with DataStax Enterprise (DSE) on Docker, we discussed getting started with DataStax Enterprise on Docker, we discussed some of the applications that make up the DataStax ecosystem. In the process we pulled some Docker images of the applications we are interested in and we got into working with the DSE Search, DSE Analytics with Spark, and DSE Graph on the Docker desktop. We were able to learn about these tools and their strengths. The live recording of Cassandra Lunch, which includes a more in-depth discussion and a demo, is embedded below in case you were not able to attend live. If you would like to attend Apache Cassandra Lunch live, it is hosted every Wednesday at 12 PM EST. Register here now!

In Apache Cassandra Lunch #70: Basics of Apache Cassandra, we discussed the basics of Apache Cassandra, we discussed why we need apache Cassandra, we also looked at some of the features of Cassandra. In the process, we were able to learn the background knowledge about Cassandra, we then went a step forward to set up a standalone Apache Cassandra. With the standalone Cassandra, we used Cassandra Query Language (CQL) to communicate and interact with the Cassandra database. The live recording of Cassandra Lunch, which includes a more in-depth discussion and a demo, is embedded below in case you were not able to attend live. If you would like to attend Apache Cassandra Lunch live, it is hosted every Wednesday at 12 PM EST. Register here now!