Business Platform Team

Anant Corporation Blog: Our research, knowledge, thoughts, and recommendations about building and managing online business platforms.

Tag Archives: data engineering


Data Engineer’s Lunch #4: Airflow for Data Engineering

In case you missed it, the fourth installment of our weekly data engineering lunch was presented by guest speaker Will Angel. It covered the topic of using Airflow for data engineering. Airflow is a scheduling tool for managing data pipelines. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you were not able to attend live. If you would like to attend a Data Engineer’s Lunch live, it is hosted every Monday at noon EST. Register here now!

Continue reading
Scripting / Shell Automations for Data Engineering

Data Engineer’s Lunch #3: Scripting / Shell Automation for Data Engineering

In Data Engineer’s Lunch #3: Scripting / Shell Automation for Data Engineering, we discuss a multitude of tools you can use to do scripting and shell automation for data engineering. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you were not able to attend live. If you would like to attend Data Engineer’s Lunch in person, it is hosted every Monday at 12 PM EST. Register here now!

Continue reading

Data Engineer’s Lunch #2: Common ETL Frameworks

ETL stands for Extract, Transform, and Load. This describes a process through which data becomes more refined. ETL is one of the main skills that data engineers need to master in order to do their jobs well. It was also the topic of our second ever Data Engineer’s lunch discussion. If you missed it, or just want an overview of available ETL frameworks, keep reading. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you could not attend live. If you would like to attend a Data Engineer’s Lunch live, it is hosted every Monday at 12 PM EST. Register here now!

Continue reading

Data Engineer’s Lunch #1: Data Engineering Roadmap

In case you missed it, last week we started the first of what will be weekly Data Engineering lunch discussions on Monday, November 16th. The first lunch covered the Data Engineering Road-map. We discussed how to become a proficient data engineer and the various masteries that are required. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you were not able to attend live. If you would like to attend a Data Engineer’s Lunch live, it is hosted every Monday at 12 PM EST. Register here now!

Continue reading