Business Platform Team

Anant Corporation Blog: Our research, knowledge, thoughts, and recommendations about building and managing online business platforms.

Tag Archives: data engineering


Data Engineer’s Lunch #21: Python ETL Tools

In Data Engineer’s Lunch #21: Python ETL Tools, we discussed, compared, and contrasted a number of python tools that assist in running ETL pipelines. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you were not able to attend live. If you would like to attend a Data Engineer’s Lunch live, it is hosted every Monday at noon EST. Register here now!

Continue reading
introduction to sed for data engineering

Introduction to sed for Data Engineering

In this blog, we will introduce sed, a stream editor, and how we can use this tool for data engineering. We also include a walkthrough of a demo you can use to learn the basics. You can also check out this GitHub repository for the walkthrough instructions.

Continue reading

Data Engineer’s Lunch #4: Airflow for Data Engineering

In case you missed it, the fourth installment of our weekly data engineering lunch was presented by guest speaker Will Angel. It covered the topic of using Airflow for data engineering. Airflow is a scheduling tool for managing data pipelines. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you were not able to attend live. If you would like to attend a Data Engineer’s Lunch live, it is hosted every Monday at noon EST. Register here now!

Continue reading
Scripting / Shell Automations for Data Engineering

Data Engineer’s Lunch #3: Scripting / Shell Automation for Data Engineering

In Data Engineer’s Lunch #3: Scripting / Shell Automation for Data Engineering, we discuss a multitude of tools you can use to do scripting and shell automation for data engineering. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you were not able to attend live. If you would like to attend Data Engineer’s Lunch in person, it is hosted every Monday at 12 PM EST. Register here now!

Continue reading

Data Engineer’s Lunch #2: Common ETL Frameworks

ETL stands for Extract, Transform, and Load. This describes a process through which data becomes more refined. ETL is one of the main skills that data engineers need to master in order to do their jobs well. It was also the topic of our second ever Data Engineer’s lunch discussion. If you missed it, or just want an overview of available ETL frameworks, keep reading. The live recording of the Data Engineer’s Lunch, which includes a more in-depth discussion, is also embedded below in case you could not attend live. If you would like to attend a Data Engineer’s Lunch live, it is hosted every Monday at 12 PM EST. Register here now!

Continue reading