Automate Data Pipelines (training)

Colleagues, in the Automate Data Pipelines: Learn to build pipelines leveraging Airflow DAGs to organize your tasks along with AWS resources such as S3 and Redshift. Gain high-demand skills including Automate Data Pipelines, Apache Airflow, Data pipeline dags, Data pipeline partitioning, Amazon s3, Data pipeline maintenance,  Redshift, Data pipeline creation and Data lineage. Lessons: 1) Introduction to Automating Data Pipelines. Welcome to Automating Data Pipelines. In this lesson, you'll be introduced to the topic, prerequisites for the course, and the environment and tools you'll be using to build data pipelines, 2) Data Pipelines - learn the components of a data pipeline including Directed Acyclic Graphs (DAGs). You'll practice creating data pipelines with DAGs and Apache Airflow, 3) Airflow and AWS - create connections between Airflow and AWS first by creating credentials, then copying S3 data, leveraging connections and hooks, and building S3 data to the Redshift DAG, 4) Data Quality - track data lineage and set up data pipeline schedules, partition data to optimize pipelines, investigating Data Quality issues, and write tests to ensure data quality, 5) Production Data Pipelines - learn how to build Pipelines with maintainability and reusability in mind. They will also learn about pipeline monitoring, and 6) Hands-on Project: Data Pipelines - work on a music streaming company’s data infrastructure by creating and automating a set of data pipelines with Airflow, monitoring and debugging production pipelines.

Enroll today (teams & executives are welcome): https://imp.i115008.net/4P0JMn 

Download your free Data Science - Career Transformation Guide.

For your listening-reading pleasure:

Explore our Data-Driven Organizations Audible and Kindle book series on Amazon:

1 - Data-Driven Decision-Making  (Audible) (Kindle)

2 - Implementing Data Science Methodology: From Data Wrangling to Data Viz (Audible) (Kindle)

Much career success, Lawrence E. Wilson - Data Science Academy (share with your team)