• views: 121
• date: 18 April 2024
• posted by: voska89

Apache Airflow is a workflow orchestration tool, and primarily used in Big Data related project.
What you'll learn:
To get the basic understanding of Workflows, Apache Airflow basic features, Core Concepts, Familiarization with Airflow UI, XComs, Variables, Connections Hooks
You will also learn how to install Apache Airflow on Linux / Ubunto, in 2 different flavours, Install in Docker Container and Vanilla Installation
This course will help you enhance knowledge of ETL pipelines and how to orchestrate those ETL pipelines in Airflow Dags.
Dags in this course contains working examples of Apache Spark, Elasticsearch, Snowflake, Ecommerce Dag as well.
Requirements:
You should be familiar with Python, Scala Languages, Little bit of knowledge about concepts of Big Data, Some understanding about Apache Spark will be help full in understanding of this course.
Description:
Airflow is an extensive tool and has many different features. I will explain in details how we can take benefit from Airflow in our Big Data-related projects. In this Apache Airflow I will start from basic concepts, then move to Installation, Later will deep dive into advanced concepts. In the end, I will create a few big data-related projects and create Airflow Dag to give you a flavor of how all components of Airflow work together.Please note that Apache Airflow is not a Data Flow tool rather its a Workflow Orchestration tool, With such a nice and beautiful User Interface and a bundle of rich components available. When data is flowing through different processes it is difficult to monitor each and every process, if we are working in CLI based environment. Rather using Apache Airflow we can get notified by color scheming of tasks, and we can start the task right from where it has failed.I will show you different use cases of Big Data universe, in which we can take leverage from Apache Airflow. After completing this course Part 1, you will be find your self equipped with a new tool just to solve your Big Data use cases.
Who this course is for:
This Course is intended for Data Engineers, Big Data Architects, or for students those does not have prior knowledge of Apache Airflow.
Homepage

https://www.udemy.com/course/data-engineering-apache-airflow/

   
   
   

Forex Trading

Crypto Trading. 20 USD Bonus after KYC

We need your support!
Make a donation to help us stay online
        
Bitcoin (BTC)
bc1q08g9d22cxkawsjlf8etuek2pc9n2a3hs4cdrld
	
Bitcoin Cash (BCH)
qqvwexzhvgauxq2apgc4j0ewvcak6hh6lsnzmvtkem

Ethereum (ETH)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

Litecoin (LTC)
ltc1qt6g2trfv9tjs4qj68sqc4uf0ukvc9jpnsyt59u

USDT (ERC20)
0xb55513D2c91A6e3c497621644ec99e206CDaf239

USDT (TRC20)
TYdPNrz7v1P9riWBWZ317oBgJueheGjATm

0 1 2 3 4 5

| Print version |

	Information
		Users of GUESTS are not allowed to comment this publication.