|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/data-engineering-apache-airflow/
课程评论：没有评论
**Coursera 课程总结：数据工程 - Apache Airflow** 本课程深入探讨了 Apache Airflow，一个功能强大且广泛的应用，专注于其在处理大数据项目中的应用。课程将从基本概念入手，详细讲解 Airflow 的安装过程。随后，课程将深入研究 Airflow 的高级功能。 课程的亮点在于，学员将通过构建几个与大数据相关联的项目来实践 Airflow 的应用。通过创建 Airflow DAGs（有向无环图），学员将直观地理解 Airflow 各个组件如何协同工作。 特别强调的是，Apache Airflow 并非一个数据流工具，而是一个工作流编排工具。它提供了漂亮的图形用户界面和丰富的组件，极大地改善了在命令行环境中难以监控大数据处理流程的局面。通过 Airflow 的颜色编码任务状态，用户可以清晰地了解任务的执行情况，并且能够从故障发生处轻松地重新启动任务。 课程还将展示各种大数据领域的用例，说明如何有效利用 Apache Airflow。完成本课程（第一部分）后，学员将掌握一项强大的新工具，能够自信地解决他们在大数据应用中的各种挑战。
Airflow is an extensive tool and has many different features. I will explain in details how we can take benefit from Airflow in our Big Data-related projects. In this Apache Airflow I will start from basic concepts, then move to Installation, Later will deep dive into advanced concepts. In the end, I will create a few big data-related projects and create Airflow Dag to give you a flavor of how all components of Airflow work together.Please note that Apache Airflow is not a Data Flow tool rather its a Workflow Orchestration tool, With such a nice and beautiful User Interface and a bundle of rich components available. When data is flowing through different processes it is difficult to monitor each and every process, if we are working in CLI based environment. Rather using Apache Airflow we can get notified by color scheming of tasks, and we can start the task right from where it has failed.I will show you different use cases of Big Data universe, in which we can take leverage from Apache Airflow. After completing this course Part 1, you will be find your self equipped with a new tool just to solve your Big Data use cases.
