|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/data-engineering-with-google-dataflow-and-apache-beam/
课程评论：没有评论
Coursera 课程总结：使用 Google Cloud Dataflow 和 Apache Beam 进行数据工程 本课程旨在介绍 Apache 基金会最新的数据管道开发框架——Apache Beam，以及它与 Google Cloud Dataflow 的结合如何日益普及。课程内容涵盖以下要点： 1. **Apache Beam 深入解析：** 理解其内部工作原理。 2. **优势与收益：** 阐述使用 Apache Beam 的核心优势。 3. **本地开发环境：** 通过 Google Colab 实现无需安装即可进行开发。 4. **主要功能介绍：** 讲解 Apache Beam 的核心功能。 5. **本地 Python SDK 配置：** 指导如何在本地环境中配置 Apache Beam Python SDK。 6. **部署至 Google Dataflow：** 演示如何将资源部署到 Google Dataflow 以构建批处理管道。 **重要提示：** * 本课程**不教授 Python 基础**，但会有效利用 Python。学习者应具备 Python 基础知识，包括函数定义、对象创建和数据类型。 * **Section 4（部署至 Google Dataflow）** 要求注册 GCP **免费套餐**，这需要提供信用卡信息，但通常不会产生费用。 * 课程内容会根据需要**持续更新**。 **课程要求：** * 具备 Python **基础知识**。 * 本地安装 **Python 3.7 或更高版本**（用于 Section 4）。 * 拥有 GCP **免费账号**（用于 Section 4）。 **课程安排：** * **Section 2：** 概念 * **Section 3：** 主要功能 * **Section 4：** Apache Beam on Google Cloud Dataflow 感谢您对本课程的关注！希望您能通过课程获得宝贵的知识。
This course wants to introduce you to the Apache Foundation's newest data pipeline development framework: The Apache Beam, and how this feature is becoming popular in partnership with Google Dataflow. In a summary, we want to cover the following topics:1. Understand your inner workings2. What are your benefits3. Explain how to use on your local machine without installation via Google Colab for development4. Its main functions5. Configure Apache Beam python SDK locallyvice6. How to deploy this resource on Google Dataflow to a Batch pipeline This course is dynamic, you will be receiving updates whenever possible.It is important to remember that this course does not teach Python, but uses it. So, get comfortable with knowing Python basics, defining a function, creating objects and data types.Also, if you are interested in learning section 4, which consists of deploying a pipeline on Google Dataflow, you will need to have a free counter in GCP. It's a simple process, but it requires a credit card!I kindly ask you you to consider all the efforts to put this course together and give a nice rate at the end of the course, even tough the course is simple, it was made with all good intent to share knowledge for cheap price. Thanks and hope you enjoy!___________________________________________________________________________________________________________Requirements:· Basic knowledge of Python· Have Python 3.7 or greater installed locally (from section 4)· Free account at GCP (from section 4)Schedule:· Section 2 - Concepts· Section 3 - Main Functions· Section 4 - Apache Beam on Google Dataflow
