|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/etl-using-python-mysql-to-bigquery/
课程评论：没有评论
课程名称：使用Python进行ETL：从MySQL到BigQuery 课程简介：本课程直接而简明，旨在快速教会您如何将数据从MySQL进行ETL转移到BigQuery。课程内容分为多个简短的操作指南，适合在周末学习，以便在周一早上展示您的新技能！ 课程内容包括： - 设置：GCP账户的创建、安全性凭证与认证、Python环境的搭建。 - 数据提取：使用Python连接MySQL，使用Python的pandas库导出数据，以及保存文件的Python库使用。 - 数据转换：使用Python函数和pandas库对数据进行转换，以及在提取过程中的内联SQL用于数据转换。 - 数据加载：使用BigQuery Python库连接BigQuery，将数据加载到BigQuery，增量加载与截断加载的比较，以及加载过程中的其他数据处理选项。 完成本课程后，您将掌握以下技能： - 使用Python连接MySQL。 - 学习如何隐蔽您的数据库凭据以保护安全。 - 使用os模块来保存文件并减少硬编码。 - 在ETL的转换阶段利用Python和pandas库实现数据的实时转换。 - 轻松使用Google BigQuery的模块/库进行数据加载。 享受学习的过程，继续不断成长！
This is a direct and to the point course that will get you quickly ETL'ing data from MySQL to BigQuery. The lessons in this course are broken out into short How-Tos. Therefore you can take this course over the weekend and be ready to show off your skills on Monday morning!Things that we will cover:SetupSetting up a GCP AccountCredential and Authentication for securityPython Environment SetupExtractUse Python to connect to MySQLUse Python's pandas to export dataPython library usage for saving files to file pathsTransformUse Python functions to transform dataUse Python pandas to transform dataUse inline SQL during Extract for data transformationLoadUse the BigQuery Python libraryConnect to BigQueryLoad data to BigQueryIncremental Loads vs Truncate and LoadOther data handling options during LoadAfter taking this course, you'll be comfortable with the following pretty cool things:Connect to MySQL using PythonLearn how to obscure your database credentials so you're not exposing them in your codeUsage of the os module for the purpose of saving files and hard coding fewer things.Use both Python and the pandas library to transform data on the fly during the Transformation phase of your ETLLearn how to use GBQ's modules/libraries to make the loading of the data a very easy, straightforward taskHave fun, enjoy and keep growing!
