|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/two-real-world-azure-data-engineer-projects-end-to-end/
课程评论：没有评论
**课程名称：** 2个真实世界 Azure 数据工程师项目端到端 **课程概述：** 本 Coursera 课程专注于为学习者提供扎实的 Azure 数据工程概念准备和掌握。课程摒弃了像 COVID 或 Twitter 分析等常见的案例，而是专注于作者本人实际应用并为大型客户开发的真实世界项目。 **课程亮点：** * **内容精炼：** 课程直击核心，不冗余，最大化节省学习者时间。 * **真实场景实施：** 使用实际用例，而非虚拟场景，提供真切的学习体验。 * **简历增值：** 学习成果可加入简历，有效展示实际项目经验。 * **面试助力：** 帮助学习者在面试和讨论中自信地展示其技能和经验。 * **复杂架构设计：** 涵盖与行业最佳实践一致的复杂架构解决方案。 * **多组件集成：** 单个项目涉及 Azure Data Factory (ADF)、Azure Data Lake Storage (ADLS)、Databricks、Azure SQL Database、Key Vault 等多个组件的集成。 * **解决经验缺失难题：** 为新晋数据工程师提供宝贵的真实项目经验。 * **行业最佳实践：** 课程设计遵循数据工程项目和解决方案中的行业普遍最佳实践。 **涉及技术：** * Azure Data Lake Storage Gen 2 * Azure Data Factory * Data Factory Pipeline * Azure Functions * Azure Key Vault * Azure SQL Database * SQL Server Management Studio (SSMS) * AWS S3 Bucket * ADF 与 Databricks 连接 * Databricks 与 SQL Server 连接 * Databricks 与 ADLS 连接 * S3 与 Azure Cloud 连接 * Triggers * SAS token * Databricks 创建 Secrets scope * Key Vault 存储和访问 Secrets **学习收获：** * 掌握数据工程领域的解决方案思考、设计和开发流程。 * 学会绘制数据工程项目架构图。 * 指导如何创建 Azure Data Factory、Azure Data Lake Storage Gen 2、Azure Databricks Workspace 和 S3 存储账户。 * 讲解如何创建 Azure Function。 * 教授如何使用 PySpark 在 Databricks 笔记本中实现业务逻辑。 * 演示如何将 ADF 连接到 Databricks。 * 理解如何将项目的多个部分串联起来。 * 指导创建 Azure SQL Server。 * 学习如何将数据从文件加载到 Azure SQL Server。 * 掌握如何将 Databricks 笔记本连接到 Azure SQL Server。 * 教授如何在 Azure Key Vault 中存储 Secrets。
This course will help you in preparing and mastering your Azure Data engineering Concepts.It is not like any random project like covid, or twitter analysis. These project is real world projects on which I personally worked and developed it for big clients.Highlights of the Course:Designed to keep only précised information no beating around the bush. (To save your time).Real time implementation, no dummy use case.Can be added as part of your resume.It will help you to showcase your experience in interviews and discussion.Involve complex architecture solution which is aligned with industry best practices.Single projects involve various component integration like ADF, ADLS, Databricks, Azure SQL DB, Key Vault.Solves the problem of real time experience for new Data engineers.This course has been developed in mind to keep all the best practices followed in the Industry as an data engineering project and solution.Technologies involved:Azure Data Lake Storage Gen 2Azure Data FactoryData Factory PipelineAzure FunctionsAzure Key VaultAzure SQL DBSSMSAWS S3 BucketConnect ADF to DatabricksConnect Databricks to SQL ServerConnect Databricks to ADLSConnect S3 to Azure CloudTriggersSAS tokenCreate Secrets scope in DatabricksStore secretes in Key Vault and access themWhat you will learn after this course:How to think, design and develop the solution in the data engineering world.How to create the architecture diagram for data engineering projects.How to Create Azure Data Factory AccountHow to Create Azure Data Lake Storage Gen 2 account.How to Create Azure Databricks Workspace.How to create S3 storage account.How to create Azure Function.How to implement logic in the Databricks notebook using pyspark.How to connect ADF to Databricks.How to chain the multiple pieces together in project.How to create Azure SQL Server.How to load the data from file to Azure SQL server.How to connect Databricks notebook with Azure SQL Server.How to Store secrets in the Azure Key Vault.
