|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/build-a-data-mesh-using-azure-hands-on-real-world-scenario/
课程评论：没有评论
**课程总结：基于Azure构建数据网格（Data Mesh） - 实操与真实场景应用** 本课程将带您深入实践，学习如何利用微软的云平台Azure构建一个数据网格（Data Mesh）架构。课程结束时，您将对Azure Synapse Analytics有扎实的理解，并掌握其在数据摄取、转换和分析中的应用。 **核心内容与技能：** * **Azure Synapse Analytics 概览：** 熟悉Synapse中的各个Hub，并学会使用Serverless SQL Pools和Spark Pools。 * **关键概念与功能：** 深入理解OPENROWSET函数、显式数据类型、排序规则、数据库、外部数据源、链接服务、内置Copy Data工具、CETAS、管道（Pipelines）、活动（Activities）、数据流（Dataflows）、外部表（External Table）和视图（View）。 * **数据分析能力：** 掌握使用Spark和SQL进行数据分析。 * **数据网格（Data Mesh）理念：** 理解数据网格的核心概念、原则及其在真实世界场景中的应用，特别是数据域（Data Domains）的重要性。 * **Azure 数据湖存储 Gen2：** 学习使用Azure Data Lake Storage Gen2。 * **Azure RBAC：** 了解如何在Azure中分配内置角色。 * **领域驱动设计（DDD）的应用：** 探索DDD在构建模块化、可扩展数据基础设施中的作用。 * **去中心化数据管理：** 学习如何利用Azure实现数据管理的分权，通过Microsoft Entra ID（原Azure Active Directory）创建用户和组，并由领域特定团队构建数据域。 **课程目标：** 本课程旨在帮助您理解数据网格架构如何打破数据孤岛，赋能组织构建数据驱动的产品。无论您是数据工程师、数据科学家、数据分析师、业务分析师，还是其他IT职位，您都将能理解如何在新兴的数据网格架构下，实现高效、无缝的数据协作与价值创造。 **适用人群：** 数据工程师、数据科学家、数据分析师、业务分析师以及任何希望深入理解并实践Azure上数据网格架构的IT专业人士。
In this course, I will practically show you how to build a Data Mesh using Microsoft's cloud computing platform Azure. By the end of the course, you would have gained a solid understanding of Azure Synapse analytics, and how it can be used for data ingestion, transformation, and analysis. I will give you an overview of all the Hubs in Azure Synapse and show you how to use Serverless SQL Pools and Spark Pools. You will understand the OPENROWSET function, explicit data types, collation, database, external data source, linked service, built-in copy data tool, CETAS, pipelines, activities, dataflows, external table, and view. I will show how to perform data analysis using Spark and SQL. You will understand what data mesh is and its principles, and how it can be applied in a real-world scenario. You will learn about the importance of data domains. You will learn about azure data lake storage gen v2. You will learn about how to assign built-in roles in Azure. Furthermore, you would have explored the role of domain-driven design in creating a modular scalable data infrastructure. Data Mesh emphasizes the decentralization of data management, allowing teams to own their data and avoid dependencies on a central data team, you will learn about using Azure to create decentralized teams, in the Microsoft Entra Id previously Azure active directory we will create users and groups for the decentralized teams. Then we will build the data domains using the domain-specific teams. The principles of data mesh can help you build more robust and scalable data systems that meet your organization's needs. Whether you are a data engineer or a data scientist or a data analyst or a business analyst or whichever role in IT, at the end of this course you will understand how with the new Data Mesh architecture in place, the company can build data-driven products without any data silos.
