|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/azure-data-factory-data-engineer-real-time-projects/
课程评论:没有评论
课程总结:Azure数据工厂大师班 - 2025年数据工程师 欢迎参加“Azure数据工厂 - 数据工程师:真实项目”课程。在本课程中,您将学习如何使用Azure数据工厂V2进行ETL和大数据处理。Azure数据工厂(ADF)是当前云计算中最受欢迎的数据工程工具之一。从现实世界的场景出发,本课程将深入探讨使用ADF解决数据工程问题的方法。 完成本课程后,您将能够自信地处理任何相当于10年以上经验的项目。整个课程基于实际案例,涵盖各种领域中常见的项目需求。这将帮助您掌握必要的技能,并为通过DP200和DP203等认证考试做好充分准备。 课程内容包括: - 建立实时数据管道的实际操作。 - 使用ADF的数据流转换数据并加载到ADLS2和Blob存储。 - 从SQL Server到API端点摄取JSON数据的技巧。 - 如何构建生产级的管道,并掌握良好的实践和命名标准。 - 使用ADF、Azure Monitor和Log Analytics监控管道的真实项目经验。 - 手动触发器的使用及其在数据管道调度中的应用。 - 创建数据驱动、全集成、动态和自动化的生产级管道,以及如何进行编排。 - 理解数据仓库概念,如事实表和维度表、SCD类型1和类型2、增量加载等,并利用ADF实现。 - 如何通过自托管集成运行时从本地数据存储或SQL Server将数据传输到云端。 - 如何从REST API、Azure Blob存储和SQL数据库中摄取数据到Azure Data Lake Gen2。 此课程非常适合希望在数据工程领域提升技能的学习者。
Welcome to the Course "Azure Data Factory - Data Engineer: Real Time Projects".Learn ETL and Big Data Processing on Azure with Azure Data Factory V2Azure Data Factory (ADF) is one of the in-demand data engineering tool in the Cloud. This course has been taught with covering a data engineering solutions using ADF for real world scenarios.Once you complete this course including assignments, quizzes, you will be in a position to take up or handle confidently any kind of projects one equal to 10+ years of experience.Entire course built based on real time scenarios which are going to use very frequently and common to any type of projects on various domains.This course will gives you necessary skills and help you greatly to pass for Certification exams like DP200 and DP203.What this course will teach you?You will learn how to build a real time data pipeline in Azure Data Factory (ADF).You will learn how to transform data using Data Flows in Azure Data Factory (ADF) and load into ADLS2, Blob storage.You will learn how to ingest JSON data from SQL Server to API end point.You will learn how to build production ready pipelines and good practices and naming standards.You will learn how to monitor pipelines using Azure Data Factory (ADF), Azure Monitor and Log Analytics with a real-world project.You will learn about manual/Triggers in Azure Data Factory (ADF) and how to use them to schedule the data pipelines.Create Data driven, fully integrated, dynamic and automated production grade pipeline creation and orchestration.Data Warehousing Concepts like Fact & dimension tables, SCD type1, type2, Incremental loading and implement using ADF.Connect & copy data from On Premise data stores, On premise SQL server via Self Hosted Integration Runtime to cloud.How to ingest data from sources such as REST API, Azure Blob Storage, SQL DB into Azure Data Lake Gen2 using Azure Data Factory (ADF)