|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/azuredatafactory/
课程评论:没有评论
课程名称:Azure数据工厂大师课程 [实时场景+实验室] 课程概述: 本课程旨在深入探讨大数据的概念及其应用领域,特别是实时案例在金融、零售、旅游和医疗保健等行业中的具体应用。学员将学习什么是Azure数据工厂,以及无代码ETL(提取、转换、加载)服务的优势。此外,课程还会详细介绍Azure数据工厂的各种功能,包括Linked Services、数据集、活动、管道、触发器和参数等。 课程内容包括: - 大数据的定义及其生成领域 - 实时场景分析 - Azure数据工厂的基本构建块和工作原理 - 创建免费的Azure订阅及Azure门户的快速入门 - 整合运行时(Integration Runtime)和其不同类型的比较 - 存储账户的概念及其组成,如Blob存储、文件、队列和表等 - 通过UI和PowerShell创建Azure数据工厂V2 - 数据流图的概念及数据调试的功能 - 实际操作演示,包括数据上传、管道创建及调试等 - 不同文件格式(如CSV和JSON)之间的复制和处理策略。 通过本课程,学员将掌握如何在Azure环境中有效管理和处理大数据,灵活运用Azure数据工厂进行数据的提取、转换和加载,为未来的职业发展奠定坚实基础。
What is Big DataDifferent domains which generates Big DataReal-time use case - financeReal-time use case - RetailReal-time use case - TravelReal-time use case - Health CareScenarioWhat is azure data factoryCode Free ETL as a ServiceWhy Azure Data Factory Linked ServicesDatasetsActivityPipelineTriggersParametersAzure data factory v2 data flow architecturePrerequisites to create Free Subscription in azureHow to create Azure Free SubscriptionHow to login Into Azure PortalA Quick tour on azure portalWhat is subscriptionWhat is resource groupWhat is location/regionWhat is integration runtimeWhat are the different types of Integration Runtimes(IR)What is Azure IRWhat is Self-Hosted IRWhat is SSIS IRWhich integration runtime should I use?Integration runtime locationWhat is auto-resolve integration runtimeDetermining which IR to useOverview DiagramWhat is Storage AccountWhat is File, Queue and Table in Storage AccountWhat is Blob Storage and TypesStorage tiersStorage performance TierData RedundancyDemoCreate Storage AccountUpload data into Storage AccountCreate Azure Data Factory V2 through UICreate Azure Data Factory V2 through powershellAzure Blob Storage containersCSV File OverviewData flow diagramEstimationsDebugging Functionality in Azure Data FactoryPrerequisitesRequired ResourcesNaming convensionsDemoCreate Storage AccountUpload file into Storage AccountCreate Azure Data Factory V2Create Linked Service for blob storage using Integration RuntimeCreate Source Data ReferenceCreate Sink Data ReferenceCreate PipelineDebug PipelineRun PipelineMonitor PipelineCopy multiple csv files from inputcsv container to outputcsv container as csv fileCopy specific extension files from input container to output container as specified file format.Copy two types of files json and csv from inputcsvjson container to outputcsvjson container as source formatDynamic Copy ActivityCopy files based on filenames from input container to output container as csv formatCopy selected file based on filename from input container to output container as source formatCopy two types of files json and csv from input container to output container as csv filesCopy two types of files json and csv from input container to output container as csv filesHow to add timestamp for files while copying from input container to output containerCopy Json and CSV files from input container to jsoncontainer and csvcontainer.