|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/microsoft-fabric-end-to-end-data-engineering-project/
课程评论：没有评论
课程名称：Microsoft Fabric: 完整的数据工程项目 课程概述：在本项目中，我们将构建一个必应新闻数据分析平台！这是一个完整的 Azure 数据工程项目，采用 Microsoft Fabric 实现。我们将从必应 API 获取原始数据，利用 Synapse 数据工程对原始数据进行清洗和转换，使用 Synapse 数据科学进行情感分析，通过数据工厂设置工作流，利用 Power BI 制作精彩报告，设置数据激活器的警报，并对整个流程进行充分测试。让我们开始必应新闻分析之旅吧！ 课程涵盖主题： 1. **数据摄取**：使用数据工厂从必应 API 无缝获取数据，为分析项目奠定基础。 2. **数据转换**：通过 Synapse 数据工程将原始 JSON 数据整理成精简的 Delta 表，学习增量加载等高效的处理技术。 3. **情感分析**：利用 Synapse 数据科学揭示新闻描述中隐藏的洞察，预测新闻的情感（积极、消极或中立）。 4. **数据工作流编排**：学习通过数据工厂的管道展现数据工作流的编排艺术，确保操作顺畅高效。 5. **数据报告**：使用 Power BI 以引人注目的方式可视化数据，赋能利益相关者获取宝贵的洞察。 6. **配置警报**：通过新工具数据激活器，在 Power BI 可视化中设置警报和通知，提前应对潜在问题。 7. **端到端管道测试**：测试从数据摄取到数据转换直至报告更新的完整流程，验证管道的完整性和性能，确保可靠性和准确性。 本项目围绕必应新闻数据分析这一实用应用展开，涉及日常新闻数据的摄取及生成深具洞察的报告。通过简化的方式逐步讲解，我旨在让所有热爱 Azure 数据工程的人士，无论背景如何，都能轻松掌握。本项目不要求任何技能，即使是完全的初学者，只需按照课程的步骤进行，即可实施该项目。唯一的前置条件是观看课程第一部分中包含的两段 Microsoft Fabric 的介绍视频。祝您学习顺利，学有所获！
In this project, we will build a Bing News Data Analytics platform! This would be a complete end to end Azure Data Engineering project that's done using Microsoft Fabric. We'll pull raw data from Bing API, transform the raw data to clean data with Synapse Data Engineering, analyze sentiment with Synapse Data Science, set up workflows with Data Factory, make cool reports with Power BI, set alerts with Data Activator, and test everything well. Let's get started on Bing News Analytics! The Topics covered in this Project are, 1. Data Ingestion from Bing API using Data Factory: Learn how to seamlessly pull in data from external sources, setting the foundation for your analytics project. 2. Data Transformation using Synapse Data Engineering: Dive into the process of shaping and refining your raw JSON data to a curated Delta Table, including techniques like incremental loading to keep your processes efficient. 3. Sentiment Analysis using Synapse Data Science: Uncover insights hidden within the news description by predicting the sentiment of the news classified as Positive, Negative or Neutral. 4. Orchestration using Data Factory via pipelines: Discover the art of orchestrating your data workflows, ensuring smooth and efficient operations. 5. Data Reporting using Power BI: Visualize your data in a compelling and actionable manner, empowering stakeholders with valuable insights. 6. Configuring Alerts using the Data Activator: Stay ahead of potential issues by setting up alerts and notifications within your Power BI visuals using a new tool called Data Activator. 7. End to End Pipeline Testing: The complete flow will be tested right from the data ingestion to the data transformation and until the report gets updated with the incoming new data to Validate the integrity and performance of your pipelines, ensuring reliability and accuracy. This project revolves around Bing News Data Analytics, a practical application that involves ingesting news data daily and generating insightful reports. By walking through each step in a simplified manner, I aim to make Azure Data Engineering accessible to all enthusiasts, regardless of their background. Pre-requisitesYou don't need to have any skills to do this project. Even if you are an absolute beginner, if you follow the entire course, you will be able to implement this project, The only pre-requisite for this project is, you need to two introductory videos of Microsoft Fabric which is included as part of this course in the section 1. All the very best and Happy Learning!!!
