|
所在平台: Coursera |
课程主页: https://www.coursera.org/learn/data-enginering-capstone-project
课程评论：没有评论
课程名称：数据工程顶点项目 课程概述：在本课程中，学员将应用在IBM数据工程专业证书课程中学习的各种数据工程技能和技术。学员将扮演一名新加入组织的初级数据工程师，并面临一个需要数据工程解决方案的真实案例。 课程大纲： 1. **数据平台架构与OLTP数据库** - 描述：在本模块中，您将设计一个使用MySQL作为OLTP数据库的数据平台，利用MySQL存储OLTP数据。 2. **在NoSQL数据库中查询数据** - 描述：在本模块中，您将设计一个使用MongoDB作为NoSQL数据库的数据平台，用于存储电子商务目录数据。 3. **构建数据仓库** - 描述：在本模块中，您将设计并实施一个数据仓库，并从数据仓库生成报告。 4. **数据分析** - 描述：在本模块中，您将担任一家电子商务公司的数据工程师。公司完成了数据仓库的搭建，您负责设计一个反映业务关键指标的报告仪表板。 5. **ETL与数据管道** - 描述：在本模块中，您将使用提供的Python脚本执行各种ETL操作，移动数据从RDBMS到NoSQL、从NoSQL到RDBMS，以及从RDBMS和NoSQL到数据仓库。您将编写一个管道，分析Web服务器日志文件，提取所需的行和字段，进行转换和加载数据。 6. **使用Spark进行大数据分析** - 描述：在本模块中，您将使用来自Web服务器的数据分析搜索术语，并加载预训练的销售预测模型，预测未来一年的销售预测。 7. **最终提交与同伴评审** - 描述：在最后一个模块中，您将完成自己的提交，包括来自实践实验室的截图供同伴评审。在完成提交后，您将审查并评分一位同伴的提交。 通过本课程，您将能够全面提升数据工程方面的实际操作能力。
Part: 1
Title:Data Platform Architecture and OLTP Database
Description:In this module, you will design a data platform that uses MySQL as an OLTP database. You will be using MySQL to store the OLTP data.
Part: 2
Title:Querying Data in NoSQL Databases
Description:In this module, you will design a data platform that uses MongoDB as a NoSQL database. You will use MongoDB to store the e-commerce catalog data.
Part: 3
Title:Build a Data Warehouse
Description:In this module you will design and implement a data warehouse and you will then generate reports from the data in the data warehouse.
Part: 4
Title:Data Analytics
Description:In this module, you will assume the role of a data engineer at an e-commerce company. Your company has finished setting up a data warehouse. Now you are assigned the responsibility to design a reporting dashboard that reflects the key metrics of the business.
Part: 5
Title:ETL & Data Pipelines
Description:In this module, you will use the given python script to perform various ETL operations that move data from RDBMS to NoSQL, NoSQL to RDBMS, and from RDBMS, NoSQL to the data warehouse. You will write a pipeline that analyzes the web server log file, extracts the required lines and fields, transforms and loads data.
Part: 6
Title:Big Data Analytics with Spark
Description:In this module, you will use the data from a webserver to analyse search terms. You will then load a pretrained sales forecasting model and predict the sales forecast for a future year.
Part: 7
Title:Final Submission and Peer Review
Description:In this final module you will complete your submission of screenshots from the hands-on labs for your peers to review. Once you have completed your submission you will then review the submission of one of your peers and grade their submission.
In this course you will apply a variety of data engineering skills and techniques you have learned as part of the previous courses in the IBM Data Engineering Professional Certificate. You will assume the role of a Junior Data Engineer who has recently joined the organization and be presented with a real-world use case that requires a data engineering solution.
