|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/basic-data-engineering-for-beginner-using-google-cloud-python/
课程评论：没有评论
**课程名称：** 使用 Google Cloud & Python 的数据工程入门 **课程概述：** 本课程旨在为希望进入数据工程领域的朋友们提供入门级的基础知识。数据在数字时代如同工业时代的石油，但原始数据本身无法直接使用。数据工程师的角色是将数据收集、连接并以高效的方式转化为可用的格式，为数据科学家和机器学习工程师提供价值。 **课程内容涵盖：** * 数据工程简介 * 关系型与非关系型数据库 * 关系型与非关系型数据模型 * 表规范化 * 事实表与维度表 * 用于数据仓库的表反规范化 * 使用 Python Pandas 进行 ETL（提取、转换、加载）与数据暂存 * Elasticsearch 基础 * 数据仓库 * 工程师应知的数字及其与大数据关系 * Hadoop * Google Cloud Dataproc 上的 Spark 集群 * 数据湖 **重要提示：** * 本课程是数据工程领域的基础入门，适合有 Python 和 SQL 编程经验的初学者。 * 如果您没有 Python 或 SQL 的基础知识，本课程可能不适合您。 * 如果您已有数据工程领域的经验，本课程可能偏基础。 **适合人群：** 对数据工程感兴趣、具备 Python 和 SQL 基础知识的初学者。
"Data is the new oil". You might have heard the quote before. Data in digital era is as valuable as oil in industrial era. However, just like oil, raw data itself is not usable. Rather, the value is created when it is gathered completely and accurately, connected to other relevant data, and done so in a timely manner.Data engineers design and build pipelines that transform and transport data into a usable format. A different role, like data scientist or machine learning engineer then able to use the data into valuable business insight. Just like raw oil transformed into petrol to be used through complex process.To be a data engineer requires a lot of data literacy and practice. This course is the first step for you who want to know about data engineering. In this course, we will see theories and hands-on to introduce you to data engineering. As data field is very wide, this course will show you the basic, entry level knowledge about data engineering process and tools.This course is very suitable to build foundation for you to go to data field. In this course, we will learn about:Introduction to data engineeringRelational & non relational databaseRelational & non relational data modelTable normalizationFact & dimension tablesTable denormalization for data warehouseETL (Extract Transform Load) & data staging using pyhton pandasElasticsearch basicData warehouseNumbers every engineers should know & how it is related to big dataHadoopSpark cluster on google cloud dataprocData lakeImportant NotesData field is HUGE! This course will be continuously updated, but for time being, this contains introduction to concept, and sample hands-on for data engineering. For now, this course is intended for beginner on data engineering. If you have some experience on programming and wonder about data engineering, this course is for you.If you have experience in data engineering field, this course might be too basic for you (although I'm very happy if you still purchase the course)If you never write python or SQL before, this course is not for you. To understand the course, you must have basic knowledge on SQL and pyhton.
