|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/data-engineering-cloud-google-bigquery-data-studio/
课程评论：没有评论
**课程名称：** 使用 Google BigQuery 和 Google Cloud 进行数据工程 **课程概述：** 本课程介绍 Google Cloud 中的数据仓库解决方案 BigQuery。BigQuery 是一款功能强大的数据仓库，能够存储和查询 PB 级数据，且无需用户进行任何基础设施的设置和管理。它不适用于日常事务性操作，但凭借其对标准 SQL 的支持，对于熟悉 Oracle、PostgreSQL、MySQL、Microsoft SQL Server 等关系型数据库的用户来说，上手非常容易。 课程将重点讲解 BigQuery 的现代功能，以简化实际工作。BigQuery 的主要优势在于其自动伸缩能力，无需担心存储大小、处理器数量或内存分配，并且用户仅需为数据处理付费，不收取内存或处理器资源费用。Google 还提供示例数据库供学员练习。 **课程内容亮点：** * **数据仓库概念与 BigQuery 的角色：** 了解数据仓库的定义及其在数据生态系统中的定位，以及 BigQuery 如何满足现代数据仓库的需求。 * **数据管道构建：** 学习如何创建简单的数据管道，包括数据输入（ ingestion）、数据清洗（cleansing）和数据可视化（visualization）。 * **数据工程工具与方法：** 掌握从各种来源将数据摄取到 BigQuery 的工具和技术。 * **Google Sheets & Data Studio 数据可视化：** 学习如何利用 Google Sheets 和 Data Studio 进行数据可视化，从而更好地解读数据。 **目标学员：** 本课程适合具备 SQLSQL 基础知识的学员。课程**不**会讲解 SELECT、FROM、WHERE、GROUP BY、ORDER BY 等基础 SQL 语法。但会将重点放在 BigQuery 中使用的现代化 SQL 语法。 **学习收益：** 如果你是一名负责创建数据管道的工程师，本课程将为你提供从多种数据源获取数据并进行处理的实用技能。通过本课程，你将能够高效地利用 Google BigQuery 和 Google Cloud 生态系统中的工具来构建和管理你的数据工程解决方案。
A data warehouse is a repository of historical data that is queried to answer questions, gain insight from data, and make business decisions. BigQuery is Google's product for data warehouse. It is designed to store and query terabytes, even petabytes of data without we need to setup and manage any infrastructure. It is not a transactional database for day-to-day operation. BigQuery supports standard SQL, so if you ever develop with relational database like Oracle, PostgreSQL, MySQL, Microsoft SQL Server, etc, it is easy to familiarize yourself with BigQuery. There are a few BigQuery functions to support modern-day requirements, and learning about them will make your job easier.There is no infrastructure required. We don't need to worry about the size of storage, number of processors, or memory allocation for processing query. BigQuery scales automatically to run query, and then release the resource when it is done. We don't even charged for memory or processor allocation.Google provides sample database for practice and trial.This course has several topics:an introduction, where we will see what this course aboutwhat is data warehouse and in which part BigQuery take roleshow we can create a simple data pipeline, including data input, data cleansing, and data visualizationtools and methods that can be used for data engineering, particularly on data ingestion from various sources to BigQuerydata visualization using Google Sheets & Data StudioThis course is for people with basic technical knowledge on SQL.This course is not basic SQL course, so we will not learn the meaning of basic sql such as SELECT, FROM, WHERE, GROUP BY, ORDER BYSee the preview video Technology in This Course for SQL keyword that we will not discuss on detailHowever, we will still learn some of modern SQL syntax that can be used in BigQueryIn this course we will also learn how to fetch data from several sources, so this is a good course if you are an engineer that responsible for creating data pipeline.
