|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/databricks-data-engineer-associate/
课程评论:没有评论
课程名称:Databricks 认证数据工程师助理考试指南 概述:欢迎参加我们的Databricks 认证数据工程师助理认证综合课程。本课程旨在帮助您掌握成为认证Databricks数据工程师助理所需的技能。Databricks是一个基于云的数据分析平台,提供统一的数据处理、机器学习和分析方法。随着对数据工程师需求的不断增长,Databricks已成为行业中最受欢迎的技能之一。 在本课程中,您将学习Databricks的核心概念,包括Databricks Lakehouse平台、使用Spark SQL和Python进行的ELT、增量数据处理、生产管道以及数据治理。本课程由在Databricks和数据工程领域拥有多年经验的行业专家设计,结合理论概念和动手实验室,帮助您应用所学知识。 完成课程后,您将能够自信地参加Databricks认证数据工程师助理考试,为自己的数据工程师职业生涯打下坚实基础。通过本课程,您应该能够: 1. 理解Databricks Lakehouse平台及其工具的使用及优势,包括: - 数据湖屋(架构、描述、优势) - 数据科学和工程工作区(集群、笔记本、数据存储) - Delta Lake(基本概念、表管理、操作、优化) 2. 使用Apache Spark SQL和Python构建ETL管道,包括: - 关系实体(数据库、表、视图) - ELT(创建表、写入数据、清理数据、组合和重塑表、SQL UDFs) - Python(通过字符串操作和控制流为Spark SQL提供便利,数据在PySpark和Spark SQL之间传递) 3. 增量处理数据,包括: - 结构化流(基本概念、触发器、水印) - 自动加载器(流读取) - 多跳架构(青铜-白银-黄金、流应用) - Delta Live Tables(优势和功能) 4. 为数据工程应用和Databricks SQL查询及仪表板构建生产管道,包括: - 作业(调度、任务编排、用户界面) - 仪表板(端点、调度、警报、刷新) 5. 理解和遵循最佳安全实践,包括: - Unity Catalog(优势和功能) - 实体权限(基于团队的权限、基于用户的权限) 立即注册,迈出成为认证Databricks数据工程师助理的第一步。
Welcome to our comprehensive course on Databricks Certified Data Engineer Associate certification. This course is designed to help you master the skills required to become a certified Databricks data engineer associate.Databricks is a cloud-based data analytics platform that offers a unified approach to data processing, machine learning, and analytics. With the growing demand for data engineers, Databricks has become one of the most sought-after skills in the industry.In this course, you'll learn the core concepts of Databricks, including Databricks Lakehouse Platform, ELT with Spark SQL and Python, Incremental Data Processing, Production Pipelines, and Data Governance.This course is designed by industry experts with years of experience in Databricks and data engineering. This course has theoretical concepts and hands-on labs to help you apply the concepts learned in the course.Upon completion of the course, you'll be able to take the Databricks Certified Data Engineer Associate exam with confidence and succeed in your career as a data engineer.At the end of this course you should be able to:Understand how to use and the benefits of using the Databricks Lakehouse Platform and its tools, including:Data Lakehouse (architecture, descriptions, benefits)Data Science and Engineering workspace (clusters, notebooks, data storage)Delta Lake (general concepts, table management, manipulation, optimizations)Build ETL pipelines using Apache Spark SQL and Python, including:Relational entities (databases, tables, views)ELT (creating tables, writing data to tables, cleaning data, combining and reshaping tables, SQL UDFs)Python (facilitating Spark SQL with string manipulation and control flow, passing data between PySpark and Spark SQL)Incrementally process data, including:Structured Streaming (general concepts, triggers, watermarks)Auto Loader (streaming reads)Multi-hop Architecture (bronze-silver-gold, streaming applications)Delta Live Tables (benefits and features)Build production pipelines for data engineering applications and Databricks SQL queries and dashboards, including:Jobs (scheduling, task orchestration, UI)Dashboards (endpoints, scheduling, alerting, refreshing)Understand and follow best security practices, including:Unity Catalog (benefits and features)Entity Permissions (team-based permissions, user-based permissions)Enroll now and take the first step towards becoming a certified Databricks data engineer associate.