|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/cicd-with-databricks-asset-bundles/
课程评论：没有评论
**课程名称：** CI/CD with Databricks Asset Bundles (DAB) **课程概述：** 本课程旨在帮助您将 DevOps 和 CI/CD 实践应用于 Databricks 部署。您将深入学习 Databricks Asset Bundles (DAB)，这是 Databricks 官方的“工作空间即代码”框架，能够为您的分析平台带来真正的 DevOps 能力。通过本课程，您将学会将 Notebook、Job、Pipeline、集群配置、基础设施和工作空间配置打包成一个单一、版本化的单元。随后，您将自动化其验证、测试以及通过 CI/CD 管道进行多阶段部署。告别一次性操作和隐藏的配置漂移，实现可重复、可靠的版本发布。 **高阶课程大纲：** * **引言与核心概念：** * 了解 Databricks Asset Bundles 和 CI/CD 的基本概念。 * 回顾课程目标、“无限交付循环”以及如何查找每个动手实验模块的代码示例。 * **环境与设置：** * 配置 Azure Databricks 工作空间。 * 设置 VS Code。 * 安装 Databricks CLI。 * 准备 Databricks Connect，实现 IDE 驱动开发。 * **Asset Bundles 基础：** * 掌握核心的 `databricks bundles` 命令：`init`、`validate`、`deploy`、`run` 和 `destroy`。 * 学习如何在 `databricks.yml` 文件中定义、版本化和管理您的分析项目。 * **本地开发与单元测试：** * 集成 PyTest 用于单元和集成测试。 * 通过 CI 或 Databricks Connect 运行测试。 * 生成覆盖率报告以强制执行质量门。 * 理解如何在本地 PySpark 进行快速单元测试，以及如何使用 Databricks Connect 在真实集群上执行和调试代码，确保 IDE 与云端的一致性。 * **动手实战项目：** * 将所学知识应用于三个实际项目： * Notebook ETL 管道（Bronze→Silver→Gold）。 * Python 脚本任务和 `.whl` 打包的 Job。 * Delta Live Tables 流式处理管道。 * **Git 集成与 CI/CD 管道：** * 将项目集成到 Git。 * 采用基于分支的工作流。 * 构建 GitHub Actions 或 Azure Pipelines，以自动化构建、测试、预发布（含审批）和生产部署。 **课程产出：** 完成本课程后，您将能够为整个 Databricks 环境构建一个端到端的自动化 CI/CD 流程。
Are you ready to put DevOps and CI/CD to work in your Databricks deployments? In this course, you'll become an expert in Databricks Asset Bundles-the official "workspace-as-code" framework that brings true DevOps to your analytics platform. You'll learn to bundle notebooks, jobs, pipelines, cluster specs, infrastructure and workspace configurations into a single, versioned package-and then automate its validation, testing, and multi-stage deployment through CI/CD pipelines. No more one-off clicks or hidden drift-just repeatable, reliable releases.High-Level Curriculum OverviewIntroduction & Core ConceptsGet oriented with Databricks Asset Bundles and CI/CD concepts. Review the course goals, the "infinite delivery loop," and where to find code samples for each hands-on module.Environment & SetupProvision your Azure Databricks workspaces, configure VS Code, install the Databricks CLI, and prepare Databricks Connect for IDE-driven development.Asset Bundles FundamentalsLearn the core databricks bundles commands-init, validate, deploy, run, and destroy-and how to define, version, and manage your analytics project in databricks.yml.Local Development and Unit TestingIntegrate PyTest for unit and integration tests, run tests via CI or Databricks Connect, and generate coverage reports to enforce quality gates.Understand how to switch between local PySpark for rapid unit testing and Databricks Connect to execute and debug code on real clusters, ensuring parity between your IDE and the cloud.Hands-On ProjectsApply your knowledge in three practical hands-on projects:Notebook ETL pipelines (Bronze→Silver→Gold)Python script tasks and.whl-packaged jobsDelta Live Tables streaming pipelinesGit Integration & CI/CD PipelinesOnboard your project to Git, adopt branch-based workflows, and author GitHub Actions or Azure Pipelines to automate builds, tests, staging (with approval), and production rollouts.By the end of this course, you'll have an automated end to end CI/CD process for your entire Databricks environment.
