|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/databricksazure/
课程评论：没有评论
**Azure Databricks 掌握计划 [真实场景+实验]** 本课程将带您深入了解 Azure Databricks，一个基于 Apache Spark 的云端大数据分析平台。课程内容涵盖了 Azure Databricks 的基础概念、架构、数据处理能力以及在机器学习领域的应用。 **核心内容：** * **Azure Databricks 概览与架构：** 理解 Azure Databricks 是什么，它解决了哪些挑战，以及其发展历程和核心架构（包括数据流架构）。 * **数据处理：** 学习如何使用 Azure Databricks 进行批量数据处理和实时流数据处理。 * **机器学习：** 掌握在批量数据上应用机器学习技术。 * **界面与工作空间：** 熟悉 Azure Databricks 的工作空间界面，包括数据管理、计算管理和模型管理。 * **身份验证与授权：** 了解如何进行身份验证和授权，以及如何登录 Azure 门户。 * **集群管理：** 学习如何创建、配置、启动、停止、重启集群，以及管理集群列表。 * **Notebook 操作：** 掌握创建、导入、导出、克隆、移动 Notebook，以及在 Notebook 中进行单元格操作、设置默认语言、使用快捷键和注释代码。支持 Python, Scala, SQL, R 语言 Notebook。 * **数据管理：** 学习如何在 Azure Databricks 中创建、描述、删除数据库和表（支持 UI 和 Notebook 操作），以及处理空数据库和非空数据库。 * **Databricks 文件系统 (DBFS)：** 了解 DBFS，学习如何创建目录和文件，读写文件内容，以及复制、移动和删除文件/目录。还包括文件系统的挂载和刷新。 * **包管理：** 学习如何安装和卸载库。 * **UI 交互与 Widgets：** 学习如何使用 UI 创建表，理解 UI 和 Notebook 创建表之间的区别。掌握 Widgets 的概念和用法，学习如何创建 Widgets 来传递动态参数值，并如何在 Notebook 中读取这些值，以及如何移除 Widgets。 * **Databricks CLI：** 学习如何安装和配置 Databricks CLI，以及如何通过 CLI 进行集群、Notebook 和文件系统的管理。 * **PySpark CSV 处理：** 学习如何使用 PySpark 读取 CSV 文件，包括单个文件、目录下的所有文件，以及在使用 `delimter`、`inferSchema`、`header` 等选项时进行配置，并学习如何使用用户指定的 schema 读取 CSV 文件。 * **作业管理：** 学习如何创建和运行作业。 本课程通过真实场景的示例和动手实验，帮助您全面掌握 Azure Databricks 的各项功能，成为一名 Azure Databricks 的专家。
What is Azure DatabricksChallenges to solutions with Azure DatabricksHistory of Azure DatabricksAzure Databricks ArchitectureAzure Databricks Data Flow ArchitectureBatch Data Processing with Azure DatabricksStream Data Processing with Azure DatabricksMachine Learning on batch data with Azure DatabricksInterfaceWorkspaceData ManagementComputation ManagementModel ManagementAuthentication and AuthorizationHow to login into azure portalHow to create Azure Databricks DashboardHomeWorkspaceRecentData ManagementComputation ManagementModel ManagementJob ManagementSearchCreating and configuring clusters in Azure DatabricksHow to create Python notebookHow to create Scala notebookHow to create SQL notebookHow to create R notebookHow to login into azure portalHow to create Azure Databricks Creating and configuring clusters in Azure DatabricksHow to create notebookHow to detach and attach notebook to another clusterHow to Export Notebook in different formatsHow to Import Notebook from different formatsHow to clone NotebookHow to move NotebookHow to change default language of NotebookHow to move cellsHow to create and delete cellsHow to use shortcuts to execute cellsHow to comment code in notebookAll Options available on NotebookHow to create new database in Azure DatabricksHow to describe database in Azure DatabricksHow to drop database in Azure DatabricksHow to drop Non empty database in Azure DatabricksHow to create table with UIHow to create table with NotebookDifference between table with UI and table with notebookHow to create table in specified database with UIHow to create table in specified database with NotebookHow to create empty table How to create Partition table with NotebookHow to append or overwrite partitions in tableHow to describe table in Azure DatabricksHow to drop table in Azure DatabricksHow to upload data into Databricks File SystemCommand to create directory in dbfsCommand to create file and write data to itCommand to display file contentCommand to list down content in a directoryCommand to move files from one directory to another directoryCommand to copy file from one directory to another directoryCommand to remove file and directories Command to mount and unmount file systemCommand to list down mountCommand to refresh mount pointsCommand to install the packagesCommand to find current notebook path/ from UICommand to run one notebook from another notebookCommand to exit notebook executionCommand to list down secret scopesWhat is widget and TypesHow to create widget to pass dynamic values to Python notebookHow to read dynamic parameter values in Python notebookHow to remove widget from python notebook How to create widget to pass dynamic values to Scala notebookHow to read dynamic parameter values in Scala notebookHow to remove widget from scala notebookHow to run notebook whenever we change the dynamic parameter valuesWidgets panel settingsPrerequisites to install databricks cliHow to install databricks cliHow to authenticate to databricks workspace from cliHow to create clusterHow to terminate clusterHow to start clusterHow to restart clusterHow to get list of clustersHow to get list of notebookHow to import notebook into databricks from localHow to export notebookHow to remove notebookHow to create foldersHow to get list of folders in dbfsHow to create folder in dbfsHow to copy files from local to dbfsHow to move file from one folder to another folderHow to remove files from dbfsHow to remove folders from dbfsHow to install librariesHow to uninstall librariesHow to create jobHow to run job 1. PySpark Read CSV file into DataFrameRead single fileRead all CSV files in a directory2. Options while reading CSV filedelimiterInferSchemaheader3. Read CSV files with a user-specified schema
