|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/apache-spark-master-big-data-with-pyspark-and-databricks/
课程评论：没有评论
课程名称：Apache Spark：掌握大数据与PySpark和DataBricks 课程概述：本课程旨在帮助您掌握在Databricks中使用pyspark进行ETL操作的技能，构建生产级机器学习模型，学习Spark优化技术，并精通分布式计算。大数据工程师在大规模计算环境中与巨量数据处理系统和数据库互动，为组织提供分析，帮助评估性能、识别市场人口统计数据，并预测即将到来的变化和市场趋势。 Azure Databricks：Azure Databricks是一个为微软Azure云服务平台优化的数据分析平台，提供三种开发数据密集型应用程序的环境：Databricks SQL、Databricks数据科学与工程以及Databricks机器学习。 数据湖屋：数据湖屋是一种数据解决方案概念，结合了数据仓库和数据湖的元素。数据湖屋实现了数据仓库的数据结构和管理功能，更加经济高效地进行数据存储。 Spark结构化流处理：结构化流处理是建立在Spark SQL引擎之上的可扩展且容错的流处理引擎。简而言之，结构化流处理提供快速、可扩展、容错的端到端“精确一次”流处理，无需用户深入理解流处理的复杂性。 自然语言处理：自然语言处理（NLP）广义上定义为软件自动处理自然语言（如语音和文本）的能力。自然语言处理的研究已有50多年的历史，起源于语言学，并随着计算机的发展而发展壮大。
This course is designed to help you develop the skill necessary to perform ETL operations in Databricks using pyspark, build production ready ML models, learn spark optimization techniques and master distributed computing.Big Data engineering:Big data engineers interact with massive data processing systems and databases in large-scale computing environments. Big data engineers provide organizations with analyses that help them assess their performance, identify market demographics, and predict upcoming changes and market trends.Azure Databricks:Azure Databricks is a data analytics platform optimized for the Microsoft Azure cloud services platform. Azure Databricks offers three environments for developing data intensive applications: Databricks SQL, Databricks Data Science & Engineering, and Databricks Machine Learning.Data Lake House:A data lakehouse is a data solution concept that combines elements of the data warehouse with those of the data lake. Data lakehouses implement data warehouses' data structures and management features for data lakes, which are typically more cost-effective for data storage.Spark structured streaming:Structured Streaming is a scalable and fault-tolerant stream processing engine built on the Spark SQL engine..In short, Structured Streaming provides fast, scalable, fault-tolerant, end-to-end exactly-once stream processing without the user having to reason about streaming.Natural language processing:Natural Language Processing, or NLP for short, is broadly defined as the automatic manipulation of natural language, like speech and text, by software.The study of natural language processing has been around for more than 50 years and grew out of the field of linguistics with the rise of computers.
