Distributed Computing with Spark SQL

所在平台: CourseraArchive

课程类别: 其他类别

大学或机构: CourseraNew

课程主页: https://www.coursera.org/archive/spark-sql

课程评论:没有评论

第一个写评论        关注课程

课程大纲

Introduction to Spark
Spark Core Concepts
Engineering Data Pipelines
Machine Learning Applications of Spark

课程评论(0条)

课程详情

This course is for students with SQL experience and now want to take the next step in gaining familiarity with distributed computing using Spark. Students will gain an understanding of when to use Spark and how Spark as an engine uniquely combines Data and AI technologies at scale. The four modules build on one another and by the end of the course the student will understand: Spark architecture, Spark DataFrame, optimizing reading/writing data, and how to build a machine learning model. The first module will introduce Spark, including how Spark works with distributed computing and what are Spark Dataframes. Module 2 covers the core concepts of Spark such as storage vs. computing, caching, partitions and Spark UI. The third module looks at Engineering Data Pipelines covering connecting to databases, schemas and type, file formats and writing good data. The final module looks at the application of Spark with Machine Learning through the business use case, a short introduction to what machine learning is, building and applying models and a final course conclusion. By understanding when to use Spark, either scaling out when the model or data is too large to process on a single machine, or having a need to simply speed up to get faster results, students will hone their SQL skills and become a more adept Data Scientist.

使用Spark SQL进行分布式计算:本课程面向有SQL经验的学生,现在希望进一步了解使用Spark进行分布式计算。学生将了解何时使用Spark,以及Spark作为引擎如何独特地大规模结合数据和AI技术。这四个模块是相互构建的,到课程结束时,学生将理解:Spark架构,Spark DataFrame,优化读取/写入数据以及如何构建机器学习模型。第一个模块将介绍Spark,包括Spark如何与分布式计算一起使用以及什么是Spark Dataframe。模块2涵盖了Spark的核心概念,例如存储与计算,缓存,分区和Spark UI。第三个模块着眼于工程数据管道,涵盖了连接数据库,模式和类型,文件格式以及编写好的数据。最终模块通过业务用例研究Spark在机器学习中的应用,对机器学习的简要介绍,构建和应用模型以及最后的课程结论。通过了解何时使用Spark,或者在模型或数据太大而无法在单个计算机上处理时扩大规模,或者仅需要加快速度以获得更快的结果,学生就会磨练自己的SQL技能,并变得更加熟练科学家。

课程标签

0人关注该课程

主题相关的课程