Apache Spark Core and Structured Streaming 3.0 In-Depth

所在平台: Udemy

课程主页: https://www.udemy.com/course/apache-spark-core-30-in-depth/

课程评论:没有评论

第一个写评论        关注课程

课程简介

课程名称:Apache Spark核心与结构化流处理3.0深度解析 课程概述:Apache Spark已成为大数据工程师最为重要的技能之一。作为MapReduce编程范式的演进,Spark提供了统一的数据处理平台,从编写SQL到图形处理,再到实现机器学习算法应有尽有。它有效利用集群节点并优化内存管理,以在节点集群中分担负载,从而实现更快的结果。Apache Spark推动了成千上万家企业的数据驱动决策。为了充分理解Apache Spark库的优势,了解其基础知识是非常重要的。本课程正是针对这一目标而设计。它从初学者水平开始,逐步以易于理解的方式解释复杂概念。通过五个不同的用例,课程深入描述了框架的特性和工作原理,同时提供详细的实操实现。在课程中,部分实操环节和用例解决方案采用全课堂模式进行讲解,视频时长超过40分钟。完成本课程后,您将掌握Spark Core的专业知识,同时对Spark SQL、结构化流处理、Spark ML和GraphX等库的使用有更清晰的理解和应用能力。本课程将帮助您建立扎实的基础知识,您将学习批处理与流处理的区别、编程模型、API以及流处理特有的挑战。课程会快速过渡到流处理概念的理解,结合多种示例与实操,深入探讨内部工作机制,并在最后以用例作为总结。所有活动都将在云环境中使用Spark 3.0进行。

课程评论(0条)

课程详情

Apache Spark has turned out to be the most sought-after skill for any big data engineer. An evolution of MapReduce programming paradigm, Spark provides unified data processing from writing SQL to performing graph processing to implementing Machine Learning algorithms. It effectively uses cluster nodes and better memory management to spread the load across cluster of nodes to get faster results. Apache Spark drives the mission of data-driven-decision-making in thousands of organizations.In order to fairly appreciate the benefits of the libraries of Apache Spark, it is essential to know the foundations right. This course aims exactly at that part. It starts from the beginner level and gradually explains all the complex concepts in an easy to reflect manner. It gives a profound description of the features and working of the framework through 5 different use cases with detailed hands on implementations. In fact, some hands-on sessions and solutions to the use-cases are explained in a full classroom mode with videos extending over 40 mins. After taking this course, you will gain the expertise on Spark Core and usage of further libraries like Spark SQL, Structured Streaming, Spark ML and GraphX will be much easier to visualize, implement and optimize.This illustrative course will build your foundational knowledge. You will learn the differences between batch & stream processing, programming model, the APIs and the challenges specific to stream processing. Quickly we'll move to understand the concepts of stream processing with wide varieties of examples & hands-on, dealing with inner working and taking a use case towards the end. All of this activity will be on cloud using Spark 3.0.

课程标签

0人关注该课程

主题相关的课程