|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/apache-spark-spark-sql-streaming-complete-course/
课程评论：没有评论
课程名称：Apache Spark、Spark SQL 和流处理从基础到高级 课程概述：本课程由一位在IT行业拥有多年的大数据解决方案设计经验的讲师主讲，旨在分享他在Spark生态系统方面的学习和经验。该课程帮助学员理解Spark的工作原理，掌握专业的大数据工程技能，从而获得良好的就业机会。课程已更新为最新版本，涵盖了Apache Spark、Spark SQL、Spark Streaming、与Hive集成、真实案例以及大数据项目设计等全方位知识。 课程优势：报名参加本课程，您将获得关于Apache Spark、Spark SQL、Spark Streaming、Hive等内容的全面知识，包括实际案例和面试中常见的应用场景。这门课程内容独特，包含了诸多在网上难以找到的Spark细节。本课程从非常基础的Spark知识开始，逐步深入到实际项目中使用的高级Spark技术，使用最新的Spark 3.x版本。 课程内容包括： - Spark环境设置及各种文件格式 - Hive优化概念，如分区、桶、连接 - 专家级Spark代码审查，包含演示和互动环节 - Spark Google云账户的设置，进行各种概念的实践 - Spark SQL子句的使用，如分发、排序和聚集 - Scala基础编码 - 使用Java 8作为Maven项目的Eclipse编码应用 - 窗口函数（如rank、row_number、dense_rank）的演示 - RDD、Dataset和DataFrame API - 向Hadoop或Hive表中创建/插入数据的各种方法 - Spark作业配置优化 - Spark应用程序DAG分析和调试 - Spark流处理及结构化流处理的Java编码 - 大公司使用的性能技术以快速查询数据 本课程是一个完整的学习包，深入讲解了Spark的罕见命令和概念。完成课程后，您将不用再担心遗漏任何Spark相关主题。课程特别考虑了Spark在实时项目中的实际应用。此外，您还可以下载关于Scala和Apache Spark安装的逐步安装指南文档。
I am Big Data Solution Designer in IT industry from last few years. I am adding all my learning and experience in this video series. So that you can understand working of Spark eco-system, work like a professional big data engineer and get a good job. Updated course with latest versionBenefits of this course:Enroll into this course and get end to end knowledge of Apache Spark +Spark-SQL + Spark Streaming + Spark with Hive + Real World Use cases + Designing of Big Data project with Spark eco-system & Interview asked Use cases. This course is very rare of its kind and includes even very thin details of Spark which are not available anywhere online.In this course you will get to understand a step by step learning of very Basic Spark to Advance Spark (which is actually used in Real-time projects) like with latest Spark version 3.xSpark Setup , All file formats ,Hive Optimization Concepts like Partition , Bucketing , Joins , Spark Code Review like Experts: all demo / interactive sessionsSpark Google cloud account setup for hands-on over all conceptsSpark SQL Clauses: Distribute by , order by , clustered by , sort byScala basics CodingEclipse Coding Application with Java 8 as Maven Project and Spark APIWindow functions like rank , row_number , dense_rank: all demo / interactive sessionsRDD , Dataset & DataFrame APIDifferent ways to create / insert data in Hadoop or Hive tableSpark Job Configuration OptimizationSpark Application DAG analysis and debugging using spark UISpark Streaming & Structured Streaming with Coding in JavaPerformance Technique that big companies use to query fast on data.This course is a full package explaining even rarely used commands and concepts in Spark. After completing this course you won't find any topic left in Spark. This course is made keeping in mind the Real Implementation of Spark in Live Projects.. Additionally ,You can download the Step Step Installation Guide (doc) to Install Scala and Apache Spark
