|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/apache-spark-for-java-developers/
课程评论：没有评论
**Coursera 课程总结：Apache Spark for Java Developers** 本课程专为 Java 开发者设计，旨在帮助您快速入门强大的 Apache Spark 并行计算框架。如果您是数据科学新手，想要了解大规模数据集是如何并行处理的，那么 Spark 的 Java API 是一个绝佳的起点。 课程详尽覆盖了 Spark Core、Spark SQL 和 DataFrame 的核心操作基础，并提供易于理解的示例，您可以直接在本地开发环境中运行和实践。 此外，本课程还包含以下亮点： * **SparkML 模块**: 学习如何将机器学习模型应用于大数据，无需数学基础。 * **Spark Streaming 模块**: 深入掌握 Spark 与 Apache Kafka 的集成，处理实时大数据流，涵盖 DStream 和 Structured Streaming API。 * **AWS EMR 部署 (可选)**: 了解如何将 Spark 应用部署到 AWS EMR 集群，如果您没有 AWS 账户，也可通过观看视频了解部署过程。 * **Spark 内部机制与性能优化**: 深入了解 Spark 的内部工作原理，探索其执行计划优化。对比 RDDs 和 Spark SQL 的性能，学习避免性能陷阱，从而节省项目成本。 * **Java Lambda 实践**: 在课程中，您将大量练习 Java Lambda 表达式，是学习函数式 Java 风格的绝佳机会。 通过本课程，您将全面掌握使用 Java 开发 Spark 应用的技能，并提升处理大数据和实时流数据的能力。
Get started with the amazing Apache Spark parallel computing framework - this course is designed especially for Java Developers.If you're new to Data Science and want to find out about how massive datasets are processed in parallel, then the Java API for spark is a great way to get started, fast.All of the fundamentals you need to understand the main operations you can perform in Spark Core, SparkSQL and DataFrames are covered in detail, with easy to follow examples. You'll be able to follow along with all of the examples, and run them on your own local development computer.Included with the course is a module covering SparkML, an exciting addition to Spark that allows you to apply Machine Learning models to your Big Data! No mathematical experience is necessary! And finally, there's a full 3 hour module covering Spark Streaming, where you will get hands-on experience of integrating Spark with Apache Kafka to handle real-time big data streams. We use both the DStream and the Structured Streaming APIs.Optionally, if you have an AWS account, you'll see how to deploy your work to a live EMR (Elastic Map Reduce) hardware cluster. If you're not familiar with AWS you can skip this video, but it's still worthwhile to watch rather than following along with the coding.You'll be going deep into the internals of Spark and you'll find out how it optimizes your execution plans. We'll be comparing the performance of RDDs vs SparkSQL, and you'll learn about the major performance pitfalls which could save a lot of money for live projects.Throughout the course, you'll be getting some great practice with Java Lambdas - a great way to learn functional-style Java if you're new to it.
