|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/learn-by-example-apache-storm/
课程评论:没有评论
**课程名称:** Learn By Example: Apache Storm **课程概述:** 本课程将Apache Storm定位为实时流处理领域的Hadoop。通过本课程,学员将学习如何构建需要对最新数据做出即时响应(秒级或分钟级)的应用,例如实时抓取Twitter热门话题或监测支付网关故障峰值。Storm能够处理从简单数据转换到实时机器学习算法应用等各种复杂任务。课程包含25个实际应用示例,帮助学员深入理解Storm。 **课程内容亮点:** 1. **Storm核心组件:** 深入理解Storm拓扑(topology)的基本构建块——Spouts(数据源)和Bolts(数据处理器)。 2. **拓扑运行模式:** 学习如何在本地模式(local mode)和远程模式(remote mode)下运行Storm拓扑。 3. **数据处理并行化:** 掌握通过不同的分组策略(shuffle grouping, fields grouping, Direct grouping, All grouping, Custom Grouping)实现拓扑内数据处理的并行化。 4. **可靠性与容错:** 学习如何管理Spouts和Bolts中的可靠性和容错机制。 5. **Trident拓扑:** 探索使用Trident拓扑进行复杂数据转换,包括Map、Filter、Windowing(窗口化)和Partitioning(分区)等操作。 6. **实时机器学习:** 学习如何利用Trident-ML和Storm-R等库在流数据上实时应用机器学习算法。 **课程特色:** * **实例驱动:** 课程以25个精心设计的Solv ed Examples(已解决示例)为核心,理论与实践紧密结合。 * **全面实用:** 覆盖Storm的核心概念、运行机制、高级特性及实际应用场景。 * **面向实践:** 旨在帮助学员掌握构建健壮、高效的实时流处理应用的能力。
Storm is to real-time stream processing what Hadoop is to batch processing. Using Storm you can build applications which need you to be highly responsive to the latest data and react within seconds and minutes, such as finding the latest trending topics on twitter, or monitoring spikes in payment gateway failures. From simple data transformations to applying machine learning algorithms on the fly, Storm can do it all. This course has 25 Solved Examples on building Storm Applications. What's covered? 1) Understanding Spouts and Bolts which are the building blocks of every Storm topology. 2) Running a Storm topology in the local mode and in the remote mode 3) Parallelizing data processing within a topology using different grouping strategies: Shuffle grouping, fields grouping, Direct grouping, All grouping, Custom Grouping 4) Managing reliability and fault-tolerance within Spouts and Bolts 5) Performing complex transformations on the fly using the Trident topology: Map, Filter, Windowing and Partitioning operations 6) Applying ML algorithms on the fly using libraries like Trident-ML and Storm-R.