|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/java-parallel-computation-on-hadoop-in-4-hours/
课程评论：没有评论
Coursera 课程《Java and Hadoop Parallel Computation》旨在帮助学员掌握使用 Java 和 Hadoop 进行大规模数据并行处理的必备知识。 **课程亮点：** * **Hadoop 基础：** 从 Hadoop 入门，深入了解 HDFS（Hadoop 分布式文件系统）和 MapReduce 的工作机制。 * **集群架构：** 学习 Hadoop 集群的组成部分，以及如何在伪分布式和分布式模式下配置和运行 Hadoop。 * **实战案例：** 通过丰富的 MapReduce 编程示例，如数据排序、模式搜索、词共现、倒排索引和数据聚合，全面掌握 Hadoop 的应用。所有示例均提供完整源代码和详细解释。 * **适用人群：** 适合所有希望扩展数据处理能力、解决大规模数据处理效率问题的软件开发者。 * **行业应用：** 了解 Alibaba、Facebook、Yahoo! 等众多知名公司如何利用 Hadoop 进行数据挖掘和洞察发现。 **课程内容涵盖：** * 并行计算的背景和 Hadoop 出现之前的局限性。 * Hadoop 解决的核心问题。 * Hadoop 的核心项目，特别是 HDFS 和 MapReduce。 * HDFS 的工作原理。 * MapReduce 的工作原理。 * Hadoop 集群的工作方式。 * 如何利用虚拟机环境进行 Hadoop 的学习和测试。 * MapReduce 启动程序的原理。 * 多种 MapReduce 编程实例，包括数据排序、模式搜索、词共现、倒排索引和数据聚合。 本课程提供结构化的学习路径，帮助您快速掌握这一处理大数据的流行技术。
Build your essential knowledge with this hands-on, introductory course on the Java parallel computation using the popular Hadoop framework: - Getting Started with Hadoop - HDFS working mechanism - MapReduce working mecahnism - An anatomy of the Hadoop cluster - Hadoop VM in pseudo-distributed mode - Hadoop VM in distributed mode - Elaborated examples in using MapReduce Learn the Widely-Used Hadoop Framework Apache Hadoop is an open-source software framework for storage and large-scale processing of data-sets on clusters of commodity hardware. Hadoop is an Apache top-level project being built and used by a global community of contributors and users. It is licensed under the Apache License 2.0. All the modules in Hadoop are designed with a fundamental assumption that hardware failures (of individual machines, or racks of machines) are common and thus should be automatically handled in software by the framework. Apache Hadoop's MapReduce and HDFS components originally derived respectively from Google's MapReduce and Google File System (GFS) papers. Who are using Hadoop for data-driven applications? You will be surprised to know that many companies have adopted to use Hadoop already. Companies like Alibaba, Ebay, Facebook, LinkedIn, Yahoo! is using this proven technology to harvest its data, discover insights and empower their different applications! Contents and Overview As a software developer, you might have encountered the situation that your program takes too much time to run against large amount of data. If you are looking for a way to scale out your data processing, this is the course designed for you. This course is designed to build your knowledge and use of Hadoop framework through modules covering the following: - Background about parallel computation - Limitations of parallel computation before Hadoop - Problems solved by Hadoop - Core projects under Hadoop - HDFS and MapReduce - How HDFS works - How MapReduce works - How a cluster works - How to leverage the VM for Hadoop learning and testing - How the starter program works - How the data sorting works - How the pattern searching - How the word co-occurrence - How the inverted index works - How the data aggregation works - All the examples are blended with full source code and elaborations Come and join us! With this structured course, you can learn this prevalent technology in handling Big Data.
