|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/master-elasticsearch-on-hadoop-ecosystem-with-data-pipelines/
课程评论：没有评论
课程名称：完整的ElasticSearch与LogStash，Hive，Pig，MR和Kibana 课程概述： 这是一个面向初学者到高级专业人士的完整ElasticSearch教程。课程旨在教授如何使用ElasticSearch与Apache Hadoop，构建各种真实世界的大数据应用程序。课程内容广泛，致力于建立现实生活中的数据应用程序，以便将数据从一个系统转移到另一个系统，这是今天任何数据工程师的常见实践。 课程内容： 第一部分 - 数据摄取流（从Hadoop到ElasticSearch） 这一部分将教授如何将不同Hadoop应用程序（如Hive、Pig、MR）以及LogStash中的数据移动到ElasticSearch索引中。主要内容包括： - 在计算机上安装Apache Hive并将Hive表中的数据加载到ElasticSearch。 - 在计算机上安装Apache PIG，并使用Apache PIG将数据索引到ElasticSearch中。 - 创建一个MapReduce程序（Java代码）并加载数据到ElasticSearch索引。 - 如何使用LogStash将数据移动到ElasticSearch索引中。 第二部分 - 数据回归流（从ElasticSearch到Hadoop） 在这一部分，您将学习如何使用ElasticSearch集群中的索引数据，并将其加载回Hadoop集群，随后导入到Hive、Pig、M/R或LogStash中。主要内容包括： - 将ElasticSearch索引直接导入Apache Hive表。 - 利用Apache PIG脚本将ElasticSearch索引数据导入Hadoop。 - 通过Java MapReduce程序将ElasticSearch索引数据导入Hadoop。 - 使用LogStash应用程序导入ElasticSearch索引数据。 第三部分 - 数据可视化（商业智能） 在本部分课程中，您将学习如何利用ElasticSearch集群中的索引数据，使用Kibana创建动态仪表板。这对数据分析师和数据科学家来说非常重要。 第四部分 - 生产集群监控工具（管理） 这个部分将教授如何维护生产中的应用程序，学习如何使用Marvel插件监控ElasticSearch集群，包括： - 在索引、分片和节点级别监控集群健康。 - 使用Linux工具解析ElasticSearch集群统计信息。 - 设置等待触发机制等。 第五部分 - 搜索ElasticSearch索引 学习ElasticSearch提供的强大搜索功能，以及如何实时从ElasticSearch索引中搜索内容。将涵盖建立用于理解ElasticSearch基础的众多基本知识，介绍搜索引擎及ElasticSearch在单节点或多节点集群中的工作原理。 该课程还提供步骤清晰的安装指南，帮助您在个人计算机上安装所需的工具和组件，以运行课程中的所有示例。每个视频都详细解释整个过程，易于理解。此外，您将获得可供操作和扩展的可用代码示例，Windows用户需要在个人电脑上安装虚拟机以设置单节点Hadoop集群，详细说明已在课程中提供。
Complete ElasticSearch tutorial for beginners to advanced level professionals.Learn how to use ElasticSearch with Apache Hadoop and build various real world big data applications.This comprehensive course focuses on building real world like data applications to move data from one system to another. A common practice for any data engineer today. No other course can cover so much ground as you will do in this one.In this course you will learn:Section 1 - Ingestion Flows (Hadoop to ElasticSearch)In this section of the course, you will learn to move data from various Hadoop applications (such as Hive, Pig, MR) & LogStash into an ElasticSearch index. This is an ideal business use case to prepare data for business analytics. Here are four major topics that will be covered in this section of the course:Learn how to install Apache Hive on your computer. Then read data from a hive table and load it into ElasticSearchLearn how to install Apache PIG on your computer and index data into ElasticSearch using Apache PIGCreate a MapReduce program (Java code) and load data into an ElasticSearch indexLearn how to move data using LogStash into an ElasticSearch indexSection 2 - Egression Flows (ElasticSearch to Hadoop)In this section of the course, you will learn to use indexed data from an ElasticSearch cluster and load it back into Hadoop cluster. After data is loaded back into Hadoop, you will learn how to directly import it into Hive, Pig, M/R or LogStash. Here are four major topics that we will cover under this section:Learn how to import an ElasticSearch index directly into Apache Hive tableLearn how to import an ElasticSearch indexed data into Hadoop using Apache PIG scriptsLearn how to import an ElasticSearch indexed data into Hadoop using Java MapReduce programLearn how to import an ElasticSearch indexed data using LogStash applicationSection 3 - Data Visualization (Business Intelligence)In part of the course, you will learn how to use indexed data from an ElasticSearch cluster and create dynamic dashboards using Kibana.This will be a very important lesson for Data Analysts and Data Scientists.Section 4 - Production Cluster Monitor tool (Administration)No knowledge is complete without learning how to maintain an application in production. In this section of the course, you will learn how to monitor your ElasticSearch cluster using Marvel plugins. Here are few things that you will learn:Cluster Health monitoring at Index, Shard, Node levelsParsing ElasticSearch Cluster statistics using Linux utilitiesSetting up wait-for-trigger mechanism and much moreSection 5 - Searching an ElasticSearch IndexLearn about awesome search capabilities offered by ElasticSearchHow to search something from an ElasticSearch index in real time.We will cover lots of basics to build foundation required to understand ElasticSearch. You will also learn about behind the scenes on how a search engine and specifically ElasticSearch works in a single or multiple node cluster.You will also get step by step instructions for installing all required tools and components on your machine in order to run all examples provided in this course. Each video will explain entire process in detail and easy to understand manner.You will get access to working code for you to play with it and expand on it. All code examples are working and will be demonstrated in video lessons.Windows users will need to install virtual machine on their PC to setup single node hadoop cluster. Detailed Instructions are available inside the course.
