|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/apache-nifi-complete-master-course-hdp-automation-etl/
课程评论：没有评论
**课程名称：Apache NiFi 完整大师课程 - HDP - 自动化 ETL** **课程概述：** 本课程全面介绍 Apache NiFi，一个强大的下一代数据管道创建和企业系统集成框架。NiFi 拥有超过 250 个处理器和 70 多个控制器，能够与几乎所有流行的企业系统进行集成。 **课程将涵盖以下核心概念：** * **基础概念：** FlowFile、Controllers、Processors、Connections、Process Group、Funnel、Data Provenance、Processor relationships、Input and Output Ports。 * **子项目：** NiFi Registry 的使用。 * **生产环境维护与优化：** * 提高性能和高效处理错误。 * 处理吞吐量 (Throughput) 和延迟 (Latency) 。 * 处理背压 (Back Pressure) 和 Yields。 * 错误处理机制和失败重试。 * 监控 (Monitoring) 和 Bulletin。 * 数据溯源 (Data Provenance) 。 * **数据处理与控制器：** * 通过关系 (relationship)、Yield 和 Back Pressure 控制数据流。 * 演示用于处理各种类型数据的各种处理器和控制器。 * 深入讲解生产环境中常用的处理器，如 HTTP、RDBMS、NoSQL、S3、CSV、JSON、Hive 等。 * 详细介绍 ConnectionPool、SSL 等控制器，并提供演示。 * **实操演示与应用：** * 所有概念均结合实际操作和演示进行讲解。 * 提供真实世界的实现案例。 * 课程提供所有演示的 FlowFile 模板，方便学员实践。 * 演示如何创建和使用 KeyStore、Trust Store 进行 SSL 通信。 * 使用 Maven 和 Eclipse EE 进行自定义处理器开发，并将 nar 文件部署到 NiFi 库中。 **总而言之，本课程旨在帮助学员掌握 Apache NiFi 的全部基础和高级知识，并通过丰富的实操演示，能够独立构建和优化企业级数据管道。**
Apache Nifi is next generation framework to create data pipeline and integrate with almost all popular systems in the enterprise. It has more than 250 processors and more than 70 controllers. This course covers all all basic to advanced concepts available in Apache Nifi likeFlowfileControllersProcessorsConnectionsProcess GroupFunnelData ProvenanceProcessor relationshipsInput and Output Ports This course also covers on the Apache Nifi Subprojects like Nifi RegistryAs part of production maintenance, user may have to take cautious decision to improve the performance and handle the errors efficiently. To facilitate the same, Demo also covers on Handling Throughput and LatencyHandling Back Pressure and YieldError handlingFailure RetryMonitoring BulletinData ProvenanceTo have seamless experience with data, handling of data latency and throughput and prioritizing the data is important. Its controlled with relationship, yield and back pressure.Various processors and controllers to process various type of data is demonstrated.Processors which are used in production scenarios like HTTP, RDBMS, NoSQL S3, CSV, JSON, Hive, etc., are covered in detail along with controllers like SSL, ConnectionPool, etc., with demo.All these concepts are covered with demo and real time implementation is provided.For easy practical purpose, all the demonstrated flowfile template is uploaded as part of the course.Demo on creating and using KeyStore, Trust Store for SSL communication.Using Maven and Eclipse EE for custom processor and deploying nar file to Nifi libraries.
