|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/creating-data-pipeline-using-aws-confluent-kafka-platform/
课程评论：没有评论
课程名称：使用AWS和Confluent Kafka平台创建数据管道 课程概述：在此实践导向的项目课程中，您将学习如何使用Confluent Kafka与AWS服务的强大组合，构建一个云原生的实时流数据管道。本课程专为开发人员、数据工程师和技术领导者设计，将逐步引导您创建一个功能完善的数据管道——从数据源到存储，利用云生态系统中最受欢迎的技术。 课程开始时，您将设置Confluent Cloud和AWS的免费账户。接下来，您将构建和配置Kafka集群，创建主题，并使用连接器管理数据流。在AWS方面，您将创建和配置AWS Lambda函数（Python 3.10+），以便从Kafka主题消费消息、解析数据并插入到DynamoDB表中。 通过本课程的学习，您将完成一个端到端的事件驱动架构，具备实时流处理能力。我们还将介绍如何使用CloudWatch Logs监控和验证您的管道，并负责任地清理资源以避免不必要的费用。 本课程将帮助您增强对AWS和Confluent服务的使用信心，并构建实时流应用程序，无论在当前工作角色还是未来职业发展中都是如此。作为一名领导者，本课程将帮助您开始思考云技术，并更深入地理解构建云原生数据管道的细节。 无论您是初学者、数据工程师、解决方案架构师、产品负责人、产品经理还是希望更好地理解流数据架构的技术领导者，本课程均提供实用技能和架构见解。对于希望转行的参与者，本课程将帮助您增加真实项目经验，提升AWS云技术与架构的实操技能，同时了解云原生实时流数据管道的设置、问题、风险、挑战、优势与不足之处。
In this hands-on, project-based course, you'll learn how to build a cloud-native, real-time streaming data pipeline using the powerful combination of Confluent Kafka and AWS services. Designed for developers, data engineers, and technology leaders, this course takes you step-by-step through the creation of a fully functional data pipeline - from sourcing to storage - leveraging some of the most in-demand technologies in the cloud ecosystem.You'll start by setting up free-tier accounts on both Confluent Cloud and AWS. From there, you'll build and configure a Kafka cluster, create topics, and use connectors to manage data flow. On the AWS side, you'll create and configure AWS Lambda functions (Python 3.10+) to consume messages from Kafka topics, parse them, and insert them into a DynamoDB table.By the end of the course, you will have completed an end-to-end, event-driven architecture with real-time streaming capabilities. We'll also walk through how to monitor and verify your pipeline using CloudWatch Logs, and responsibly clean up your resources to avoid unnecessary charges. This course will help build confidence on starting to use other AWS and Confluent services and build real time streaming applications in your future or current job role. As a Leader this course will help jump start your Cloud thought process and help you understand deeper details on what goes on building cloud native data pipelines.Whether you're a beginner, Data Engineer, Solution Architect, Product Owner, Product Manager or a Technology Leader looking to better understand streaming data architecture in action, this course provides both practical skills and architectural insights. This course will help those who are looking to switch careers & will help to add a real life project to their Resume and boost their hands-on AWS Cloud Technical & Architecture skills. This Course will help participants upskill themselves by understanding nuances up close, of cloud native real time streaming data pipeline data pipeline setup, its issues, risks, challenges, benefits & shortcomings.
