|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/kafka-for-developers-data-contracts-using-schema-registry/
课程评论:没有评论
课程名称:Kafka开发者 - 使用Schema Registry的数据契约 概述:本课程旨在让学员通过理论学习和编码实践,掌握使用AVRO和Schema Registry构建Kafka应用程序的技能。如果您希望学习以下内容: - 在使用Kafka作为流媒体平台的应用程序之间演变数据的技术 - 使用紧凑的数据格式AVRO在应用程序之间交换数据 - 使用Schema Registry及其优点 - 在使用Kafka作为流媒体平台的应用程序之间强制执行数据契约 - 优雅地处理数据演变 那么这就是适合您的课程。本课程以实践为导向,通过代码学习相关概念。课程结束时,您将全面理解以下内容: - 将AVRO用作数据序列化格式 - 使用Schema Registry进行数据演变 课程内容包括: 1. Kafka概述:介绍课程及预期内容。 2. 数据契约与Kafka中的序列化:学习序列化如何与Kafka相关及其对Kafka架构的好处,了解不同的序列化格式及AVRO、Protobuf和Thrift对Schema的支持。 3. AVRO简介:介绍AVRO及其在Kafka和Schema Registry中的流行原因,学习构建简单的AVRO模式。 4. 本地Kafka设置与演示:使用Docker设置本地Kafka,使用Kafka控制台生产者和消费者生产和消费消息。 5. 问候应用程序 - 基础AVRO项目设置:使用Gradle和Maven构建问候应用程序的基础项目,以从问候模式生成Java类。 6. 用Java构建AVRO生产者和消费者:学习如何构建Kafka生产者和消费者以发布和消费AVRO记录。 7. 使用AVRO的咖啡店订单服务 - 实际用例:为实际用例构建AVRO模式,并为其构建Kafka生产者和消费者。 8. AVRO中的逻辑类型:涵盖AVRO的不同逻辑类型及其用法。 9. AVRO记录的底层结构:讲解AVRO记录在发布和消费时的结构。 10. AVRO中的模式变更:演示如何因业务需求的变化而使消费者出现问题。 11. 使用Schema Registry的数据演变:覆盖根据变化的业务需求演变模式的不同技术,并介绍不同的兼容性技术。 12. 模式命名策略:讲解Schema的不同命名策略以及其对应用事件的影响。 13. 使用SpringBoot和Schema Registry构建咖啡订单服务:编码并构建Spring Boot Kafka应用程序,以AVRO格式交换数据并与Schema Registry进行交互,构建一个RESTful服务以通过REST接口发布和接收事件,然后将其发布到Kafka。 课程结束后,您将完整掌握AVRO作为数据序列化格式的使用以及使用Schema Registry进行数据演变的能力。
This course is structured to give you a theoretical and coding experience of Building Kafka Applications using AVRO and Schema Registry. If you are looking forward to learning the below-listed things:Techniques that are available to evolve the data between the applications that uses Kafka as a Streaming Platform Use a compact data format like AVRO to exchange data between the applicationsUse Schema Registry and its benefitsEnforcing Data Contracts between applications that uses Kafka as a Streaming PlatformHandle Data evolution gracefully using Schema RegistryThen this is the right course for you. This is a pure hands-on oriented course where you will be learning the concepts through code.By the end of this course, you will have a complete understanding of these concepts:Use AVRO as a data serialization formatEvolution of the data using Schema RegistryGetting Started with KafkaIn this section, I will give you all an introduction to the course and what to expect from this course.Data Contract & Serialization in KafkaLearn "How serialization is connected to Kafka" and how it benefits the overall Kafka architecture.We will look into different Serialization formats and the support for Schema in AVRO, Protobuf and ThriftIntroduction to AVRO - A data serialization systemAn introduction to AVRO and why AVRO is popular to work with Kafka and Schema Registry.Learn to build a simple AVRO schema.Kafka Setup & Demo in Local Using DockerIn this section , we will setup Kafka in local, Produce and Consume messages using Kafka Console Producer and Consumer.Greeting App - Base AVRO Project SetUp - GradleWe will set up the base project for the greeting app which we can use to generate the Java Classes from the Greetings schema using Gradle build tool.Greeting App - Base AVRO Project SetUp - MavenWe will set up the base project for the greeting app which we can use to generate the Java Classes from the Greetings schema using Maven build tool.Build AVRO Producer and Consumer in JavaWe will learn to build a Kafka Producer to publish AVRO records in to the Kafka topic.We will learn to build a Kafka Consumer to consume AVRO records from the Kafka topic.CoffeeShop Order Service Using AVRO - A Real time use CaseWe will build a AVRO schema for a real time use case and build Kafka Producers and Consumers to it.Logical Types in AVROI will cover the different logical types in AVRO and how to use them.TimeStampDecimalUUIDDateAVRO Record- Under the HoodAnatomy of an AVRO record when the data is published and consumed as AVRO recordSchema Changes in AVRODemonstration of how the consumer breaks with changing business requirementsData Evolution using Schema RegistryCover the different techniques of evolving a Schema with the changing business requirements.I will cover the different Compatibility techniques to share data between the producer and consumer applicationsBackward CompatibilityForward CompatibilityFull CompatibilityNone CompatibilitySchema Naming StrategiesI will cover the different naming strategies for Schema and how its impacts the application events.TopicName StrategyRecordName StrategyTopicRecordName StrategyBuild a Coffee Order Service using SpringBoot & Schema RegistryIn this section, we will code and build a Spring Boot Kafka application that exchanges the data in an AVRO format and interacts with Schema Registry for data evolution.Build a RestFul service to publish the events through which we receive events through the rest interface and then publish them to KafkaBy the end of this course, you will have a complete understanding of these concepts:Use AVRO as a data serialization formatEvolution of the data using Schema Registry