|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/abcd-airflow-23x-helm-eks-minikube/
课程评论：没有评论
**课程名称：** Apache Airflow 2.x on AWS - EKS Minikube Helm **课程概述：** 本课程将教授您如何在大力神（AWS）的弹性Kubernetes服务（EKS）上高效、可扩展地部署Apache Airflow。学员将学习创建用于本地开发的Airflow脚本、编写自定义Helm Chart、利用模板化脚本和YAML文件进行配置、利用`eksctl`构建可拓展的EKS集群、部署ALB Ingress Controller实现负载均衡和Airflow UI访问，以及挂载EFS以持久化Kubernetes Executor日志。此外，课程还将引导学员创建管道，利用AWS CodePipeline自动化Airflow的部署过程。 **课程目标：** * **DevOps工程师：** 了解部署Airflow的技术依赖，特别是EFS在Kubernetes Executor中的应用。 * **数据工程师：** 学习如何高效配置Airflow用于开发，无需花费大量时间在基础设置上。 * **全栈工程师：** 掌握与Airflow相关的框架，如Helm和AWS EKS。 * **开发者：** 专注于开发，摆脱配置Airflow核心组件时的困扰。 **先修知识：** * Airflow组件基础知识 * Kubernetes基础知识 * AWS基础知识 * 熟练使用IDE **依赖项：** * Linux OS 或 Windows * AWS账户（非本地部署所需） **课程特色：** 本课程遵循Apache Airflow的生产部署指南，并结合AWS服务官方文档，确保学员能够部署高度可扩展的Airflow环境，并实时获取最新的技术信息。 **不适合人群：** * 希望了解Airflow是什么或学习如何创建DAGs/Pipelines的学员。 **重要提示：** 本课程涉及使用AWS EKS等AWS资源，这些资源可能不属于免费套餐范围。
In this course, you will learn how to:Create a Script to seamlessly deploy Airflow for Local DevelopmentCreate your own Helm ChartTemplate Scripts and YAML filesConfigure Airflow using HelmCreate a Scalable EKS Cluster using eksctlDeploy an ALB Ingress Controller for Load Balancing and accessing the Airflow UIMounting EFS for Persisting Kubernetes Executor LogsCreating a Pipeline to Deploy Airflow using AWS Code PipelinePrerequisites:Basic Knowledge about Airflow ComponentsBasic Knowledge about KubernetesBasic Knowledge about AWSFamiliar with working on an IDEDependencies: Linux OS, Windows, AWS Account (For Non-Local Deployment )This course is lined up with the Production Guide of Apache Airflow to deploy a Highly Scalable Airflow on EKS and also follows official Documentation of AWS while deploying Services making sure you always stay up to date and acquire more detailed information whenever you want to. Who this course is for:If you are a DevOps Engineer and want to know the technical dependencies for deploying Airflow such as using EFS for using a Kubernetes Executor.If you are a Data Engineer and want to use Airflow for Development but don't want to spend a huge amount of time learning how to configure it.If you are a Full Stack Engineer and want to learn about various frameworks revolving around Airflow such as Helm, AWS EKS.If you want to focus on development and get rid of all the frustration coming from trying to set up Airflow with all the core components. Who this course isn't for: If you want to know what Airflow is or learn how to create DAGs or pipelines.Note: This course includes using AWS resources such as EKS which is not free tier eligible.
