|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/mastering-presto/
课程评论：没有评论
课程名称：掌握Presto：实践学习 课程概述：Presto是一种开源的分布式SQL查询引擎，旨在对各种规模的数据源（从GB到PB）进行交互式分析查询。Presto的设计和编写是从零开始，专注于交互式分析，其速度接近商业数据仓库，同时可以扩展到Facebook等大型组织的数据规模。 在课程的第一部分，将介绍Presto的理论，包括Presto的架构和组件，如协调者、工作节点、连接器、查询执行模型等。同时，还会讲解Kafka、Cassandra、Hive、PostgreSQL和Redshift的工作原理，以及它们的连接器的具体细节。 在课程的第二部分，将进行大量实践讲座，帮助您搭建开发环境，包括为Hive和Presto创建Docker镜像、为整个Presto基础设施制作Helm图表，并将其部署到本地Kubernetes集群中。随后，您将学习如何通过将S3中的parquet文件与PostgreSQL数据进行联接，运用单个SQL查询来运行实际示例。当您熟悉如何在本地运行和使用Presto的功能后，我将展示如何设置您的AWS账户，并将Presto集群部署到Amazon的托管Kubernetes（EKS）集群，以便能够按规模分析TB甚至PB级别的数据。 最后，我将讨论市场上所有可用的托管和非托管Presto服务，分析它们各自的优缺点。
Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes. Presto was designed and written from the ground up for interactive analytics and approaches the speed of commercial data warehouses while scaling to the size of organisations like Facebook.In the first part of the course I will talk about Presto's theory including Presto's architecture and components - coordinator, worker, connector, query execution model, etc. Additionally, I will explain to you how Kafka, Cassandra, Hive, PostgreSQL and Redshift work before I mention the specifics to their connectors. In the second part of the course, you are going to have many practical lectures where I will help you to build a development environment including Docker images for Hive and Presto, Helm chart for the whole Presto infrastructure and then deploy the chart to a local Kubernetes cluster.Later, you will learn how to run a real world example by joining parquet files in S3 with PostgreSQL data in a single SQL query. When you learn how to run and use Presto's features locally, I will show you how to setup your AWS account and how to deploy your Presto cluster to a managed Kubernetes (EKS) cluster in Amazon where you will be able to analyse terabytes or even petabytes of data at scale.Finally, I am going to talk about all available managed and non-managed Presto services on the market, describing pros and cons for each of them.
