|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/data-engineering-and-data-integration-tools/
课程评论：没有评论
课程名称：数据工程与数据集成工具 课程概述： 欢迎参加Uplatz提供的《数据工程与数据集成工具》课程。本课程重点介绍了提取、转换、加载（ETL）和提取、加载、转换（ELT）的概念，这些是任何数据仓库项目的核心。数据的获取、集成和处理是整合组织内部各个部门数据孤岛的关键任务，最终目的是建立一个强大且灵活的数据仓库，以便进行企业报告和分析。 本课程将重点介绍Talend，这是一款数据集成的ETL工具，提供数据准备、数据质量、数据集成、应用集成、数据管理和大数据的软件解决方案。Talend的产品种类繁多，尤其是在大数据产品和数据集成解决方案方面。这些解决方案作为开源平台提供，Talend在大数据集成领域具有特殊优势。Talend还提供与云、大数据、企业应用集成、主数据管理和数据质量等相关的功能。此外，Talend允许存储和重用元数据的统一库。 Talend是云计算和大数据集成的绝佳工具，其Talend Studio在数据集成和大数据处理方面非常受欢迎。Talend可以通过图形工具和向导顺利安排大数据集成，使团队能够轻松与Apache Hadoop、Spark和NoSQL数据库进行云端合作。Talend数据集成软件工具具有开放、可访问的架构，能够更快地响应业务需求，并且其工具的灵活性使得数据集成任务的修改和安排比手动编码更加迅速。 Uplatz致力于提供这一关于Talend的全面课程，适合任何希望成为ETL架构师或数据集成工程师的人士。掌握Talend将为您的职业生涯打开巨大的机遇。 课程内容包括： 1. 开源ETL技术在大数据中的角色概述 2. Talend的优势和安装指南 3. 如何读取和写入各种源/目标系统 4. 基本与高级业务转型技巧 5. 如何处理层次文件结构（XML、JSON） 6. 上下文变量和全局变量的使用 7. 数据库最佳实践和数据仓库概念的实施 8. 作业控制和执行流的调度 9. 跨作业的共享数据库连接 10. 错误处理和日志配置 通过本课程，学员将获得全面的Talend使用技能，能够有效应对未来数据工程领域的挑战与机遇。
A warm welcome to the Data Engineering and Data Integration Tools course by Uplatz.Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) concepts are core of any datawarehousing initiative. Data ingestion, integration, and processing form a critical task for consolidating the data silos across the departments in an organisation and ultimately to build a robust and flexible datawarehouse for enterprise reporting & analytics.One of such tools is Talend. Talend is an ETL tool/software for Data Integration. It delivers software resolutions for data groundwork, data quality, data integration, application integration, data management and big data.There exist separate products of these different solutions in Talend. Big Data products and data integration are broadly used in Talend. Data integration and data management solutions are offered by Talend, as an open source platform. Big data integration is a specialty of Talend. Other features provided by Talend are related to cloud, big data, enterprise application integration, master data management and data quality. It also provides a unified repository to store and reuse the Metadata.Talend is one of the finest tools for cloud computing and big data integration. The most common invention of Talend Studio is data integration and big data. Talend can smoothly arrange big data integration with graphical tools and wizards. This permits the group to generate a condition to easily work with Apache Hadoop, Spark, and NoSQL databases for cloud. Talend data integration software tool has an open, accessible architecture. It permits quicker response to business needs. The tool contracts to modify and arrange data integration jobs faster than hand coding. Talend integration cloud tool offers connectivity, built-in data quality, and native code generation. Talend is protected cloud integration platform which allows IT and business users to connect shared both could and on-premise. It solves the power of cloud design job as it can manage, monitor, and control in the cloud.Uplatz provides this end-to-end course on this leading Data Integration and ETL tool called Talend. With many organizations using Talend as their leading data warehousing and data integration software, there are huge career prospects by learning and mastering Talend. If you wish to become an ETL Architect or a Data Integration Engineer, then Talend course can be a complete game changer.Talend - Course Curriculum1. Role of Open Source ETL Technologies in Big DataOverview on: TOS (Talend Open Studio) for Data IntegrationETL conceptsData warehousing concepts2. TalendWhy Talend?FeaturesAdvantagesTalend Installation/System RequirementsGUI layout (designer)Understanding it's Basic FeaturesComparison with other market leader tools in ETL domainImportant areas in Talend Architecture: ProjectWorkspaceJobMetadataPropagationLinking components3. Talend: Read & Write various Types of Source/Target SystemData Source ConnectionFile as SourceCreate meta dataDatabase as sourceCreate metadataUsing MySQL database (create tables, Insert, Update Data from Talend)Read and write into excel files, into multiple tabsView dataHow to capture log and navigate around basic errorsRole of tLogrow and how it makes developers life easy4. Talend: How to Transform Your Business: BasicUsing Advanced components like: tMap, tJoin, tFilter, tSortRow, tAggregateRow, tReplicate, tSplit, Lookup, tRowGenerator5. Talend: How to Transform Your Business: Advanced 1Trigger (types) and Row TypesContext Variables (parameterization)Functions (basic to advanced functions to transform business rules such as string, date, mathematical etc.)Accessing job level / component level information within the job6. Talend: How to Transform Your Business: Advanced 2Type Casting (convert data types among source-target platforms)Looping components (like tLoop, tFor)tFileListtRunJobHow to schedule and run talend DI jobs externally (not in GUI)7. Working with Hierarchical File StructuresRead and Write an XML file, configure the schema and XPath expression to parse an XML fileRead and Write a JSON file, configure the schema and JSONPath expression to parse a JSON fileRead and write delimited, fixed width files.8. Context Variables and Global VariablesCreate context/global variablesUse context/global variables in the configuration of Talend componentsLoad context variables from a flow9. Best practicesWorking with databases and implementing data warehousing conceptsWorking with files (excel, delimited, JSON, XML etc.)10. Orchestration and Controlling Execution FlowFiles - Use components to list, archive, and delete files from a directoryDatabase - Controlling Commit and RollbackCOMMIT at end of job/ every x number of rowsRollback on error11. Shared DB connection across jobs and subjobsUse triggers to connect components and subJobsOrchestrate several jobs in master jobs.Handling ErrorsKill a Job on a component errorImplement a specific Job execution path on a component errorConfigure the log level in the console
