|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/databricks-certified-data-engineer-associate-exam-with-labs/
课程评论:没有评论
课程名称:Databricks认证数据工程师助理测试与实验 课程概述: Databricks认证数据工程师助理实践考试是一个全面而严格的评估,旨在评估个体在使用Databricks进行数据工程任务的熟练程度。该考试是希望验证自己技能与知识的专业人士的一项基准测试,Databricks是全球组织广泛使用的数据工程平台。考试涵盖多个与数据工程相关的主题,包括数据摄取、数据转换、数据存储和数据分析。候选人需展示对数据工程中关键概念和技术的理解,并能在实际场景中应用这些概念。 考试结构: 考试主要测试候选人完成诸如设置数据管道、使用Spark进行数据转换、优化数据存储与检索以及分析数据以获取有意义的洞察等任务的能力。参加者需要具备扎实的Databricks架构、Spark编程和数据工程最佳实践的理解。考试包含选择题、情境题和需要实际操作的练习,以考查候选人解决复杂数据工程问题和基于数据分析作出明智决策的能力。通过考试的候选人将获得认证,证明其在数据工程任务中使用Databricks的专业能力。 考试详情: - 考试名称:Databricks认证数据工程师助理 - 类型:监考认证 - 总题数:45道 - 时间限制:90分钟 - 注册费用:200美元 - 题目类型:选择题 - 考试辅助工具:不允许 - 语言:英语、日语、巴西葡萄牙语 - 交付方式:在线监考 - 前提条件:无,但推荐相关培训 - 建议经验:超过6个月的数据工程实际操作经验 - 有效期:2年 考试大纲涵盖的主题: 1. Databricks湖屋平台 2. 使用Apache Spark的ELT 3. 增量数据处理 4. 生产管道 5. 数据治理 总结: 总的来说,Databricks认证数据工程师助理实践考试是希望验证其数据工程能力的专业人士的重要评估。通过考试,考生能够证明自己在使用Databricks进行数据工程任务方面的熟练程度,并提升其在数据工程领域的职业机会。
Databricks Certified Data Engineer Associate Practice Exam is a comprehensive and rigorous assessment designed to evaluate an individual's proficiency in utilizing Databricks for data engineering tasks. This exam serves as a benchmark for professionals seeking to validate their skills and knowledge in working with Databricks, a leading data engineering platform used by organizations worldwide.Databricks Certified Data Engineer Associate Practice Exam covers a wide range of topics related to data engineering, including data ingestion, data transformation, data storage, and data analysis. Candidates are required to demonstrate their understanding of key concepts and techniques used in data engineering, as well as their ability to apply these concepts in real-world scenarios.This exam is structured to test candidates on their ability to perform tasks such as setting up data pipelines, transforming data using Spark, optimizing data storage and retrieval, and analyzing data to derive meaningful insights. Candidates are expected to have a solid understanding of Databricks architecture, Spark programming, and data engineering best practices.Databricks Certified Data Engineer Associate Practice Exam consists of multiple-choice questions, scenario-based questions, and hands-on exercises that require candidates to demonstrate their practical skills in using Databricks. The exam is designed to assess candidates on their ability to solve complex data engineering problems and make informed decisions based on data analysis.Candidates who pass the Databricks Certified Data Engineer Associate Practice Exam will receive a certification that validates their expertise in using Databricks for data engineering tasks. This certification is recognized by employers and industry professionals as a testament to the candidate's skills and knowledge in data engineering.Preparing for the Databricks Certified Data Engineer Associate Practice Exam requires a thorough understanding of Databricks functionality, Spark programming, and data engineering principles. Candidates are encouraged to review the exam objectives, study relevant resources, and practice using Databricks to ensure they are well-prepared for the exam.Databricks Certified Data Engineer Associate Exam Summary:Exam Name: Databricks Certified Data Engineer AssociateType: Proctored certificationTotal number of questions: 45Time limit: 90 minutesRegistration fee: $200Question types: Multiple choiceTest aides: None allowedLanguages: English, 日本語, Português BRDelivery method: Online proctoredPrerequisites: None, but related training highly recommendedRecommended experience: 6+ months of hands-on experience performing the data engineering tasks outlined in the exam guideValidity period: 2 yearsDatabricks Certified Data Engineer Associate Exam Syllabus Topics:Section 1: Databricks Lakehouse PlatformDescribe the relationship between the data lakehouse and the data warehouse.Identify the improvement in data quality in the data lakehouse over the data lake.Compare and contrast silver and gold tables, which workloads will use a bronze table as a source, which workloads will use a gold table as a source.Identify elements of the Databricks Platform Architecture, such as what is located in the data plane versus the control plane and what resides in the customer's cloud accountDifferentiate between all-purpose clusters and jobs clusters.Identify how cluster software is versioned using the Databricks Runtime.Identify how clusters can be filtered to view those that are accessible by the user.Describe how clusters are terminated and the impact of terminating a cluster.Identify a scenario in which restarting the cluster will be useful.Describe how to use multiple languages within the same notebook.Identify how to run one notebook from within another notebook.Identify how notebooks can be shared with others.Describe how Databricks Repos enables CI/CD workflows in Databricks.Identify Git operations available via Databricks Repos.Identify limitations in Databricks Notebooks version control functionality relative to Repos.Section 2: ELT with Apache SparkExtract data from a single file and from a directory of filesIdentify the prefix included after the FROM keyword as the data type.Create a view, a temporary view, and a CTE as a reference to a fileIdentify that tables from external sources are not Delta Lake tables.Create a table from a JDBC connection and from an external CSV fileIdentify how the count_if function and the count where x is null can be usedIdentify how the count(row) skips NULL values.Deduplicate rows from an existing Delta Lake table.Create a new table from an existing table while removing duplicate rows.Deduplicate a row based on specific columns.Validate that the primary key is unique across all rows.Validate that a field is associated with just one unique value in another field.Validate that a value is not present in a specific field.Cast a column to a timestamp.Extract calendar data from a timestamp.Extract a specific pattern from an existing string column.Utilize the dot syntax to extract nested data fields.Identify the benefits of using array functions.Parse JSON strings into structs.Identify which result will be returned based on a join query.Identify a scenario to use the explode function versus the flatten functionIdentify the PIVOT clause as a way to convert data from wide format to a long format.Define a SQL UDF.Identify the location of a function.Describe the security model for sharing SQL UDFs.Use CASE/WHEN in SQL code.Leverage CASE/WHEN for custom control flow.Section 3: Incremental Data ProcessingIdentify where Delta Lake provides ACID transactionsIdentify the benefits of ACID transactions.Identify whether a transaction is ACID-compliant.Compare and contrast data and metadata.Compare and contrast managed and external tables.Identify a scenario to use an external table.Create a managed table.Identify the location of a table.Inspect the directory structure of Delta Lake files.Identify who has written previous versions of a table.Review a history of table transactions.Roll back a table to a previous version.Identify that a table can be rolled back to a previous version.Query a specific version of a table.Identify why Zordering is beneficial to Delta Lake tables.Identify how vacuum commits deletes.Identify the kind of files Optimize compacts.Identify CTAS as a solution.Create a generated column.Add a table comment.Use CREATE OR REPLACE TABLE and INSERT OVERWRITECompare and contrast CREATE OR REPLACE TABLE and INSERT OVERWRITEIdentify a scenario in which MERGE should be used.Identify MERGE as a command to deduplicate data upon writing.Describe the benefits of the MERGE command.Identify why a COPY INTO statement is not duplicating data in the target table.Identify a scenario in which COPY INTO should be used.Use COPY INTO to insert data.Identify the components necessary to create a new DLT pipeline.Identify the purpose of the target and of the notebook libraries in creating a pipeline.Compare and contrast triggered and continuous pipelines in terms of cost and latencyIdentify which source location is utilizing Auto Loader.Identify a scenario in which Auto Loader is beneficial.Identify why Auto Loader has inferred all data to be STRING from a JSON sourceIdentify the default behavior of a constraint violationIdentify the impact of ON VIOLATION DROP ROW and ON VIOLATION FAIL UPDATEfor a constraint violationExplain change data capture and the behavior of APPLY CHANGES INTOQuery the events log to get metrics, perform audit loggin, examine lineage.Troubleshoot DLT syntax: Identify which notebook in a DLT pipeline produced an error, identify the need for LIVE in create statement, identify the need for STREAM in from clause.Section 4: Production PipelinesIdentify the benefits of using multiple tasks in Jobs.Set up a predecessor task in Jobs.Identify a scenario in which a predecessor task should be set up.Review a task's execution history.Identify CRON as a scheduling opportunity.Debug a failed task.Set up a retry policy in case of failure.Create an alert in the case of a failed task.Identify that an alert can be sent via email.Section 5: Data GovernanceIdentify one of the four areas of data governance.Compare and contrast metastores and catalogs.Identify Unity Catalog securables.Define a service principal.Identify the cluster security modes compatible with Unity Catalog.Create a UC-enabled all-purpose cluster.Create a DBSQL warehouse.Identify how to query a three-layer namespace.Implement data object access controlIdentify colocating metastores with a workspace as best practice.Identify using service principals for connections as best practice.Identify the segregation of business units across catalog as best practice.In conclusion, the Databricks Certified Data Engineer Associate Practice Exam is a valuable assessment for professionals looking to validate their skills in data engineering using Databricks. By passing this exam, candidates can demonstrate their proficiency in utilizing Databricks for data engineering tasks and enhance their career opportunities in the field of data engineering.DISCLAIMER: These questions are designed to, give you a feel of the level of questions asked in the actual exam. We are not affiliated with Databricks or Apache. All the screenshots added to the answer explanation are not owned by us. Those are added just for reference to the context.