|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/hadoop-on-azure-working-with-big-data-using-hdinsight/
课程评论:没有评论
**课程名称:Hadoop on Azure. An Introduction to Big Data Using HDInsight** **课程概述:** 本课程旨在介绍大数据及其在Microsoft Azure上的HDInsight云实现。在大数据时代,海量数据正以前所未有的速度和多样性被收集,而其中只有一小部分得到了分析。课程将阐述“大数据”的真正含义,通常指数据量大、处理速度快、格式多样且语义复杂的数字信息。大数据来源广泛,可以是历史数据,也可以是实时流数据,如社交媒体、传感器数据、用户行为等。 为了从大数据中获得有价值的洞察,数据需要能够被访问、清洗、分析并以易于理解的方式呈现。HDInsight是Apache Hadoop技术栈在Azure上的云实现,是大数据分析的领先解决方案,包含了Storm, HBase, Pig, Hive, Sqoop, Oozie, Ambari等组件,并能与Excel、SQL Server Analysis Services、SQL Server Reporting Services等商业智能工具集成。 **请注意:** 本课程侧重于建立理论知识基础,而非动手实践。它是为后续课程(将运用所学知识在Azure HDInsight上构建端到端的大数据解决方案)打下基础。 **课程大纲:** 无
Massive amounts of data are being collected on just about everything and only a small part of that data is being analyzed.In 2014, every second over 5700 tweets were sent and 870 Facebook links were sent. In 2013, about 4.4 zettabytes of data were created and approximately 5% of it was analyzed. By 2020, it's estimated that we will collect 44 zettabytes of data and the amount we analyze will jump to 40%. One of the most overused words in recent times is "Big Data"But what does the word really mean? Big data refers to data being collected in ever-escalating volumes, at increasingly high velocities, and for a widening variety of unstructured formats and variable semantic contexts.Big data describes any large body of digital information, from the text in a Twitter feed, to the sensor information from industrial equipment, to information about customer browsing and purchases on an online catalog. Big data can be historical (meaning stored data) or real-time (meaning streamed directly from the source).For big data to provide actionable intelligence or insight, not only must the right questions be asked and data be relevant to the issues be collected, the data must be accessible, cleaned, analyzed, and then presented in a useful way. HDInsight is a cloud implementation on Microsoft Azure of the rapidly exanding Apache Hadoop technology stack that is the go-to solution for big data analysis.It includes implementations of Storm, HBase, Pig, Hive, Sqoop, Oozie, Ambari, and so on. HDInsight also integrates with business intelligence (BI) tools such as Excel, SQL Server Analysis Services, and SQL Server Reporting Services.Note: This is not a hands on course. This course creates a knowledge foundation for my next course in this series which is using what we've learned to create a real world end to end big data solution with Azure HDInsight.