|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/introduction-to-big-data/
课程评论：没有评论
课程名称：大数据导论 课程概述： 本课程将深入探讨“大数据”这一热门话题。我们将详细解释什么是大数据，它从何而来，如何处理，以及如何利用其分析结果。 课程核心内容： * **大数据定义：** 大数据通常被描述为具有**高体量（Volume）**、**高多样性（Variety）**和**高速度（Velocity）**的特点。数据可以是数字、文本、图片、音频、视频等任何形式的信息。这三个关键要素常被称为“大数据的三要素”。 * **大数据案例：** 课程将以社交媒体网络分析用户数据以提供个性化内容和广告，以及搜索引擎通过分析查询与结果之间的关系来改进用户体验为实例，阐释大数据的应用场景。 * **大数据分析方法：** 课程重点介绍**MapReduce**作为将原始数据转化为有用信息的重要方法。MapReduce是一种能在多台计算机上并行处理大规模数据集的技术。它不仅是一种编程模型，也常指其具体实现。MapReduce包含两个主要部分： * **Map函数：** 负责数据的排序和过滤，将数据归类以便分析。 * **Reduce函数：** 通过整合数据，提供数据的汇总摘要。 课程学习要点： * 理解大数据是什么。 * 掌握大数据的三个核心要素：高体量、高多样性、高速度。 * 了解谷歌在大数据方面的策略。 * 认识集群（Cluster）和节点（Node）的概念。 * 学习谷歌文件系统（GFS）和Big Table。 * 深入理解MapReduce的工作原理。 * 了解Hadoop生态系统。 （课程不设详细教学大纲）
Big data is a big buzz word and everyone seems to be talking about it, but what exactly is big data ? Where is this data coming from, how is it being processed, and how are the results being used? What is big data? Big data can be characterised as data that has high volume,high variety and high velocity. Data includes numbers, text, images, audio, video, or any other kind of information you might store on your computer. Volume, velocity, and variety are sometimes called "the 3 V's of big data." What kind of datasets are considered big data? Examples includes social media network analyzing their members' data to learn more about them and connect them with content and advertising relevant to their interests, or search engines looking at the relationship between queries and results to give better answers to users' questions. How is big data analyzed? One of the best known methods for turning raw data into useful information is by what is known as MapReduce. MapReduce is a method for taking a large data set and performing computations on it across multiple computers, in parallel. It serves as a model for how program, and is often used to refer to the actual implementation of this model. MapReduce consists of two parts. The Map function does sorting and filtering, taking data and placing it inside of categories so that it can be analysed. The Reduce function provides a summary of this data by combining it all together. What You Will Learn What is big data What is high volume What is high variety What is high variety Google's Big Data Approach What is Cluster What is a Node What is GFS What is Big Table What is MapReduce What is Hadoop
