AR (Augmented Reality) & Video Streaming Services Emerging Technologies

所在平台: Coursera

课程主页: https://www.coursera.org/learn/ar-technologies-video-streaming

课程评论：没有评论

第一个写评论        关注课程

课程简介

课程名称：增强现实（AR）与视频流服务新兴技术 课程概述：欢迎参加“增强现实与视频服务新兴技术”课程。AR（增强现实）技术和先进视频多媒体技术在产品中的应用决定了其价值和奢华程度。本课程的目标是教授用于前沿AR、Skype和YouTube视频及多媒体产品与服务的所有重要技术，包括基于H.264/MPEG-4 AVC、MPEG-DASH、CDN和移动CDN的先进视频和实时多媒体传输机制。掌握这些核心技术将帮助您理解全球每一个先进视频和多媒体系统的运作，并使您的公司在AR及视频多媒体技术产品和服务方面成为真正的世界领导者。 课程大纲： 1. **AR应用、产品与商业**：本模块探讨多种AR应用、技术和商业模式，包括对AR与VR（虚拟现实）之间的区别、各种AR用户界面（如智能手机、AR眼镜和头戴式显示器）的优势进行深入分析，并对AR市场的现状与预测进行讨论。 2. **AR技术**：本模块专注于AR技术及其操作工作流程、云支持技术，介绍AR技术组件的特性、特征检测/描述技术及兴趣点检测（IPD）过程。 3. **SIFT、SURF、FAST、BRIEF、ORB、BRISK**：重点分析多种核心特征提取技术，详细探讨特征检测与描述方案，强调特征提取在AR过程中的重要性。 4. **Skype、YouTube与H.264/MPEG-4 AVC**：考察Skype和YouTube作为国际知名视频服务的历史和技术演变，讲解H.264/MPEG-4 AVC图像媒体技术。 5. **视频流与MPEG-DASH**：探讨先进的视频流技术及MPEG-DASH的相关知识，包括推送与拉取媒体流的区别、视频帧类型以及HTTP协议的演进。 6. **CDN视频流技术**：研究CDN（内容传递网络）的必要性与运作过程，探讨CDN市场的价值、大小及其服务提供商的作用。 7. **AR智能手机项目**：聚焦两个AR智能手机项目（IKEA目录和Google翻译应用）的特性，测试不同环境因素对AR应用准确性的影响。 通过本课程，您将深入了解AR和视频流服务的前沿技术，为在快速发展的数字时代中脱颖而出做好准备。

课程大纲

Name:AR Applications, Products & Business

Description:The first module “AR Applications, Products & Business” focuses on the variety of AR (Augmented Reality) applications, technologies, products, and businesses. The lecture starts with the definitions and characteristics of AR and explains the differences of AR and VR (Virtual Reality). Then the advantages of various AR UI (User Interface) types, which include handheld AR displays (e.g., smartphones), AR eyeglasses, and HMDs (Head-Mounted Displays) are covered. In addition, AR business models and an analysis of the AR market, which includes the AR/VR headset market share, Worldwide AR/VR headset forecast, AR/VR market size by segment, and AR/VR market size forecasts are described.

Name:AR Technology

Description:The second module “AR Technology” focuses on AR (Augmented Reality) technologies, operation workflow, and Cloud support technologies. First, the features of AR technological components, and the role of AR feature detection/description technology and the IPD (Interest Point Detection) process is introduced. Second the advantages of AR cloud cooperative computation and AR cloud offloading is covered. In addition, the types of AR feature extraction descriptor types, feature detector requirements, and influencing factors are covered.

Name:SIFT SURF FAST BRIEF ORB BRISK

Description:The third module “SIFT SURF FAST BRIEF ORB BRISK” focuses on all of the core feature extraction technologies used in AR (Augmented Reality), which include SIFT, SURF, FAST, BRIEF, ORB, and BRISK. As feature extraction is the most important (and computation burdening and time consuming) procedure of the AR process, the variety of technologies applied in state-of-the-art AR devices are studied in detail in this module. The lectures cover the characteristics of the AR IPD (Interest Point Detection), feature detection, and description schemes, which include SIFT (Scale Invariant Feature Transform), SURF (Speed-Up Robust Feature), FAST (Features from Accelerated Segment Test), BRIEF (Binary Robust Independent Elementary Features), ORB (Oriented FAST and Rotated BRIEF), and BRISK (Binary Robust Invariant Scalable Keypoints).

Name:Skype, YouTube & H.264/MPEG-4 AVC

Description:The fourth module “Skype, YouTube & H.264/MPEG-4 AVC” focuses on the two most famous video service types that exist in the World. Skype is the most widely used video conferencing and VoIP (Voice over IP) application service in the World, which is now included in various Microsoft products, making video and voice communications possible from practically anywhere an Internet connection is available. YouTube is the World’s most widely used video service application service. The lectures cover the history of Skype and YouTube and also the evolution of their video and audio codec technologies. In addition, the lecture covers the details of the state-of-the-art H.264/MPEG-4 AVC video media technology that is currently used by Skype and YouTube.

Name:Video Streaming & MPEG-DASH

Description:The fifth module “Video Streaming & MPEG-DASH” focuses on advanced video streaming techniques and details on MPEG-DASH (Moving Picture Experts Group - Dynamic Adaptive Streaming over HTTP) technology. First, the differences in Push vs. Pull based media streaming is covered along with the operation process of Pull based adaptive media streaming. Second, the types of video frames along with the structure of the fragmented MP4 file and GOP (Group of Pictures) are studied. Third, HTTP (Hypertext Transfer Protocol) versions 1.0~2 and the DASH scheme is explained followed by examples of the YouTube MPEG-DASH progressive downloading process. Fourth, the standardization of ISO/IEC 23009-1 based MPEG-DASH specifications and the operation process of MPEG-DASH MDP (Multimedia Presentation Description) hierarchical data and MPD decoding & playing methods are covered.

Name:CDN Video Streaming Technology

Description:The sixth module “CDN Video Streaming Technology” focuses on the necessity and operations of advanced video service CDN (Content Delivery Network) technologies. First, the CDN structure and the operation process of CDN hierarchical content delivery is covered. Second, the CDN market value, market size, service providers, and the role of the Telcos, CDN providers, operators, and market regions are studied. Third, details on CDN cooperative caching and content routing, Query based scheme, Digest based scheme, Directory based scheme, Hashing based scheme, and the Semi-hashing based scheme are covered. Fourth, content aging and updating operations along with CDN popularity prediction and contents update techniques (with operational examples of the LRU (Least Recently Used) and LFU (Least Frequently Used) strategies) are covered in the lectures. In addition, the differences in CDN vs. Mobile CDN technology are discussed.

Name:AR Smartphone Project

Description:The seventh module “AR Smartphone Project” focuses on two AR smartphone projects using the IKEA Catalog and Google Translate applications. First the operation features of the IKEA Catalog and Google Translate AR applications are studies in the project. Second the limitations of the operation process of these AR applications are tested to recognize how the brightness levels, shined light angles, shape and size of the area and object, distance, font and texture types, and language translations types can influence the accuracy of the AR operations.

课程评论(0条)