Information Theory

开始时间: 04/22/2022 持续时间: Unknown

所在平台: CourseraArchive

课程类别: 信息,技术与设计

大学或机构: The Chinese University of Hong Kong(香港中文大学)

授课老师: Raymond W. Yeung


课程评论: 1 个评论

评论课程        关注课程


The lectures are based on the first 11 chapters of Prof. Raymond Yeung’s textbook entitled Information Theory and Network Coding (Springer 2008).

  • Chapter 1 The Science of Information 
  • Chapter 2 Information Measures 
  • Chapter 3 The I-Measure 
  • Chapter 4 Zero-Error Data Compression 
  • Chapter 5 Weak Typicality 
  • Chapter 6 Strong Typicality 
  • Chapter 7 Discrete Memoryless Channels 
  • Chapter 8 Rate-Distortion Theory 
  • Chapter 9 The Blahut-Arimoto Algorithms 
  • Chapter 10 Differential Entropy 
  • Chapter 11 Continuous-Valued Channels

This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text. The electronic version of the 2008 book can be downloaded for free (with institutional subscription).

At the completion of this course, the student should be able to:
  1. Demonstrate knowledge and understanding of the fundamentals of information theory.
  2. Appreciate the notion of fundamental limits in communication systems and more generally all systems.
  3. Develop deeper understanding of communication systems.
  4. Apply the concepts of information theory to various disciplines in information science.



都柏林的老菲利普 2014-02-01 12:21 0 票支持; 0 票反对



This course is an introduction to information theory, which emphasizes fundamental concepts as well as analytical techniques. Specific topics include: Information Measures, The I-Measure, Zero-Error Data Compression, Weak Typicality, Strong Typicality, Discrete Memoryless Channels, etc.


信息论 信息论基础 信息 信息度量 entropy 密码学 香港中文大学



Mathematical Biostatistics Boot Camp 关注



Natural Language Processing 关注

Computational Neuroscience 关注

Pre-Calculus 关注

Statistics: Making Sense of Data 关注

Discrete Optimization 关注

Natural Language Processing 关注

Scientific Computing 关注