A First Course in Information Theory by Raymond W. Yeung

From the Publisher

Incepted half a century ago, information theory is a classical yet modern field which is more vibrant than ever before. In particular, there have been a number of major research results on the foundation of the theory during the last ten years. These results enable information theory to be understood and explored in a way which has not been possible before, and they open new dimensions in the theory. In short, the depth of information theory is far beyond what we used to know.

This book is an integration of the most fundamental topics in information theory plus a few selected advanced topics. All concepts and technicalities are explained with clarity. Except for a few classical results, all the results included here are not found elsewhere in book form. These include the theory of I-Measure, Shannon-type and non-Shannon-type information inequalities, and network coding theory. Some important implications of information theory in probability theory and group theory are also explained in this book.

ITIP, the software package that comes with the book, is the only software package of its kind which can prove all Shannon-type information inequalities. It is an essential tool for all information theorists.

This book is suitable for use as a textbook, or as a reference book with any other textbook in a course on information theory. It is also an essential reference for researchers working in areas related to this subject matter.

Booknews

An introduction to information theory for discrete random variables. Classical topics and fundamental tools are presented along with three selected advanced topics. Yeung (Chinese U. of Hong Kong) presents chapters on information measures, zero-error data compression, weak and strong typicality, the -measure, Markov structures, channel capacity, rate distortion theory, Blahut-Arimoto algorithms, information inequalities, and Shannon-type inequalities. The advanced topics included are single-source network coding, multi-source network coding, and entropy and groups. Annotation c. Book News, Inc., Portland, OR (booknews.com)

What People Are Saying

Toby Berger
No one since Shannon has had a better appreciation for the mathematical structure of information quantities than Prof. Yeung. ... Yeung unveils a smørgasbord of topics in modern information theory that heretofore have been available only in research papers.
— Cornell University

Product Details

• Table of Contents

Table of Contents