Main Page

From Webresearch

Jump to: navigation, search
Prof. Urbanke contemplating lunch


These are the modest beginnings of an ambitious project. We want to change how researchers distribute information, exchange ideas, and collaborate. To get started, here is a Wiki. Hopefully you will help us filling in content.

The aim is to cover technical topics at a level comparable to a tutorial or a basic book. The exact level of specificity may be hard to describe, but thinking of a good introductory graduate-level course you took may be a good start. Please try to include examples. You can see some conventions we would like to follow. You can also see some convenient formating features in dummy page, and get up to speed on basic Wiki usage on the Wiki quickstart guide. If you have any suggestions, please add them in the suggestion page.


Information Theory

Information theory is a branch of electrical engineering, applied mathematics and theoretical computer science involving the development of a mathematical theory of information.

Information theory was developed by Claude E. Shannon to find fundamental limits on signal processing and communication operations such as compression, reliable communication, and storage of information. Since its inception it has broadened to find applications in many other areas, including statistical inference, cryptography and networking.

The key measure of information is known as entropy which is measured in bits. Its impact has been crucial to the success of the Voyager missions to deep space, the invention of the compact disc, the feasibility of mobile phones, the development of the Internet, the study of linguistics and of human perception, the understanding of black holes, and numerous other fields, see impact of information theory.

Important sub-fields of information theory are source coding, channel coding, algorithmic information theory, information-theoretic security, and measures of information.

Textbooks on Information Theory

Other books


Connections to other fields

Consult the User's Guide for information on using the wiki software.

Personal tools