|
|
Information theory - Wikipedia, the free encyclopedia
|
||
|
Algorithmic information theory - Wikipedia, the free encyclopedia
Algorithmic information theory is a subfield of information theory and computer science that concerns itself with the relationship between computation and information. According to Gregory Chaitin, i...
en.wikipedia.org/wiki/Algorithmic_information_theory |
||
|
Basics of Information Theory ... Although information is sometimes measured in characters, as when describing the length of an email message, or in digits (as in the length of a phone number), the convention in information theory is to measure information in bits.
|
||
|
The IEEE Information Theory Society is an international organization whose purpose is to connect people interested in processing, transmission, storage, and use of information, as well as theoretical and applied aspects of coding, communications, and communications networks. ... Information Theory Paper Award...
|
||
|
This site provides the current version of the book Entropy and Information Theory by R.M. Gray in the Adobe portable document format (PDF). This format can be read from a Web browser by using the Acrobat Reader helper application, which is available for free downloading from Adobe.
|
||
|
Norbert Wiener worked out the continuous case of the standard entropy/coding/ communication channel part of information theory at the same time as Shannon was doing the discrete version; I don't know whether anything like this exists for algorithmic information theory.
|
||
|
You might also be interested in my book on Information Theory, Inference and Learning Algorithms (640 pages long, published by C.U.P. Sept 2003, and available online), which grew out of this short course.
|
||
|
information theory measures the quantities of all of these kinds of information in terms of bits. The larger the uncertainty removed by a message, the stronger the correlation between the input and output of a communication channel, the more detailed particular instructions are the more information is transmitted.
|
||
|
26, 2001) -- Claude Elwood Shannon, the mathematician who laid the foundation of modern information theory while working at Bell Labs in the 1940s, died on Saturday. He was 84.
|