Definitions for information theory
in·for·ma·tion the·o·ry

Princeton's WordNetRate this definition:0.0 / 0 votes

1. information theorynoun

   (computer science) a statistical theory dealing with the limits and efficiency of information processing

GCIDERate this definition:0.0 / 0 votes

1. information theorynoun

   The science which studies the capacity of systems to contain, store, and transmit information{2 and 4}, and the factors such as noise and channel capacity that may affect the rate or accuracy of information transmission and reception.

WiktionaryRate this definition:0.0 / 0 votes

1. information theorynoun

   A branch of applied mathematics and engineering involving the quantification of information sent over a communication channel, disregarding the meaning of the sent messages, exemplified by the noisy-channel coding theorem.

WikipediaRate this definition:0.0 / 0 votes

1. Information theory

   Information theory is the scientific study of the quantification, storage, and communication of information. The field was originally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s.: vii  The field is at the intersection of probability theory, statistics, computer science, statistical mechanics, information engineering, and electrical engineering. A key measure in information theory is entropy. Entropy quantifies the amount of uncertainty involved in the value of a random variable or the outcome of a random process. For example, identifying the outcome of a fair coin flip (with two equally likely outcomes) provides less information (lower entropy) than specifying the outcome from a roll of a die (with six equally likely outcomes). Some other important measures in information theory are mutual information, channel capacity, error exponents, and relative entropy. Important sub-fields of information theory include source coding, algorithmic complexity theory, algorithmic information theory and information-theoretic security. Applications of fundamental topics of information theory include source coding/data compression (e.g. for ZIP files), and channel coding/error detection and correction (e.g. for DSL). Its impact has been crucial to the success of the Voyager missions to deep space, the invention of the compact disc, the feasibility of mobile phones and the development of the Internet. The theory has also found applications in other areas, including statistical inference, cryptography, neurobiology, perception, linguistics, the evolution and function of molecular codes (bioinformatics), thermal physics, molecular dynamics, quantum computing, black holes, information retrieval, intelligence gathering, plagiarism detection, pattern recognition, anomaly detection and even art creation.

WikidataRate this definition:0.0 / 0 votes

1. Information theory

   Information theory is a branch of applied mathematics, electrical engineering, bioinformatics, and computer science involving the quantification of information. Information theory was developed by Claude E. Shannon to find fundamental limits on signal processing operations such as compressing data and on reliably storing and communicating data. Since its inception it has broadened to find applications in many other areas, including statistical inference, natural language processing, cryptography, neurobiology, the evolution and function of molecular codes, model selection in ecology, thermal physics, quantum computing, plagiarism detection and other forms of data analysis. A key measure of information is entropy, which is usually expressed by the average number of bits needed to store or communicate one symbol in a message. Entropy quantifies the uncertainty involved in predicting the value of a random variable. For example, specifying the outcome of a fair coin flip provides less information than specifying the outcome from a roll of a die. Applications of fundamental topics of information theory include lossless data compression, lossy data compression, and channel coding. The field is at the intersection of mathematics, statistics, computer science, physics, neurobiology, and electrical engineering. Its impact has been crucial to the success of the Voyager missions to deep space, the invention of the compact disc, the feasibility of mobile phones, the development of the Internet, the study of linguistics and of human perception, the understanding of black holes, and numerous other fields. Important sub-fields of information theory are source coding, channel coding, algorithmic complexity theory, algorithmic information theory, information-theoretic security, and measures of information.

U.S. National Library of MedicineRate this definition:0.0 / 0 votes

1. Information Theory

   An interdisciplinary study dealing with the transmission of messages or signals, or the communication of information. Information theory does not directly deal with meaning or content, but with physical representations that have meaning or content. It overlaps considerably with communication theory and CYBERNETICS.

Matched Categories

1. • Scientific Theory
   • Statistics

How to pronounce information theory?

1. Alex

   US English

   David

   US English

   Mark

   US English

   Daniel

   British

   Libby

   British

   Mia

   British

   Karen

   Australian

   Hayley

   Australian

   Natasha

   Australian

   Veena

   Indian

   Priya

   Indian

   Neerja

   Indian

   Zira

   US English

   Oliver

   British

   Wendy

   British

   Fred

   US English

   Tessa

   South African

How to say information theory in sign language?

Numerology

1. Chaldean Numerology

   The numerical value of information theory in Chaldean Numerology is: 6

2. Pythagorean Numerology

   The numerical value of information theory in Pythagorean Numerology is: 9

Examples of information theory in a Sentence

1. David Sinclair:

   It’s not junk, it’s not damage that causes us to get old, we believe it’s a loss of information — a loss in the cell’s ability to read its original DNA so it forgets how to function — in much the same way an old computer may develop corrupted software. I call it the information theory of aging.

References

1. ^ Princeton's WordNet
   http://wordnetweb.princeton.edu/perl/webwn?s=information theory
2. ^ GCIDE
   https://gcide.gnu.org.ua/?q=information theory
3. ^ Wiktionary
   https://en.wiktionary.org/wiki/Information_Theory
4. ^ Wikipedia
   https://en.wikipedia.org/wiki/Information_Theory
5. ^ Wikidata
   https://www.wikidata.org/w/index.php?search=information theory