What does shannon's source coding theorem mean?

Definitions for shannon's source coding theorem
shan·non's source cod·ing the·o·rem

This dictionary definitions page includes all the possible meanings, example usage and translations of the word shannon's source coding theorem.

Wikipedia

  1. Shannon's source coding theorem

    In information theory, Shannon's source coding theorem (or noiseless coding theorem) establishes the limits to possible data compression, and the operational meaning of the Shannon entropy. Named after Claude Shannon, the source coding theorem shows that (in the limit, as the length of a stream of independent and identically-distributed random variable (i.i.d.) data tends to infinity) it is impossible to compress the data such that the code rate (average number of bits per symbol) is less than the Shannon entropy of the source, without it being virtually certain that information will be lost. However it is possible to get the code rate arbitrarily close to the Shannon entropy, with negligible probability of loss. The source coding theorem for symbol codes places an upper and a lower bound on the minimal possible expected length of codewords as a function of the entropy of the input word (which is viewed as a random variable) and of the size of the target alphabet.

Wikidata

  1. Shannon's source coding theorem

    In information theory, Shannon's source coding theorem establishes the limits to possible data compression, and the operational meaning of the Shannon entropy. The source coding theorem shows that it is impossible to compress the data such that the code rate is less than the Shannon entropy of the source, without it being virtually certain that information will be lost. However it is possible to get the code rate arbitrarily close to the Shannon entropy, with negligible probability of loss. The source coding theorem for symbol codes places an upper and a lower bound on the minimal possible expected length of codewords as a function of the entropy of the input word and of the size of the target alphabet.

How to pronounce shannon's source coding theorem?

How to say shannon's source coding theorem in sign language?

Numerology

  1. Chaldean Numerology

    The numerical value of shannon's source coding theorem in Chaldean Numerology is: 7

  2. Pythagorean Numerology

    The numerical value of shannon's source coding theorem in Pythagorean Numerology is: 6

Translation

Find a translation for the shannon's source coding theorem definition in other languages:

Select another language:

  • - Select -
  • 简体中文 (Chinese - Simplified)
  • 繁體中文 (Chinese - Traditional)
  • Español (Spanish)
  • Esperanto (Esperanto)
  • 日本語 (Japanese)
  • Português (Portuguese)
  • Deutsch (German)
  • العربية (Arabic)
  • Français (French)
  • Русский (Russian)
  • ಕನ್ನಡ (Kannada)
  • 한국어 (Korean)
  • עברית (Hebrew)
  • Gaeilge (Irish)
  • Українська (Ukrainian)
  • اردو (Urdu)
  • Magyar (Hungarian)
  • मानक हिन्दी (Hindi)
  • Indonesia (Indonesian)
  • Italiano (Italian)
  • தமிழ் (Tamil)
  • Türkçe (Turkish)
  • తెలుగు (Telugu)
  • ภาษาไทย (Thai)
  • Tiếng Việt (Vietnamese)
  • Čeština (Czech)
  • Polski (Polish)
  • Bahasa Indonesia (Indonesian)
  • Românește (Romanian)
  • Nederlands (Dutch)
  • Ελληνικά (Greek)
  • Latinum (Latin)
  • Svenska (Swedish)
  • Dansk (Danish)
  • Suomi (Finnish)
  • فارسی (Persian)
  • ייִדיש (Yiddish)
  • հայերեն (Armenian)
  • Norsk (Norwegian)
  • English (English)

Word of the Day

Would you like us to send you a FREE new word definition delivered to your inbox daily?

Please enter your email address:


Citation

Use the citation below to add this definition to your bibliography:

Style:MLAChicagoAPA

"shannon's source coding theorem." Definitions.net. STANDS4 LLC, 2024. Web. 29 Mar. 2024. <https://www.definitions.net/definition/shannon%27s+source+coding+theorem>.

Discuss these shannon's source coding theorem definitions with the community:

0 Comments

    Are we missing a good definition for shannon's source coding theorem? Don't keep it to yourself...

    Free, no signup required:

    Add to Chrome

    Get instant definitions for any word that hits you anywhere on the web!

    Free, no signup required:

    Add to Firefox

    Get instant definitions for any word that hits you anywhere on the web!

    Browse Definitions.net

    Quiz

    Are you a words master?

    »
    (of especially persons) lacking sense or understanding or judgment
    A foreordained
    B ectomorphic
    C soft-witted
    D extroversive

    Nearby & related entries:

    Alternative searches for shannon's source coding theorem: