information entropy
expected value of the amount of information delivered by a message
Facts
14 properties- Instance of
- mathematical expression, mathematical concept[5]
- Subclass of
- information content, physical quantity
- Facet of
- information[7]
- Defining formula
- H(X) = \sum_{i = 1}^{n} p(x_i) I(x_i)
- Described by source
- IEC 80000-13:2008 Quantities and units — Part 13: Information science and technology[8]
- Different from
- negentropy, data size[10][11]
- Discoverer or inventor
- Claude Shannon[4]
- ISQ dimension
- 1
- In defining formula
- H, p, I
- Main Wikidata property
- information entropy[9]
- Opposite of
- negentropy[6]
- Quantity symbol (LaTeX)
- H(X), H
- Studied by
- thermodynamics, information theory[12][13]
🏷️ Also known as
en information entropy
en entropy
en Shannon entropy
en negentropy
en average information content
ar إنتروبية المعلومات
ar إنتروبي المعلومات
ar انتروبي
ar اعتلاج معلومات
ar إنتروبية
ar اعتلاج المعلومات
cs entropie informací
da Entropi
de Entropie
de Shannon-Entropie
de Informationsdichte
de Shannonentropie
el Εντροπία πληροφοριών
el Εντροπία
es entropía de Shannon
🔖 Identifiers · 39
- Library of Congress Authorities ID
- sh85044152
- GND ID
- 4743861-7
- Bibliothèque nationale de France ID
- 11985913j
- Brilliant Wiki ID
- entropy-information-theory
- De Agostini ID
- entropìa
- Enciclopedia della Scienza e della Tecnica ID
- entropia
- Encyclopedia of China (Third Edition) ID (2026)
- 4JTDsM
- Encyclopædia Britannica Online ID
- topic/entropy-information-theory, topic/Shannons-entropy
- FAST ID
- 912828
- Freebase ID
- /m/03zhv
- Great Russian Encyclopedia portal ID
- entropiia-v-teorii-informatsii-8e42df
Show all 39 identifiers +27
- IEV number
- 171-07-15
- J9U entity ID
- 987007550784405171
- JSTOR topic ID (archived)
- shannon-entropy
- KBpedia ID
- EntropyAndInformation
- Lexikon der Mathematik entry ID
- 2688
- Library of Congress Classification
- Wikiversity
- MathWorld ID
- Entropy
- Microsoft Academic ID (discontinued)
- 70567897
- NDL Authority ID
- 01191172
- NL CR AUT ID
- ph425914
- National Library of Spain SpMaBN ID
- XX535116
- QUDT dimension ID
- A0E0L0I0M0H0T0D1
- QUDT quantity kind ID
- InformationEntropy
- Quora topic ID
- Entropy-information-theory
- SVKKL authority ID
- 0300972-informacni-entropie
- Semantic Scholar topic ID
- 27732
- TDKIV Wikibase ID
- .xxx
- TDKIV term ID
- 000000451
- Topic's main category
- Category:Entropy and information
- Treccani ID
- entropia
- Treccani Vocabulary ID
- entropia
- Treccani's Dizionario delle Scienze Fisiche ID
- entropia
- Treccani's Enciclopedia Italiana ID
- entropia
- Treccani's Enciclopedia della Matematica ID
- entropia
- Wellcome Collection concept ID
- rjzy5p25
- Wolfram Language quantity ID
- InformationEntropy
- Yale LUX ID
- concept/09177436-dfc9-4d84-956d-b7b7ed1ed91f
🔗 Connections
Subtypes 3
Studied by 2
Subclass of 2
← Measured physical quantity 2
Created notable works 1
Different from 1
Discoverer or inventor 1
Facet of 1
Instance of 1
Library of Congress Classification 1
Maintained by WikiProject 1
On focus list of Wikimedia project 1
Opposite of 1
Topic's main category 1
← Category's main topic 1
← Different from 1
← Facet of 1
← Has use 1
← Main subject 1
← Opposite of 1
Press Enter · cited answer in seconds