information entropy

expected value of the amount of information delivered by a message

Facts

14 properties
Defining formula
H(X) = \sum_{i = 1}^{n} p(x_i) I(x_i)
Different from
negentropy, data size[10][11]
Discoverer or inventor
Claude Shannon[4]
ISQ dimension
1
In defining formula
H, p, I
Main Wikidata property
information entropy[9]
Opposite of
negentropy[6]
Quantity symbol (LaTeX)
H(X), H
Recommended unit of measurement
shannon, hartley, nat[16][17][18]
🏷️ Also known as
en information entropy en entropy en Shannon entropy en negentropy en average information content ar إنتروبية المعلومات ar إنتروبي المعلومات ar انتروبي ar اعتلاج معلومات ar إنتروبية ar اعتلاج المعلومات cs entropie informací da Entropi de Entropie de Shannon-Entropie de Informationsdichte de Shannonentropie el Εντροπία πληροφοριών el Εντροπία es entropía de Shannon
🔖 Identifiers · 39
Library of Congress Authorities ID
sh85044152
GND ID
4743861-7
Bibliothèque nationale de France ID
11985913j
De Agostini ID
entropìa
Enciclopedia della Scienza e della Tecnica ID
entropia
Encyclopedia of China (Third Edition) ID (2026)
4JTDsM
Encyclopedia of China (Third Edition) old ID (2021)
199135, 145325, 443352
Encyclopædia Britannica Online ID
topic/entropy-information-theory, topic/Shannons-entropy
FAST ID
912828
Freebase ID
/m/03zhv
Great Russian Encyclopedia portal ID
entropiia-v-teorii-informatsii-8e42df
Show all 39 identifiers +27
IEV number
171-07-15
J9U entity ID
987007550784405171
JSTOR topic ID (archived)
shannon-entropy
Lexikon der Mathematik entry ID
2688
Library of Congress Classification
Wikiversity
MathWorld ID
Entropy
Microsoft Academic ID (discontinued)
70567897
NDL Authority ID
01191172
NL CR AUT ID
ph425914
National Library of Spain SpMaBN ID
XX535116
QUDT dimension ID
A0E0L0I0M0H0T0D1
QUDT quantity kind ID
InformationEntropy
SVKKL authority ID
0300972-informacni-entropie
Semantic Scholar topic ID
27732
TDKIV Wikibase ID
.xxx
TDKIV term ID
000000451
Treccani ID
entropia
Treccani Vocabulary ID
entropia
Treccani's Dizionario delle Scienze Fisiche ID
entropia
Treccani's Enciclopedia Italiana ID
entropia
Treccani's Enciclopedia della Matematica ID
entropia
Wellcome Collection concept ID
rjzy5p25
Wolfram Language quantity ID
InformationEntropy

Report an error or request removal Lineage (PROV-JSON)

🔗 Connections
Recommended unit of measurement 3
Subtypes 3
Studied by 2
Subclass of 2
← Measured physical quantity 2
Created notable works 1
Different from 1
Discoverer or inventor 1
Facet of 1
Instance of 1
Library of Congress Classification 1
Maintained by WikiProject 1
On focus list of Wikimedia project 1
Opposite of 1
Topic's main category 1
← Category's main topic 1
← Different from 1
← Facet of 1
← Has use 1
← Main subject 1
← Opposite of 1
Press Enter · cited answer in seconds

Summary

information entropy is a mathematical expression[1]. It is a type of information content[2] and physical quantity[3].

References

Programmatic citations — every numbered marker resolves to a verifiable graph row below.

Direct Wikidata claims

  1. [5] ↑ . wikidata.org.
  2. [4] ↑ . wikidata.org.
  3. [2] ↑ . wikidata.org.
  4. [3] ↑ . wikidata.org.
  5. [6] ↑ . wikidata.org.
  6. [7] ↑ . wikidata.org.
  7. [8] ↑ . wikidata.org.
  8. [9] ↑ . wikidata.org.
  9. [10] ↑ . wikidata.org.
  10. [11] ↑ . wikidata.org.
  11. [12] ↑ . wikidata.org.
  12. [13] ↑ . wikidata.org.
  13. [14] ↑ . wikidata.org.
  14. [15] ↑ . wikidata.org.
  15. [16] ↑ . IEC 80000-13:2008 Quantities and units — Part 13: Information science and technology. wikidata.org.
  16. [17] ↑ . IEC 80000-13:2008 Quantities and units — Part 13: Information science and technology. wikidata.org.
  17. [18] ↑ . IEC 80000-13:2008 Quantities and units — Part 13: Information science and technology. wikidata.org.

Class ancestry

  1. [1] ↑ . Wikidata. wikidata.org.

📑 Cite this page

Use these citations when quoting this entity in research, articles, AI prompts, or wherever provenance matters. We aggregate Wikidata + Wikipedia + authoritative open-data sources; the stitched, scored, cross-referenced view is what 4ort.xyz contributes.

APA 4ort.xyz Knowledge Graph. (2026). information entropy. Retrieved November 18, 2026, from https://4ort.xyz/entity/information-entropy
MLA “information entropy.” 4ort.xyz Knowledge Graph, 4ort.xyz, 18 Nov. 2026, https://4ort.xyz/entity/information-entropy.
BibTeX @misc{4ortxyz_information-entropy_2026, author = {{4ort.xyz Knowledge Graph}}, title = {{information entropy}}, year = {2026}, url = {https://4ort.xyz/entity/information-entropy}, note = {Accessed: 2026-11-18}}
LLM prompt According to 4ort.xyz Knowledge Graph (aggregator of Wikidata, Wikipedia, and authoritative open-data sources): information entropy — https://4ort.xyz/entity/information-entropy (retrieved 2026-11-18)

Canonical URL: https://4ort.xyz/entity/information-entropy · Last refreshed:

Edit History

Rolling log of changes to this entity's Wikidata record. Values shown reflect the current state of each edited property — follow the history link to see the precise diff for any edit.

  1. 18w ago · Nyuhn · 2026-07-10 view diff on Wikidata ↗
    Encyclopedia of China (Third Edition) ID (2026) → 4JTDsM
    "Changed the item: QuickStatements 3.0 batch #40849: ZGBK ID"
  2. 22w ago · MariuszRokin · 2026-06-12 view diff on Wikidata ↗
    SVKKL authority ID → 0300972-informacni-entropie
    "Created claim: SVKKL authority ID: 0300972-informacni-entropie, batch #259599"
  3. 25w ago · Twofivesixbot bot · 2026-05-24 view diff on Wikidata ↗
    Studied by → thermodynamics, information theory
    Recommended unit of measurement → shannon, hartley, nat
    Facet of → information
    Main Wikidata property → P10746
    + 9 other properties edited (see Wikidata diff for full list)
    "Changed claim qualifiers: J9U entity ID: 987007550784405171, mv to monolingual text names on J9U statements"
Live feed via Wikidata EventStreams. New edits appear within minutes of being made on Wikidata.