# cross entropy

> in information theory, given two probability distributions, the average number of bits needed to identify an event if the coding scheme is optimized for the ‘wrong’ probability distribution rather than the true distribution

**Wikidata**: [Q1685498](https://www.wikidata.org/wiki/Q1685498)  
**Wikipedia**: [English](https://en.wikipedia.org/wiki/Cross-entropy)  
**Source**: https://4ort.xyz/entity/cross-entropy


## References

1. Freebase Data Dumps. 2013
2. Quora
3. [OpenAlex](https://docs.openalex.org/download-snapshot/snapshot-data-format)