# data deduplication

> data processing technique to eliminate duplicate copies of repeating data

**Wikidata**: [Q1182260](https://www.wikidata.org/wiki/Q1182260)  
**Wikipedia**: [English](https://en.wikipedia.org/wiki/Data_deduplication)  
**Source**: https://4ort.xyz/entity/data-deduplication


## References

1. Freebase Data Dumps. 2013
2. [OpenAlex](https://docs.openalex.org/download-snapshot/snapshot-data-format)