๐Ÿ“Š Data Coverage Audit

Cached 5 min ยท force refresh
127,756,161 entities total

๐Ÿฉบ Cohort health โ€” completeness by data source

The gap-radar. Global averages hide sub-population gaps โ€” slicing every metric by data-source cohort is the lens that caught the 12.9M minted-entity classification hole. red = low, amber = partial, green = healthy.

CohortEntities P31ClassifiedNamed DescrSlugEmbed PViewsProgImage
openalex 41,066,832 98.4% 0.0% 100.0% 7.8% 100.0% 7.8% 0.0% 12.7% 0.0%
wikidata_bulk 40,556,244 97.4% 97.4% 100.0% 80.8% 100.0% 100.0% 30.1% 99.9% 0.4%
musicbrainz 9,600,081 100.0% 100.0% 100.0% 100.0% 100.0% 100.0% 0.0% 100.0% 0.0%
mx_denue 5,530,966 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.3% 0.0%
companies_house 5,489,949 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.8% 0.0%
asic_companies 4,013,298 0.7% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.3% 0.0%
gleif 3,321,025 100.0% 84.1% 100.0% 100.0% 100.0% 84.1% 0.0% 91.1% 0.0%
ro_onrc 2,690,642 98.9% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.3% 0.0%
ua_edr 1,877,635 1.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
canada_federal_corporations 1,498,931 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.7% 0.0%
cl_res 1,240,468 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
sos_ct 1,219,585 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.3% 0.0%
ar_rns 1,193,656 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
sg_acra 1,074,561 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 6.4% 0.0%
cz_res 916,275 74.4% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 9.1% 0.0%
shop_products 829,867 100.0% 100.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.1% 0.0%
ie_cro 823,068 0.2% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 9.0% 0.0%
sk_rpo 621,744 83.7% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.3% 0.0%
ch_zefix 597,425 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
cy_drcor 485,952 99.2% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
fsa_fhrs 415,342 2.6% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 8.9% 0.0%
lv_ur 394,599 86.3% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 16.0% 0.0%
usda 389,001 100.0% 100.0% 100.0% 100.0% 100.0% 100.0% 0.0% 100.0% 0.0%
lt_jar 375,048 0.4% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
openfda 336,573 100.0% 100.0% 100.0% 100.0% 100.0% 100.0% 0.0% 94.5% 0.0%
clinicaltrials 265,171 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.8% 0.0%
historic_england_nhle 227,260 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.8% 0.0%
eu_cordis 210,971 65.2% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 33.1% 0.0%
mt_mbr 115,743 54.3% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 5.4% 0.0%
oss_kb 91,161 100.0% 100.0% 100.0% 46.8% 100.0% 0.0% 0.0% 5.0% 0.0%
iccd_immobili 65,474 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.7% 0.0%
nhtsa 42,794 100.0% 100.0% 100.0% 100.0% 100.0% 100.0% 0.0% 100.0% 0.0%
worldbank_projects 28,172 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 25.1% 0.0%
gem_wind_power 26,469 2.3% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.7% 0.0%
oscr 24,734 0.6% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 26.0% 0.0%
github 18,239 100.0% 0.0% 100.0% 100.0% 100.0% 100.0% 0.0% 100.0% 0.0%
eia_860 15,905 70.6% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.4% 0.0%
eu_transparency_register 13,321 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 25.5% 0.0%
huggingface 13,124 100.0% 0.0% 100.0% 100.0% 100.0% 100.0% 0.0% 100.0% 0.0%
gem_hydropower 6,454 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 24.8% 0.0%
annuaire_education 6,118 24.6% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 33.3% 0.0%
eurlex 5,231 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 44.6% 0.0%
gem_oil_gas_plants 4,650 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 26.4% 0.0%
gem_coal_plants 4,162 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 25.1% 0.0%
sec 3,810 9.3% 100.0% 100.0% 100.0% 100.0% 98.1% 0.0% 63.2% 0.0%
college_scorecard 2,579 24.9% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 28.3% 0.0%
ni_hed 1,424 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 30.0% 0.0%
gvp_votw 1,198 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 33.0% 0.0%
4ort.shop 1,058 100.0% 0.0% 100.0% 0.1% 100.0% 0.0% 0.0% 44.9% 0.0%
npu_pamatky 1,035 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 33.1% 0.0%
nz_schools 420 92.1% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 90.7% 0.0%
gem_geothermal 388 0.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 43.6% 0.0%
gem_nuclear_power 305 100.0% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 45.9% 0.0%
nps_units 24 79.2% 0.0% 100.0% 0.0% 100.0% 0.0% 0.0% 100.0% 0.0%

๐Ÿšจ Invariants โ€” assertions that should hold

Non-zero = a gap to fix. Catches structural surprises before they're stumbled on.

CheckViolationsStatus
Minted CC0 entities not field-classified (need a resolvable P31 Q-id) 73,114,852 ๐Ÿ”ด fix
Has P31 but unclassified โ€” flat value, not a resolvable Q-id 53,196,185 ๐Ÿ”ด fix
Field-classified yet no P31 (consistency check) 3,457 ๐Ÿ”ด fix
Named entities with no slug โ†’ unreachable pages 1,679 ๐Ÿ”ด fix
Has a Wikidata P18 image claim but no stored image_url 5,502,430 โ„น๏ธ info
Entities with no name 0 โœ… ok

๐Ÿ“ฅ Data sources ingested

Two kinds: creators (added new entity rows) and augmenters (attached fields/tables to existing entities). All currently CC0 or public-domain unless tagged.

Entity-creator sources

SourceLicenseEntities created

Entity-augmenter sources

SourceLicenseEntities enriched

โฑ๏ธ Freshness

How stale is each data stream right now. Pageview hourly lags Wikimedia's publish window (typically 3-5h behind real time); rollups settle into the daily/monthly tiers nightly.

Pageview ingest (hourly, global)

Latest hour ingested (any lang)
2026-10-25T07:00:00+00:00
0 rows

Pageview rollups

Daily rollup max(day)
2026-10-25
1,107,800,960 rows
Monthly rollup max(month)
2026-10-01
89,115,112 rows

Wikidata edit stream

Latest edit_ts ingested
2026-10-25T11:13:41+00:00
0 rows

Per-entity coverage

Percentage of the realistic ceiling for each field โ€” i.e. how close we are to what's actually achievable. Image coverage isn't “X of 28.8M” (most entities never had a Wikidata image), it's “X of entities that can have an image”. Hover any row for the absolute number.

Wikidata ID linked
127,755,103 / 127,756,161
100.0%
Description present
49,714,374 / 127,756,161
38.9%
URL slug generated
127,754,482 / 127,756,161
100.0%
Wikidata claims_rich (full data)
127,754,592 / 127,756,161
100.0%
Wikipedia article (any value)
38,766,343 / 127,756,161
30.3%
Image URL set(of entities with P18 (Wikidata image) in claims_rich)
147,692 / 5,651,141
2.6%
Image self-hosted (vs hotlinked)(of entities with an image URL set)
5,577 / 147,692
3.8%
Wikidata claim citations(of entities with claims_rich)
4,689,490 / 127,754,592
3.7%
Wikipedia pageview data(of entities with a real Wikipedia article)
12,929,340 / 8,876,742
145.7%
domains[] populated (post-classification)(of entities with claims_rich)
53,599,689 / 127,754,592
42.0%
professions[] populated(of entities with P106 (occupation) โ€” basically people)
6,536,195 / 6,537,613
100.0%
harvest_domain set(of entities with claims_rich)
127,735,897 / 127,754,592
100.0%
Schema.org type (not Thing/class)(of entities with claims_rich)
117,716,000 / 127,754,592
92.1%
SEC EDGAR (CIK + ticker)
10,351 / 127,756,161
0.0%
Website/domain metrics tracked
34,868 / 127,756,161
0.0%
LLM-enriched article
189,443 / 127,756,161
0.1%
Vector embedding generated
189,637 / 127,756,161
0.1%
Marked for image re-harvest
302 / 127,756,161
0.0%
Infrastructure pages (lists/disambig/categories)
668 / 127,756,161
0.0%

๐Ÿ”— Hotlink risk

External assets we should be self-hosting. Each one = performance hit, privacy/GDPR risk, and policy violation territory.

๐Ÿ–ผ๏ธ Images hotlinked from upload.wikimedia.org (5,577 self-hosted of 147,692)
142,115
96.2%
๐Ÿ”ค Templates loading Google Fonts (GDPR risk) (pricing.html, country_read_index.html, country_read.html, registry_officers.html, topics_hub.html)
5 / 54
9%

Auxiliary tables

Row counts for related tables. Bigger isn't always better โ€” depends on what each table represents.

wikidata_items 91,584,848
wikidata_class_hierarchy 5,172,642
wikidata_class_closure 44,316,192
wikidata_properties 13,427
entity_relationships 45,784,072
entity_filings 2,658,552
entity_pageviews_hourly missing/err: not in pg_class
entity_pageviews_monthly 89,115,112
entity_clickflow 14,236,762
entity_sitelinks 65,483,212
entity_aliases 95,000,360
entity_descriptions 69,993,256
search_metrics 43,432
sitelink_languages 185