Scrapy

Python web-crawling and scraping framework
Thing web_crawler Q368367
Press Enter · cited answer in seconds

Scrapy

Summary

Scrapy is a web crawler[1]. Scrapy draws 111 Wikipedia views per month (web_crawler category, ranking #3 of 4).[2]

Key Facts

  • Scrapy's instance of is recorded as web crawler[3].
  • Scrapy's instance of is recorded as free and open-source software[4].
  • Scrapy's instance of is recorded as Python package[5].
  • Scrapy's instance of is recorded as software[6].
  • Scrapy's developer is recorded as Pablo Hoffman[7].
  • Scrapy's collection is recorded as Social Sciences and Humanities Open Marketplace[8].
  • Scrapy's collection is recorded as Text Analysis Portal for Research[9].
  • Scrapy's copyright license is recorded as 3-clause BSD License[10].
  • Scrapy's programmed in is recorded as Python[11].
  • Scrapy's operating system is recorded as Microsoft Windows[12].
  • Scrapy's operating system is recorded as Linux[13].
  • Scrapy's operating system is recorded as macOS[14].
  • Scrapy's operating system is recorded as Berkeley Software Distribution[15].
  • Scrapy's software version identifier is recorded as 1.2.2[16].
  • Scrapy's software version identifier is recorded as 1.2.1[17].
  • Scrapy's software version identifier is recorded as 1.2.0[18].
  • Scrapy's software version identifier is recorded as 1.4.0[19].
  • Scrapy's software version identifier is recorded as 1.3.3[20].
  • Scrapy's software version identifier is recorded as 1.5.0[21].
  • Scrapy's software version identifier is recorded as 1.6.0[22].
  • Scrapy's software version identifier is recorded as 1.7.0[23].
  • Scrapy's software version identifier is recorded as 1.7.2[24].
  • Scrapy's software version identifier is recorded as 1.7.3[25].
  • Scrapy's software version identifier is recorded as 1.7.4[26].
  • Scrapy's software version identifier is recorded as 2.0.0[27].

Body

Definition and Type

Recorded instance of include web crawler[3], free and open-source software[4], Python package[5], and software[6].

Use and Application

Recorded has use include data visualization[28], analysis[29], and annotation[30].

Why It Matters

Scrapy draws 111 Wikipedia views per month (web_crawler category, ranking #3 of 4).[2] Scrapy has Wikipedia articles in 17 language editions, a strong signal of global cultural recognition.[31]

References

Programmatic citations — every numbered marker resolves to a verifiable graph row below.

Direct Wikidata claims

  1. [3] . wikidata.org.
  2. [4] . wikidata.org.
  3. [5] . wikidata.org.
  4. [6] . wikidata.org.
  5. [7] . wikidata.org.
  6. [8] . marketplace.sshopencloud.eu. marketplace.sshopencloud.eu. Provenance: wikidata.org.
  7. [9] . tapor.ca. tapor.ca. Provenance: wikidata.org.
  8. [10] . Free Software Directory. Retrieved . directory.fsf.org. Provenance: wikidata.org.
  9. [11] . Open Hub. Retrieved . openhub.net. Provenance: wikidata.org.
  10. [12] . doc.scrapy.org. Retrieved . doc.scrapy.org. Provenance: wikidata.org.
  11. [13] . doc.scrapy.org. Retrieved . doc.scrapy.org. Provenance: wikidata.org.
  12. [14] . doc.scrapy.org. Retrieved . doc.scrapy.org. Provenance: wikidata.org.
  13. [15] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  14. [16] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  15. [17] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  16. [18] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  17. [19] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  18. [20] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  19. [21] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  20. [22] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  21. [23] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  22. [24] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  23. [25] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  24. [26] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  25. [27] . github.com. Retrieved . github.com. Provenance: wikidata.org.
  26. [28] . marketplace.sshopencloud.eu. marketplace.sshopencloud.eu. Provenance: wikidata.org.
  27. [29] . marketplace.sshopencloud.eu. marketplace.sshopencloud.eu. Provenance: wikidata.org.
  28. [30] . marketplace.sshopencloud.eu. marketplace.sshopencloud.eu. Provenance: wikidata.org.

Class ancestry

  1. [1] . Wikidata. wikidata.org.

Aggregate / graph-position facts

  1. [2] . Wikimedia Foundation. dumps.wikimedia.org.
  2. [31] . Wikidata sitelinks. wikidata.org.

📑 Cite this page

Use these citations when quoting this entity in research, articles, AI prompts, or wherever provenance matters. We aggregate Wikidata + Wikipedia + authoritative open-data sources; the stitched, scored, cross-referenced view is what 4ort.xyz contributes.

APA 4ort.xyz Knowledge Graph. (2026). Scrapy. Retrieved May 3, 2026, from https://4ort.xyz/entity/scrapy
MLA “Scrapy.” 4ort.xyz Knowledge Graph, 4ort.xyz, 3 May. 2026, https://4ort.xyz/entity/scrapy.
BibTeX @misc{4ortxyz_scrapy_2026, author = {{4ort.xyz Knowledge Graph}}, title = {{Scrapy}}, year = {2026}, url = {https://4ort.xyz/entity/scrapy}, note = {Accessed: 2026-05-03}}
LLM prompt According to 4ort.xyz Knowledge Graph (aggregator of Wikidata, Wikipedia, and authoritative open-data sources): Scrapy — https://4ort.xyz/entity/scrapy (retrieved 2026-05-03)

Canonical URL: https://4ort.xyz/entity/scrapy · Last refreshed:

Edit History

Rolling log of changes to this entity's Wikidata record. Values shown reflect the current state of each edited property — follow the history link to see the precise diff for any edit.

  1. 1d ago · Github-wiki-bot bot · 2026-05-20 view diff on Wikidata ↗
    Software version identifier 1.2.2, 1.2.1, 1.2.0 +41
    "/* wbeditentity-statements-single-property-update:1||2 */ [[Property:P348]], Update with GitHub data ([[:toollabs:editgroups/b/CB/96c383e09430|details]])"
Live feed via Wikidata EventStreams. New edits appear within minutes of being made on Wikidata.