web crawler
internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)
Facts
4 properties- Instance of
- software category
- Subclass of
- Internet bot
- Has use
- web scraping[3]
- Topic has template
- Template:Web crawlers[4]
🏷️ Also known as
en search engine spider
en automatic indexer
en web scutter
en web crawler
en web crawlers
en spider
en web spider
en ant
ar زاحف ويب
de Webspider
de Web-Crawler
de Searchbot
de Webcrawler
de Crawler
de Suchroboter
el Ανιχνευτής ιστού
es araña web
es web crawler
es indexador web
es rastreador web
🔖 Identifiers · 19
- GND ID
- 4796298-7
- OpenAlex ID
- C13743948
- ComputerLanguage.com definition
- crawler
- Dictionary of Archives Terminology ID
- spider, harvester, web-crawler
- Encyclopedia of China (Third Edition) ID (2026)
- 2lOgjo
- Encyclopedia of China (Third Edition) old ID (2021)
- 448083
- Encyclopædia Britannica Online ID
- technology/Web-crawling-program, topic/crawler
- Freebase ID
- /m/08220
- GitHub topic
- crawler
- GitLab.com topic ID
- web-crawler
- Gran Enciclopèdia Catalana ID
- aranya
- Gran Enciclopèdia Catalana ID (former scheme)
- 0269275
Show all 19 identifiers +7
- KBpedia ID
- WorldWideWebRobot
- Microsoft Academic ID (discontinued)
- 13743948
- Quora topic ID
- Web-Crawlers
- TDKIV Wikibase ID
- sulfur
- TDKIV term ID
- 000000655
- Topic's main category
- Category:Web crawlers
- WordNet 3.1 Synset ID
- 06591891-n
🔗 Connections
Examples 8
Has use 1
Instance of 1
Subclass of 1
Subtypes 1
TDKIV Wikibase ID 1
Topic's main category 1
← Category's main topic 1
← SNARC ID 1
← Used by 1
Press Enter · cited answer in seconds