web crawler

internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)
rdfs:label
"web crawler"@en
skos:altLabel
"ant"@en
"automatic indexer"@en
"search engine spider"@en
"spider"@en
"web crawlers"@en
"web scutter"@en
"web spider"@en
schema:description
"internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)"@en
schema:dateModified "2026-09-30T15:01:25+00:00"^^xsd:dateTime
schema:version 2551356714
wikibase:identifiers 21
wikibase:sitelinks 50
wikibase:statements 27
p:P10283 wd:statement/Q45842-4AC8300A-C51D-45C2-9A13-01419CC08C03
p:P10565 wd:statement/Q45842-EF15BB33-C079-449B-A06F-3A028F805149
p:P11567 wd:statement/Q45842-8B897C11-31F2-46BA-A63A-C28C7635665A
wd:statement/Q45842-BFE6C7BF-B8AC-48FB-BC77-5EE7854364D5
wd:statement/Q45842-C6EA62BE-3FF5-44FF-8A4F-372BD39D33B0
p:P12385 wd:statement/Q45842-a6fb3da2-004d-4187-a983-f53da1dcadb2
p:P1296 wd:statement/Q45842-C6A43938-E9BB-4C15-932A-B131B0DD5A49
p:P13397 wd:statement/Q45842-78E63EB4-F993-442C-891F-70272BA26BE9
p:P13411 wd:statement/Q45842-9384FDC9-C87D-4262-B2E0-EDEFF8D0803A
p:P13572 wd:statement/Q45842-73155775-215C-4834-AFC0-1E29CE7E74E4
p:P1417 wd:statement/Q45842-3AC98EA0-4415-448D-97E9-9E2FDAFDAB18
wd:statement/Q45842-D8D0361E-06A1-4690-800C-4FC70062C634
p:P1424 wd:statement/Q45842-5fe907da-e905-46c8-a5ec-3ccd3805e2d5
p:P14541 wd:statement/Q45842-507BE4C0-1F39-4988-AB8E-3049C0D6CFAD
p:P18 wd:statement/Q45842-A019F3F5-36D2-43DE-A454-9CD362A16DE6
p:P227 wd:statement/Q45842-C797552B-3FB3-4BE0-8C4E-72763461E32B
p:P279 wd:statement/Q45842-687280c7-4ab4-1e40-d2f5-2e78c45fa839
p:P31 wd:statement/Q45842-d9de9e9e-4517-3627-bbce-60e0caccfdc5
p:P3417 wd:statement/Q45842-16C54462-2C16-4033-A3B3-01C41EC69582
p:P366 wd:statement/Q45842-11388d3a-4fd6-dfaa-cba9-343f21b3923d
p:P5398 wd:statement/Q45842-2661b9d1-402a-f236-3c5a-cb5917404bd6
p:P6366 wd:statement/Q45842-229F6F12-4732-44C7-AF7F-AF9F45AFEC41
p:P646 wd:statement/Q45842-C7C8EDAE-681C-4896-A0D0-9B4757ED9B8F
p:P8408 wd:statement/Q45842-5D886693-B9D1-4AF9-8B8E-9D58DC67EE29
p:P8814 wd:statement/Q45842-0CD160F3-D694-40CC-9BA4-E1AC261D6822
p:P910 wd:statement/Q45842-C22B42AB-FC99-4C03-91A0-8632AEB05C4B
p:P9100 wd:statement/Q45842-2A8CA693-7C72-45E2-8EA2-680E18CE6DE0
p:direct-normalized/P227 <https://d-nb.info/gnd/4796298-7>
p:direct-normalized/P6366 <https://makg.org/entity/13743948>
p:direct-normalized/P8408 <http://kbpedia.org/kko/rc/WorldWideWebRobot>
p:direct-normalized/P8814 <http://wordnet-rdf.princeton.edu/rdf/id/06591891-n>
wdt:P10283 "C13743948"
wdt:P10565 "448083"
wdt:P11567 "harvester"
"spider"
"web-crawler"
wdt:P12385 "aranya"
wdt:P1296 "0269275"
wdt:P13397 "web-crawler"
wdt:P13411 "Q682"
wdt:P13572 "crawler"
wdt:P1417 "technology/Web-crawling-program"
wdt:P1424 Template:Web crawlers
wdt:P14541 "2lOgjo"
wdt:P18 <http://commons.wikimedia.org/wiki/Special:FilePath/No%20crawl%20possibility%20because%20of%20robots%20file%20notice%20by%20Wayback%20Machine.png>
wdt:P227 "4796298-7"
wdt:P279 Internet bot
wdt:P31 software category
wdt:P3417 "Web-Crawlers"
wdt:P366 web scraping
wdt:P5398 "000000655"
wdt:P6366 "13743948"
wdt:P646 "/m/08220"
wdt:P8408 "WorldWideWebRobot"
wdt:P8814 "06591891-n"
wdt:P910 Category:Web crawlers
wdt:P9100 "crawler"
Download as:
TurtleJSON-LDRDF/XML
data from SPARQL profile: Wikidata