web crawler

noun Digital Technology.

1. (sometimes initial capital letter) a computer program that retrieves data from a website, as in order to index web pages for a search engine.