Spider

Share to:

Spider, a.k.a. web crawler, is a bot that automatically traverses the web by downloading documents and following links from page to page.