spider

a program that automatically retrieves webpages and follows the links on them to retrieve more webpages