# crawler A robot that copies the current site and searches for all hyperlinks and follows them.