Crawler

Software that follows every link on a site and reports what it finds; surfaces pages the CMS forgot it had. Strategic Web Management Ch. 7 (7.1)

View all Glossary Terms