Crawling: Search engines like google use automatic packages termed crawlers or spiders to navigate the world wide web. These crawlers commence by visiting a summary of regarded Web content and pursuing backlinks on those webpages to find out new kinds. The web site makes use of graphs to check th