MegaIndex Crawler
MegaIndex indexes links all around the Internet
Search Backlinks
For Webmasters
The logic of indexer supports restrictions in “User-agent:*” directive of robots.txt
MegaIndex Crawler uses the Crawl-delay value specified in robot.txt. The maximum allowable value is no more than 5s.