UserAgent: * Allow: / UserAgent: * Allow: /sex/ Sitemap: http://www.grabadesigner.com/sex/sitemap.xml.gz UserAgent: * Allow: /girls/ Sitemap: http://www.grabadesigner.com/girls/sitemap.xml.gz UserAgent: * Allow: /comic/ Sitemap: http://www.grabadesigner.com/comic/sitemap.xml.gz UserAgent: * Allow: /videos/ Sitemap: http://www.grabadesigner.com/videos/sitemap.xml.gz UserAgent: * Allow: /slut/ Sitemap: http://www.grabadesigner.com/slut/sitemap.xml.gz UserAgent: * Allow: /young/ Sitemap: http://www.grabadesigner.com/young/sitemap.xml.gz UserAgent: * Allow: /anime/ Sitemap: http://www.grabadesigner.com/anime/sitemap.xml.gz UserAgent: * Allow: /doujinshi/ Sitemap: http://www.grabadesigner.com/doujinshi/sitemap.xml.gz UserAgent: * Allow: /comics/ Sitemap: http://www.grabadesigner.com/comics/sitemap.xml.gz #Wildcard robots.txt agent (ask all bots to crawl slowly but still index everything). User-agent: * Crawl-delay: 1 Disallow: