User-agent: * Disallow: /Multi/ Disallow: /BioMart/ Disallow: /Genome_reviews/ Allow: /Genome_reviews/geneview Allow: /Genome_reviews/sitemap.xml.gz User-Agent: W3C-checklink Disallow: