# All robots will spider the domain User-agent: * # Disallow directory /pix/ Disallow: /pix/ Disallow: /addons/ Disallow: /admin/ Disallow: /images/ Disallow: /includes/ Disallow: /language/ Disallow: /new/ Disallow: /stats/ Disallow: /templates/ Disallow: /thumbnails/