# out of sheer curiosity I want to see what robots are acting nicely. if # anything requests these pages then it should be considered an impolite bot # and possibly forbidden from the site. the page 'unaware/default.html' does # not exist... User-agent: * Disallow: /unaware/default.html Disallow: /response/ Disallow: /noindex/ Disallow: /photos/