# Robots.txt file from http://www.pin5i.com # All robots will spider the domain User-agent: * Disallow:/bin/ Disallow:/admin/ Disallow:/aspnet_client/ Disallow:/config/ Disallow:/ipdata/ Disallow:/javascript/