# All robots will spider the domain User-agent: * Disallow: # Disallow directory /old/ User-agent: * Disallow: /old/ # Disallow directory /freelance/ User-agent: * Disallow: /freelance/ # Disallow directory /nycug/ User-agent: * Disallow: /nycug/ # Disallow directory /bitterend/ User-agent: * Disallow: /bitterend/