# All robots will spider the domain User-agent: Fasterfox Disallow: /cgi-bin/ Disallow: /orgfla/ Disallow: /press/ Disallow: /freestuff/ User-agent: * # Disallow directorys Disallow: /cgi-bin/ Disallow: /orgfla/ Disallow: /press/ Disallow: /freestuff/