# Make changes for all web spiders
User-agent: *
Disallow: /in/
Disallow: /inc/
Disallow: /media/
User-agent: ia_archiver
Disallow: /