User-agent: * Disallow: /admin/ Disallow: /list/ User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.png$ User-agent: ia_archiver Disallow: / User-agent: archive.org_bot Disallow: / User-agent: ia_archiver-web.archive.org Disallow: /