# applies to all robots User-agent: * Disallow: /admin/ Disallow: /frog/ Disallow: /public/