User-agent: * Disallow: /pub/ Disallow: /js/ Disallow: /css/ Disallow: /EXTRANET Disallow: /admin.php