User-agent: * Disallow: /admin/ Disallow: /db/ Disallow: /includes/ Disallow: /league-table/ Disallow: /php/