User-agent: * Disallow: /dev/ Disallow: dev Disallow: files Disallow: /files/