User-agent: * Disallow: /search Disallow: /q/ Disallow: /domains/ Disallow: /nameservers/ Disallow: /ip/ Disallow: /api