User-agent: * Disallow: /api Disallow: */miner