User-agent: *
Crawl-Delay: 30
Disallow: /wp-admin/
Disallow: /wp-includes/

User-agent: AhrefsBot
User-agent: Java-http-client
User-agent: SemrushBot
User-agent: Bytespider
Disallow: /