[User-Agent] Go-http-client/2.0

[mitchellkrogza]

Paste the full User-Agent String here

Paste the full User-Agent String here (paste in between the ```     ``` markers)
Example: (serpstatbot/1.0 (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)

Is this for Addition / Removal?

• Addition
• Removal
• Keep a watch on this one

Did the User-Agent request robots.txt first?

• Yes
• No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

Post log excerpt here (paste in between the ```     ``` markers)

Additional information

Add any other context about the problem here.

[mitchellkrogza]

A very common http library which is now being used for extreme levels of abusive behaviour and scraping. This will be blocked and anyone wanting it unblocked will need to whitelist it in their own whitelist.

[bctrainers]

I've had NUMEROUS instances where it's not just Go-http-client/2.0 is showing as the UA. If anything, it almost feels as if the version value is being spoofed on some clients. Unless these other version IDs do exist?

I have the following in my UA blacklist:

"~*(?:\b)Go\-http\-client(?:\b)" 3;
"~*(?:\b)Go\-http\-client/1.1(?:\b)"
"~*(?:\b)Go\-http\-client/2.0(?:\b)"

I assume the first item would be enough to also capture the /1.1 and /2.0 stuff?