Forum

Hi there,

Is it possible to deny access based on user agent string?

I'd like to stop bots looking for URLs which no longer exist which clogs up the app's error log with missing controller exceptions, and to stop bots from trying to access the app domain in general.

I found this old forum thread [www.hiawatha-webserver.org], but "DenyBot" doesn't seem to be mentioned in the documentation any more.

Thanks.

The DenyBot has been replaced with the generic Header UrlToolkit option:

UrlToolkit {
  ToolkitID = block_bots
  Header User-Agent googlebot DenyAccess
  Header User-Agent bingbot DenyAccess
}

Spiffing. Thanks.