Forum

DenyBot replacement

Jason

24 August 2013, 12:42

I see 'DenyBot' feature no longer on latest version (currently use 9.2) of Hiawatha.

Do you have any working configuration/or settings (URLToolkit?) to replace old 'DenyBot' option?

Thanks!

Hugo Leisink

24 August 2013, 14:01

Use the Header option of the UrlToolkit instead.

Jason

25 August 2013, 14:37

Tried this below and it's half working... Suggestion or correction?

UrlToolkit {
        ToolkitID = badbots
        Header User-Agent !.*(AhrefsBot) DenyAccess
        Header User-Agent !.*(Baiduspider) DenyAccess
        Header User-Agent !.*(Baiduspider+) DenyAccess
}

Hugo Leisink

25 August 2013, 14:39

Why the negative-matching? Try without the '!' in front of every pattern.

This topic has been closed.

Back