Bot Mitigation and Service Disruption

Important forum news
Locked
Message
Author
Edward
Site Admin
Posts: 12
Joined: Tue Oct 17, 2023 10:43 am

Bot Mitigation and Service Disruption

#1 Post by Edward »

Hello,

Just to make people aware of some goings on.

I've noticed a pattern of bots crawling the website unpolitely, these bots make too may requests and overload the server - resulting in errors for visitors.

I've planned to take a few reasonable steps to address this:
- Cloudflare Protection (In Progress) - This may disrupt service for a short time, you may see odd redirections or SSL errors.
- Rate Limiting (Prevent bots making too many requests in a short amount of time)
- Updating robots.txt file, which may prevent some unwanted bots crawling the page if they respect the contents of the file.

- Edward

LPGC
Installer
Posts: 5515
Joined: Wed Sep 29, 2010 6:01 pm
Location: Yorkshire
Contact:

Re: Bot Mitigation and Service Disruption

#2 Post by LPGC »

:-)
Full time LPG installer
Servicing / Diagnostics / Repairs to all systems / DIY conversion kits supplied with thorough tech support
Mid Yorkshire
2 miles A1, 8 miles M62,
http://www.Lpgc.co.uk
Twitter https://twitter.com/AutogasSimon
07816237240

Gilbertd
Senior Member
Posts: 9258
Joined: Wed Apr 09, 2008 10:00 am
Location: Peterborough

Re: Bot Mitigation and Service Disruption

#3 Post by Gilbertd »

All working perfectly again now, thanks
96 Saab 900XS, AEB Leo, sold
93 Range Rover 4.2LSE, Lovato LovEco, sold
97 Range Rover 4.0SE, multipoint, sold
98 Ex-Police Range Rover 4.0, AEB Leo, daily motor
96 Range Rover 4.6HSE Ascot, AEB Leo, my spare


Proud member of the YCHJCYA2PDTHFH club.

robertXX
Member
Posts: 491
Joined: Sat Dec 18, 2010 9:45 am

Re: Bot Mitigation and Service Disruption

#4 Post by robertXX »

Thank you Edward :)
"The Temptress" thread..... https://forum.retro-rides.org/thread/215234/temptress
'Medusa" thread .....https://www.rodsnsods.co.uk/threads/medusa.206057/

Edward
Site Admin
Posts: 12
Joined: Tue Oct 17, 2023 10:43 am

Re: Bot Mitigation and Service Disruption

#5 Post by Edward »

Just a quick update on this:

Since putting Cloudflare in front of the site and enabling some Bot protection rules we've seen a dramatic drop in the number of unwanted bots scraping the site, attempting to spam signup etc.

From time to mine you may be asked to 'Verify you're human' when visiting the forum. This challenge is part of the Cloudflare protection and is expected occasionally, probably more often if you make use of VPN or proxy services.

No other changes are planned, just keeping things up to date and maintenence.

If anybody encounters any issues just let me know. 👍
Administrator

LPGC
Installer
Posts: 5515
Joined: Wed Sep 29, 2010 6:01 pm
Location: Yorkshire
Contact:

Re: Bot Mitigation and Service Disruption

#6 Post by LPGC »

Thanks ;-)
Full time LPG installer
Servicing / Diagnostics / Repairs to all systems / DIY conversion kits supplied with thorough tech support
Mid Yorkshire
2 miles A1, 8 miles M62,
http://www.Lpgc.co.uk
Twitter https://twitter.com/AutogasSimon
07816237240

Locked