
2/ Okay, I think I might already have some ideas.
My latest #Apache log has 26,694 lines.
In these 26.694 lines, I have:
- 10,724 access requests from "https://developers.facebook.com/docs/sharing/webmasters/crawler"
- 4.562 access requests from "https://developer.amazon.com/support/amazonbot"
- 3.316 access requests from "https://openai.com/gptbot"
So yeah, I suspect these are the #LLM crawling bots from #Facebook , #Amazon , and #OpenAI who jointly make up for more than half the traffic - and they are hogging the more resource intensive functions, like "Recent Changes" on my wiki.
Fuck those fuckers for causing outages on my websites.
And any suggestions on how to block them (no snark, please - I _am_ new at this.)