Hello friends,
I climbed off major search providers since everyone is forcing AI down my throat.
I am now using ddg for web search and very old results from irc.cakephp.org are frequently making it frustrating to navigate.
Can somone please speak to an admin, to set a working robots.txt file on irc.cakephp.org, which disallows crawling, i.le.
User-agent: *
Disallow: /
The last results are from 2021, but some stuff is over 10 years ago!
Or maybe just scrap everything before the slack era or some time-cutoff to the logs?
Thanks for your time,
Zumba