Weekly thread to discuss whatever you’re working on, big or small, at work or in your free time.
- dubbel ( @dubbel@discuss.tchncs.de ) English4•3 months ago
Private project, not really security related: Crawling robots.txts to gather some statistics on which bots people are most often excluding - weirdly I couldn’t find any recent/regularly updated stats on this.
- PaddleMaster ( @PaddleMaster@beehaw.org ) English1•3 months ago
That’s a neat project. Are you looking for trends, or something specific?
- dubbel ( @dubbel@discuss.tchncs.de ) English3•3 months ago
It started with a popular mastodon posts on how to block openai crawlers I think, and I’d like to know whether people are actually implementing it.
- PaddleMaster ( @PaddleMaster@beehaw.org ) English1•3 months ago
That’s neat. I’m curious about this now. With “normal” search engines that have generally gone to shit, AI chat bots are on trend to give better results. If the robots.txt file is blocked from OpenAI, can I assume it hits other chatbots? And would that extend to Google/bing?
- PaddleMaster ( @PaddleMaster@beehaw.org ) English2•3 months ago
Project Management crap. It’s the money season in the government, so I get to ask for lots of money to try to do cool things.
- OppositeOfOxymoron ( @OppositeOfOxymoron@infosec.pub ) English2•3 months ago
Not strictly teh ciberrz, but upgrading to OpenBSD 7.5. Might rebuild a mail server this weekend.