
Making LLMs safe for mentally ill people is very difficult and this is a genuine tragedy but oh my god Yud is so gross here
Using the tragic passing of someone to smugly state that “the alignment by default COPE has been FALSIFIED” is really gross especially because Yud knows damn well this doesn’t “falsify” the “cope” unless he’s choosing to ignore any actual deeper claims of alignment by default. He’s acting like someone who’s engagement farming smugly

i for sure agree that LLMs can be a huge trouble spot for mentally vulnerable people and there needs to be something done about it
my point was more on him using it to do his worst-of-both-worlds arguments where he’s simultaneously saying that ‘alignment is FALSIFIED!’ and also doing heavy anthropomorphization to confirm his priors (whereas it’d be harder to say that with something that’s more leaning towards maybe in the question whether it should be anthro’d like claude since that has a much more robust system) and doing it off the back of someones death