We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not large enough to be conclusive, our finding is a starting point for continued research and community deliberation.
  •  self   ( @self@awful.systems ) English
    2•8 months ago

    it’s hard to determine exactly what the author’s talking about most of the time, but a lot of the special properties they claim for inductive Turing machines and super-recursive algorithms appear to be just ordinary von Neumann model shit? also, they seem to be rather taken with the idea that you can modify and extend a Turing machine, but that’s not magic — it’s how I was taught the theoretical foundations for a bunch of CS concepts, like nondeterministic Turing machines and their relationship to NP-complete problems

    •  blakestacey   ( @blakestacey@awful.systems ) English
      3•8 months ago

      New top-level thread for complaining about the worst/weirdest Wikipedia article in one’s field of specialization?

      I wonder how much Rationalists have mucked up Wikipedia over the years just by being loud and persistent on topics where actual expertise would be necessary to push back.

      •  self   ( @self@awful.systems ) English
        2•8 months ago

        New top-level thread for complaining about the worst/weirdest Wikipedia article in one’s field of specialization?

        fuck yes I’m down! finally I’ve got a use for all the weird CS garbage I keep finding. do you figure this’d be better as a SneerClub or TechTakes thread?