There’s also a lot of manual human labor to build LLMs, I was surprised. From exploited African data labelers who have to shift through the most horrific things the web has to offer and remain traumatized for life, to highly paid domain experts who work on improving final results so it ends up looking like a simulation of themselves.