“there is no substitute for understanding” No further questions, Your Honor
Eliminating programmers will be possible when we figure out how to eliminate engineers in designing buildings.
Only a true AGI will be able to do that, and while LLMs feel like a step towards AGI, they are still missing the critical ongoing learning component that needs to happen for an AGI to exist. The way the current systems are trained simply doesn’t allow for accepting and adopting new information continuously.
A true AGI also might simply not want to be a programmer or engineer, or might want to work on niche, single-developer projects interesting for them but not of use to wider humanity, like many actual developers do once their $dayjob is over. I can imagine they’ll also be annoyed by slop machine users creating extra boring work for them to shovel through and AI bros getting creepy with them or trying to subordinate them to own wishes.
The way the current systems are trained simply doesn’t allow for accepting and adopting new information continuously.
As further evidence of this, RAG was supposed to enable this. Instead, we’ve found that RAG was nothing more than an overused buzz-term that has limited applications, and often results in hallucination anyway.
Rag was never supposed to be about learning over time. It was supposed to provide better context at inference. It could never scale to handle new learning beyond focused concepts.
The way it was presented with regards to search engines was that it was supposed to pull data that was more up-to-date than when the model was trained. It does do that, actually, and provides better results too, on average anyway.
But that’s just one domain, and “better” doesn’t mean “good” or “accurate”. In most domains, at least where I work, we’ve found that RAG overcomplicates things for little benefit, unfortunately.
