- cross-posted to:
- gentech@lemmy.intai.tech
cross-posted from: https://lemmy.intai.tech/post/5502
cross-posted from: https://lemmy.intai.tech/post/5501
cross-posted from: https://lemmy.intai.tech/post/5502
cross-posted from: https://lemmy.intai.tech/post/5501
I was going to ask which are transformer based but it’s actually nearly all of them (non grey) 😳. I thought BERT was still pre transformers. Goes to show how quickly things have evolved in recent years.
yeah, the idea of making it transformers all the way down was key, each node is a complete Turing machine.