Tiny Transformer trained for addition learns bizarre addition algorithmwww.alignmentforum.orgexternal-link ☆ Yσɠƚԋσʂ ☆ ( @yogthos@lemmy.ml ) Machine Learning@lemmy.mlEnglish • 11 months ago message-square1fedilinkarrow-up15
arrow-up15external-linkTiny Transformer trained for addition learns bizarre addition algorithmwww.alignmentforum.org ☆ Yσɠƚԋσʂ ☆ ( @yogthos@lemmy.ml ) Machine Learning@lemmy.mlEnglish • 11 months ago message-square1fedilink
minus-square maccam912 ( @maccam912@beehaw.org ) linkfedilinkEnglish1•11 months agoThe takeaway for me on this though was how it started off essentially memorizing the sums, until eventually “getting it” and finding an algorithm.
The takeaway for me on this though was how it started off essentially memorizing the sums, until eventually “getting it” and finding an algorithm.