Huawei Researchers Develop LLM With 1.085 Trillion Parametersanalyticsindiamag.comexternal-link ☆ Yσɠƚԋσʂ ☆ ( @yogthos@lemmy.ml ) Technology@lemmy.ml • 1 year ago message-square6fedilinkarrow-up112
arrow-up112external-linkHuawei Researchers Develop LLM With 1.085 Trillion Parametersanalyticsindiamag.com ☆ Yσɠƚԋσʂ ☆ ( @yogthos@lemmy.ml ) Technology@lemmy.ml • 1 year ago message-square6fedilink
minus-square ☆ Yσɠƚԋσʂ ☆ ( @yogthos@lemmy.ml ) OPlinkfedilink5•1 year agoI think the solution there would be to run things in a distributed fashion the way petals is doing https://github.com/bigscience-workshop/petals
I think the solution there would be to run things in a distributed fashion the way petals is doing https://github.com/bigscience-workshop/petals