Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
manitcor ( manitcor@lemmy.intai.tech )  to TechnologyEnglish · 3 years ago

Different development paths of LLMs

lemmy.intai.tech

message-square
16
link
fedilink
  • cross-posted to:
  • gentech@lemmy.intai.tech
61

Different development paths of LLMs

lemmy.intai.tech

manitcor ( manitcor@lemmy.intai.tech )  to TechnologyEnglish · 3 years ago
message-square
16
link
fedilink
  • cross-posted to:
  • gentech@lemmy.intai.tech

cross-posted from: https://lemmy.intai.tech/post/5502

cross-posted from: https://lemmy.intai.tech/post/5501

https://www.interconnects.ai/p/llm-development-paths

  • 🐝bownage [they/he] ( bownage@beehaw.org ) 
    link
    fedilink
    English
    arrow-up
    5
    ·
    3 years ago

    I was going to ask which are transformer based but it’s actually nearly all of them (non grey) 😳. I thought BERT was still pre transformers. Goes to show how quickly things have evolved in recent years.

    • manitcor ( manitcor@lemmy.intai.tech ) OP
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 years ago

      yeah, the idea of making it transformers all the way down was key, each node is a complete Turing machine.

Technology

technology

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

  • Free and Open Source Software
  • Programming
  • Operating Systems

This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 231 users / day
  • 393 users / week
  • 2K users / month
  • 4.95K users / 6 months
  • 5.11K local subscribers
  • 43.7K subscribers
  • 6.44K Posts
  • 107K Comments
  • Modlog
  • mods:
  • Chris Remington ( remington@beehaw.org ) 
  • alyaza [they/she] ( alyaza@beehaw.org ) 
  • TheRtRevKaiser ( TheRtRevKaiser@beehaw.org ) 
  • gyrfalcon ( gyrfalcon@beehaw.org ) 
  • rs5th ( rs5th@beehaw.org ) 
  • coldredlight ( coldredlight@beehaw.org ) 
  • Leigh ( SemioticStandard@beehaw.org ) 
  • TheRtRevKaiser ( TheRtRevKaiser@kbin.social ) 
  • BE: 0.19.15
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code