• Midnitte ( Midnitte@beehaw.org ) 
    link
    fedilink
    English
    arrow-up
    20
    ·
    10 months ago

    There’s a great talk here where he talks about using local models where I could see them actually being useful.

    Hopefully we get there and memory stops this ridiculous 5000% markup.

    • CalcProgrammer1 ( CalcProgrammer1@lemmy.today ) 
      link
      fedilink
      English
      arrow-up
      12
      ·
      10 months ago

      My only takeaway that could be seen as good news is that they at least expect consumers to have access to local computing power strong enough to run local AI, and that computing power is very likely in the form of GPUs that can also be used for PC gaming. Hopefully this means there’s still some focus on consumer GPUs somewhere out there rather than just selling them all to OpenAI.

  • artyom ( artyom@piefed.social ) 
    link
    fedilink
    English
    arrow-up
    10
    ·
    10 months ago

    Doesn’t really make much sense. I mean yeah, privacy and all of that but think of the environmental impact of 1000 inefficient PCs vs. 1 efficient PC shared by 1000 people. Maybe just open source models hosted by a community would be better.

    Or better yet just forget about it entirely.

  • The only way I would be comfortable with Ai is if I could craft it myself, run it locally, and prevent it from feeding bullshit results, was energy efficient, could prevent it from phoning home, wasn’t built off of stolen data and also didn’t give profit to big companies