• degen ( degen@midwest.social ) 
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 months ago

          I know what it stands for, it just seems kind of unnecessary and dumb. Maybe there were people saying the same things about GPUs back in the day, idk

      • wewbull ( wewbull@feddit.uk ) 
        link
        fedilink
        English
        arrow-up
        3
        ·
        9 months ago

        It’s a big matrix multiplier that is tailored for machine learning model evaluation (not training). Often they are low precision as that’s all you need for model evaluation (or “inference”).

        Think of it as a much less useful GPU because it won’t do graphics.