Running AI models without matrix math means far less power consumption—and fewer GPUs?

Running AI models without matrix math means far less power consumption—and fewer GPUs?

  •  bitfucker   ( @bitfucker@programming.dev ) English
    4•3 months ago

    Good

    Edit: Oh shit nvm. It still requires dedicated HW (FPGA). This is no different than say, an NPU. But to be fair, they also said the researcher tested the model on traditional GPU too and reduce memory consumption.