one passage of note:

Where does all of this leave the Firefox browser. Surman argued that the organization is very judicious about rolling AI into the browser — but he also believes that AI will become part of everything Mozilla does. “We want to implement AI in a way that’s trustworthy and benefits people,” he said. Fakespot is one example of this, but the overall vision is larger. “I think that’s what you’ll see from us, over the course of the next year, is how do you use the browser as the thing that represents you and how do you build AI into the browser that’s basically on your side as you move through the internet?” He noted that an Edge-like chatbot in a sidebar could be one way of doing this, but he seems to be thinking more in terms of an assistant that helps you summarize articles and maybe notify you proactively. “I think you’ll see the browser evolve. In our case, that’s to be more protective of you and more helpful to you. I think it’s more that you use the predictive and synthesizing capabilities of those tools to make it easier and safer to move through the internet.”

  • taanegl ( taanegl@beehaw.org ) 
    link
    fedilink
    arrow-up
    48
    ·
    edit-2
    3 years ago

    Say it with me now: local AI, local AI… or fuck off.

    That being said, ARM laptops and probably even workstations are the future, and so is RISC-V. I suspect we’ll see more tensor cores or AI related processing built-in to the SoC’s.

    If it’s then only a question of hardware enablement and a software companion to go along with it, I’m all for it.

    Go Mozilla…! But again: local AI, or fuck off.

      • jarfil ( jarfil@beehaw.org ) 
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        3 years ago

        Neuromorphic hardware seems to be best suited as an extension of RAM storage. It doesn’t need to use the DAC/ADC approach of Mythic AI, some versions are compatible with a CMOS process, and could be either integrated directly into the processor, maybe as an extension of the cache or a dedicated neural processing module, or into RAM modules.

        It’s pretty clear that current NN processing solutions, by repurposing existing hardware, are bound to get replaced by dedicated hardware with a fraction of the power requirements and orders of magnitude larger processing capabilities.

        Once some popular use cases for large NNs have been successfully proven, we can expect future hardware to come with support for them, so it also makes sense to make plans for software that can use them. And yes, local AI… and possibly trainable locally.

    • etrotta ( etrotta@beehaw.org ) 
      link
      fedilink
      English
      arrow-up
      5
      ·
      3 years ago

      The vast majority of consumer devices, both mobile and laptops/desktops, are not powerful enough to run local AI with a good user experience yet, and even if they were, a lot of users would still prefer having it run in the cloud rather than using up their phone battery

    • Bilb! ( bilb@lem.monster ) 
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 years ago

      Local by default, option to go remote. Even the privacy-first types might want to offload that to a more powerful local machine.

      They could even sell access to a Mozilla provided AI server like they do with the VPN service.