• Hirom ( Hirom@beehaw.org ) 
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    2 months ago

    Gönner said investing in new technologies, such as artificial intelligence, was vital.

    Huge amount of money and resources is already (mis)allocated to LLM-style AI. With very dubious results on productivity, jobs, and clearly bad results for the environment.

    It’s surprising to see people wanting to pour even more money into this pit.

    • ranzispa ( ranzispa@mander.xyz ) 
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 months ago

      Is Germany allocating a lot of money to LLM stuff? I see positively the increase in computing power available in the EU: consumption is there, just outsourced from other countries.

      I do see positively European projects such as AI factories. Eventually they may not even be used for AI development, but a strong computing infrastructure accessible to researchers and small companies will definitely be useful for the development of European technology.

      • Hirom ( Hirom@beehaw.org ) 
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        LLMs require specialized processors, ie TPUs and ASICs. Using GPUs or CPUs would be even less efficients. AI datacenters layout and cooling are specifically designed to accomodate those specialized processors.

        My understanding is that repurposing such datacenter for other kind of computing would be expensive. Doing this shortly after building them would mean loosing a signifiant portion of the initial investment. ie would require replacing processors, cooming, and redisigning the overall layout to optimize for another type of processing.

        • ranzispa ( ranzispa@mander.xyz ) 
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 months ago

          AI factories have CPUs and GPUs. Either way, TPUs can be used for other kinds of calculations as well. And definitely, given enough availability of TPUs, specialized software will be optimized to run on them.

          But either way, no this is not the case. I know people who work with LLMs and they mostly use GPUs, even when they work on US computing clusters.

          • Hirom ( Hirom@beehaw.org ) 
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 months ago

            Fair point, GPUs are often used too, and have other uses for HPC workloads.

            There is still a major misallocations of resources for AI. This infrastructure is badly needed by big tech for their AI growth plans. No one else need this much.

            There’s no good reasons to build at that scale and so fast, for any reason.

            There’s a need to lower overall energy and resources usage, and improve efficiency. Building many large datacenters for LLMs go in the wrong direction.