Character.AI, the GenAI site that convinced some children to kill themselves, has gone bankrupt after parents sued them.

we found hordes of chatbots explicitly dedicated to themes of pedophilia, suicide, self-harm, and eating disorder coaching, as well as a thriving community of users creating chatbots designed to simulate school shootings, romanticize real mass shooters, and even impersonate the real child victims of mass shootings.

  • Rimu ( rimu@piefed.social ) OP
    link
    fedilink
    English
    arrow-up
    56
    ·
    edit-2
    17 days ago

    As well as harming its users and then getting sued, the economics of it all just didn’t add up.

    https://www.404media.co/character-ais-bankruptcy-documents-show-the-economics-of-ai-dont-work/

    The company said that in 2024, the company spent $13.8 million per month on AI compute; in 2025, it spent $10 million per month on AI compute. The company’s subscription revenue peaked at $2.8 million per month, but at times was less than $1 million per month. Its revenue from all sources, including ads, has peaked at $5.3 million per month.

      • matlag ( matlag@sh.itjust.works ) 
        link
        fedilink
        English
        arrow-up
        20
        ·
        17 days ago

        If losing money mattered, they would all be under already.

        Right now investors still hope that somewhat, all these companies will manage to break even and they can recover some of their losses.

        • Pratai ( Pratai@piefed.ca ) 
          link
          fedilink
          English
          arrow-up
          2
          ·
          17 days ago

          A lot of them will be bringing in trillions once the “free-era” of AI usage is over and everyone is hooked and can’t function without it.

          Then the monthly rates come in. The AI companies will own everything we touch.

            • Pratai ( Pratai@piefed.ca ) 
              link
              fedilink
              English
              arrow-up
              1
              ·
              17 days ago

              They will. Because they won’t be able to function without it. They already can’t think for themselves without asking their AI for help.

              Trust me. They’ll pay.

              • Rothe ( Rothe@piefed.social ) 
                link
                fedilink
                English
                arrow-up
                5
                ·
                17 days ago

                Perhaps for a small group of consumers. Not nearly enough for it to be even close to profitable though. I think you are unaware of the hundreds of billions of dollars of debt these companies are in. And those loans are coming due now and the next years. They will need to pay those debts or else they lose all of the compute, which is literally their entire business. Neither Anthropic or OpenAI owns any datacenters, they are all leased on debt.

                They will need to suddenly be more profitable than Microsoft and Google, while they are currently much much less profitable than even the poorest household you can imagine.

                  • And I think you’re overestimating the money most families make a month. If they are so in the red that many can’t even afford groceries, do you think they’ll be able to add a hefty AI bill monthly to the amount they already can’t pay? It’s basic maths: If I earn 10 and just to exist I need 12 right now, how will I be able to pay 20 when I add the AI bill if I still earn 10?

                  • puz ( puz@piefed.social ) 
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    15 days ago

                    You make it sound as if I could just quit my job right now and just pay for all my expenses with my credit card. I wonder how long I could pull this off :)

                  • tyler ( tyler@programming.dev ) 
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    16 days ago

                    Which will end the first time they can’t make a payment. It’s like you do not understand basic economics. Without a job you can’t pay for things. It doesn’t matter if you have a credit card or not. Your credit card will be closed because you have no income.

              • story ( story@lemmy.zip ) 
                link
                fedilink
                English
                arrow-up
                1
                ·
                16 days ago

                you are familiar with this history of the open-source/proprietary dialectic yeah? at most deepseek stays a few months behind frontier models. your pessimism feels like a Microsoft windows 7 user’s pessimism about operating systems in 2008 (yes, it will get worse for you specifically because paying for the new model is easier than finding a good free one). If i were you i would probably be pessimistic too, but we would need to ban the open weight models and then VPNs too, and then effectively enforce these bans in order to get the future you predict. I’m not seeing it. And these LLMs aren’t very smart. Ask them about free alternatives and they’ll tell you.

              • puz ( puz@piefed.social ) 
                link
                fedilink
                English
                arrow-up
                1
                ·
                15 days ago

                The question is not if addicts would pay a high price for AI (they probably would) but if they CAN afford it (they probably can’t).

          • ShadowRam ( ShadowRam@fedia.io ) 
            link
            fedilink
            arrow-up
            3
            ·
            17 days ago

            Nah, once this all crashes, hardware will go back to being semi-normal. (along with new fabs going online), and we’ll all be able to get hardware to run our models locally.

            What they will be selling is the models. Just like software, we’ll purchase a model outright, subscribe to an updating model, or we’ll pirate a model, or there will be free open-source models.

            The idea that we’d all intimately interact with a single centralized AI over the net was a stupid idea doomed to failure since the beginning.

        • Talcosis ( impairedimperator@lemmy.zip ) 
          link
          fedilink
          English
          arrow-up
          1
          ·
          17 days ago

          Fun thing about investing is that it values hype as much as it values results. You don’t need to believe in the product, you just need to believe that other people will invest money faster than the company loses money, and you’ll come out ahead.

          Good think American retirement accounts are legally required to invest in stuff.