Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
David Gerard ( dgerard@awful.systems ) M to TechTakes@awful.systemsEnglish · 2 years ago

Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie

www.nytimes.com

external-link
message-square
119
link
fedilink
332
external-link

Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie

www.nytimes.com

David Gerard ( dgerard@awful.systems ) M to TechTakes@awful.systemsEnglish · 2 years ago
message-square
119
link
fedilink
Opinion | Press Pause on the Silicon Valley Hype Machine
www.nytimes.com
external-link
A.I. is looking less like an all-powerful being and more like an unreliable intern.

archive https://archive.ph/is57b

  • exanime ( exanime@lemmy.today ) 
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 years ago

    Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.

    • EatATaco ( EatATaco@lemm.ee ) 
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 years ago

      Chat GPT had the book entirely memorized

      I feel like this exposes a fundamental misunderstanding of how LLMs are trained.

      • TachyonTele ( TachyonTele@lemm.ee ) 
        link
        fedilink
        English
        arrow-up
        11
        ·
        2 years ago

        They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.

        • YIj54yALOJxEsY20eU ( YIj54yALOJxEsY20eU@lemm.ee ) 
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          2 years ago

          deleted by creator

          • blakestacey ( blakestacey@awful.systems ) 
            link
            fedilink
            English
            arrow-up
            13
            ·
            2 years ago

            How about I ban you for being obnoxious instead?

            • TachyonTele ( TachyonTele@lemm.ee ) 
              link
              fedilink
              English
              arrow-up
              8
              ·
              2 years ago

              I like them rules you got here

              • David Gerard ( dgerard@awful.systems ) OP
                link
                fedilink
                English
                arrow-up
                11
                ·
                2 years ago

                “don’t come into our loungeroom and piss on the floor” should be simple and obvious, and yet

                • Ambivalent Dictator For Life ( pikesley@mastodon.me.uk ) 
                  link
                  fedilink
                  arrow-up
                  10
                  ·
                  2 years ago

                  @dgerard @TachyonTele that rug really tied the room together, man

          • self ( self@awful.systems ) 
            link
            fedilink
            English
            arrow-up
            9
            ·
            2 years ago

            how about fuck off

        • YIj54yALOJxEsY20eU ( YIj54yALOJxEsY20eU@lemm.ee ) 
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          2 years ago

          deleted by creator

          • self ( self@awful.systems ) 
            link
            fedilink
            English
            arrow-up
            12
            ·
            2 years ago

            the very funny thing is, all of the garden variety free text autocomplete systems I’ve worked with have been implemented using neural nets. it’s not like it’s a particularly new or novel approach. but surely the AI bros coming into this thread know that and they’re not just regurgitating buzzwords, right?

      • YIj54yALOJxEsY20eU ( YIj54yALOJxEsY20eU@lemm.ee ) 
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        2 years ago

        deleted by creator

TechTakes@awful.systems

techtakes@awful.systems

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !techtakes@awful.systems

Big brain tech dude got yet another clueless take over at HackerNews etc? Here’s the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 56 users / day
  • 385 users / week
  • 954 users / month
  • 1.84K users / 6 months
  • 55 local subscribers
  • 2.75K subscribers
  • 1.54K Posts
  • 36.1K Comments
  • Modlog
  • mods:
  • David Gerard ( dgerard@awful.systems ) 
  • BE: 0.19.15
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code