• I’ll keep presenting this challenge until someone meets it:

    Anyone who thinks LLMs aren’t generally intelligent, can you name a text processing task (ie text in, text out) than a general intelligence can do, that an LLM cannot?

    •  itsralC   ( @itsralC@lemm.ee ) 
      link
      fedilink
      English
      116 months ago

      Logic. As an example, non textbook math questions. I asked ChatGPT 3.5 this:

      Four friends (A, B, C and D) are standing in line. How many combinations are possible given that A and C cannot be next to eachother?

      It answered 20, the correct answer is 12.

      All possible conbinations

      abcd,abdc,adbc,adcb, cbad,cbda,cdba,cdab, bcda,badc, dcba,dabc

      Its answer

      To solve this, let’s first consider the total number of combinations when there are no restrictions. Since there are 4 friends, there are 4! (4 factorial) ways to arrange them, which equals 24 combinations.

      Now, let’s count the number of combinations where A and C are next to each other. Since A and C can be arranged in 2 ways, and for each arrangement, the other two friends (B and D) can be arranged in 2! ways, the total number of combinations where A and C are next to each other is 2 * 2! = 4.

      So, the number of combinations where A and C cannot be next to each other is the total number of combinations minus the number of combinations where A and C are next to each other:

      24 - 4 = 20 combinations.