It is so hard to convince people of this. However much I explain how chatGPT is program to generate text that looks like it was written by a human, people want to believe it can do math and reason things out.

I usually point them to this hilarious video: https://www.youtube.com/watch?v=nUqPOsgu0uo