Subscribe now

Analysis and Technology

GPT-4: Is the AI behind ChatGPT getting worse?

The AI that powers ChatGPT appears to be performing less well at mathematical problems than it was just a few months ago

By Jeremy Hsu

24 July 2023

ChatGPT is getting worse at some tasks

ChatGPT is getting worse at some tasks

MauriceNorbert/Alamy

The AI powering ChatGPT may provide completely different answers to the same mathematical problems over time. Those findings from recent experiments have fuelled an ongoing debate about whether the AI chatbot’s performance is getting worse – and have spurred the firm behind it, OpenAI, to reassure customers that applications built on ChatGPT will not continually break.

“The takeaway message is that the behaviour of the ‘same’ large language model can change substantially,” says Lingjiao Chen at Stanford University in California. “It is important…

Sign up to our weekly newsletter

Receive a weekly dose of discovery in your inbox! We'll also keep you up to date with New Scientist events and special offers.

Sign up

To continue reading, subscribe today with our introductory offers

View introductory offers

No commitment, cancel anytime*

Offer ends 2nd of July 2024.

*Cancel anytime within 14 days of payment to receive a refund on unserved issues.

Inclusive of applicable taxes (VAT)

or

Existing subscribers

Sign in to your account