The AI powering ChatGPT may provide completely different answers to the same mathematical problems over time. Those findings from recent experiments have fuelled an ongoing debate about whether the AI chatbot’s performance is getting worse – and have spurred the firm behind it, OpenAI, to reassure customers that applications built on ChatGPT will not continually break.
“The takeaway message is that the behaviour of the ‘same’ large language model can change substantially,” says Lingjiao Chen at Stanford University in California. “It is important…