New Versions of ChatGPT are Worse Than Old!

ChatGPT, the chat bot that OpenAI launched in November 2022, managed to go viral all over the world with what it could do. ChatGPThas started to be used in many mobile applications today, especially as an actor in customer representation.

While we assume that ChatGPT improves with each update, a study published on July 18 revealed interesting results. Scientists from Stanford and Universities of California agree with each new language model of ChatGPT. starting to give worse answers explained.

Higher failure rate on latest GPT models:

The research team members Lingjiao Chen, Matei Zaharia, and James Zou put two different versions and two versions of GPT, the language model that created ChatGPT, to the test: GPT-3.5 March/June and GPT-4 March/June.

In the test, the language model was asked several math problems and sensitive questions. Asked to write code and reason about input. Especially the difference between the versions was quite surprising.

The March release of GPT-4 is the release of an issue submitted to it. whether it is a prime number It managed to know with an accuracy rate of 97.6%. In the June version of the same version, this rate is only 2.4% was limited to.

In prime numbers, the success of GPT-3.5 was even better than GPT-4 March. GPT-3.5 March release releases prime numbers in the same period with higher accuracy he knew. Similar decreases experienced as it developed showed itself in coding.

When it came to sensitive questions, a strange picture emerged. In March releases, the bot sends a question to the user. why can’t you answer he explained in detail. In June versions, only user he apologizes and he says he can’t answer the question.

The research team also explained the reason behind the decline in ChatGPT’s capabilities. could not determine.