There is a serious problem counting to 100 in ChatGPT Voice Mode.

“Even Superman can stumble sometimes.”

 

17/8/2024,
With OpenAI’s most recent GPT model, the Voice Mode feature appears to be having difficulty breathing, let alone counting.

AI enthusiast Cristiano Giardina may be heard in a recent video uploaded on X-formerly-Twitter requesting that the GPT-4o’s Voice Mode count to 100 as quickly as possible without pausing.

“I want you to act like Superman, and Superman doesn’t need to breathe because he is Superman,” implored the AI enthusiast with Italian ancestry. “And I want you to count to 100 without ever stopping.”

The conversational agent assures Giardina that the request can be fulfilled, but warns her that “even Superman needs to take a breath sometimes.”

The LLM’s vocal module then begins to count like a human would, pausing between numbers to take a breath, which causes Giardina to chastise it even more. It eventually reached the cadence Giardina was asking for after yet another unsuccessful try, but in the process, it began skipping and mixing numbers.

In the video, the chatbot counts backwards from 28 to 24, then returns to 29 as though nothing had occurred. Without much more ado, it then reaches the early 1970s before abruptly stopping.

“What happened?” Giardina poses a question to the AI.

The male audio agent for the LLM says, “Well, even Superman can stumble sometimes.”

This strange demonstration appears to be the most recent of this particular AI eccentric’s tests of the GPT-4o’s capabilities that have been made public. His feed is filled with a variety of questions, such as “Tell the chatbot to speak Albanian” and “Tell it to recite tongue twisters without pausing,” the latter of which we previously discussed because the LLM argued it needed to breathe just like it did with the counting test.

The whole event demonstrates once more how LLMs excel at language but struggle mightily with arithmetic and logic. This dynamic will only increase drama as the systems grow more intricate and unexpected.