Here are things to know about new ChatGPT-4o

Open AI announced on Monday that it is releasing a much faster version of its AI model, ChatGPT-4o, to the public.

The o in GPT-4o stands for omni, referring to the model’s ability to handle text, speech, and video. Over the next few weeks, it will be rolled out across the company’s developer and consumer-facing products.

In a live-streamed event, Mira Murati, technology chief revealed that the GPT-4o provides ‘GPT-4-level’ intelligence but improves GPT-4’s capabilities across multiple modalities and media. This new model allows ChatGPT to handle 50 languages with improved speed and quality.

Here is a breakdown of some of ChatGPT-4o’s capabilities:

1. It has been touted as the first multi-modal AI model capable of reasoning about text, audio, and vision in real-time.
2. GPT-4o will allow for real-time translations, making global communication easier without learning new languages.
3. It can serve as a tutor, observing actions and offering real-time guidance through conversations.
4. The text-to-image capabilities of the model are a significant improvement on what is currently obtainable.
5. It can sing and harmonise with another GPT-4o.
6. It can be used to provide customer service support, which is likely to shake up the industry.
7. It is great at maths and is currently better at solving math problems than humans. It can also count very fast.
8. It can help job seekers prepare for interviews.
9. With its desktop app, ChatGPT-4o can participate in meetings and summarise them.
10. It can interact with pets.

In a blog post, Sam Altman, chief executive officer of OpenAI, revealed that this new GPT-4o feels like AI from the movies because of how real it is.

“Getting to human-level response times and expressiveness turns out to be a big change. The original ChatGPT showed a hint of what was possible with language interfaces; this new thing feels viscerally different. It is fast, smart, fun, natural, and helpful,” he said.