(Photo by Jakub Porzycki/NurPhoto via Getty Images)
Anthropic's new AI model promises to outperform OpenAI's ChatGPT and Google's Gemini.
The update, dubbed Claude 3.5 Sonnet, is an update to Claude 3 Sonnet, one of three AI models the company debuted in March. Anthropic describes it as “our most intelligent model yet.”
“Sonnet now outperforms competitor models on key evaluations, at twice the speed of Claude 3 Opus (its older flagship model) and one-fifth the cost,” according to the company, which was founded by former OpenAI employees. (
OpenAI executive Jan Leike, who is now at rival firm Anthropic. They said that while superintelligence "seems far off now, we believe it could arrive this decade."
As evidence, Anthropic benchmarked Claude 3.5 against OpenAI’s newest AI model, GPT-4o, which powers ChatGPT. The results show Anthropic’s AI model achieving slightly better results in four of the six benchmarks focused on reasoning, coding, and math skills.
(Credit: Anthropic)In addition, Claude 3.5 also bested Google’s Gemini 1.5 across all the tested benchmarks. That said, AI benchmarks have often been criticized as unreliable indicators due to a lack of standardization and independent oversight. AI companies can pick and choose which benchmarks to use and which to discard.
So, the claims about Claude 3.5 should be taken with a grain of salt. Still, Anthropic says the new model has made advancements in its writing abilities, along with “grasping nuance, humor, and complex instructions.” This includes translating computer code, “making it particularly effective for updating legacy applications and migrating codebases,” the company says.
The other major enhancement involves Claude’s ability to process data visually. The “Claude 3.5 Sonnet for vision” feature can understand information from charts and graphs and also accurately transcribe text from imperfect images.
To make Claude more useful, Anthropic also added a new feature called “Artifacts,” which will display a second side-by-side window alongside the conversation box. Through the second window, you’ll be able to see and iterate on the content that Claude produces, whether it be computer code, images, or text documents.
“This creates a dynamic workspace where they (the user) can see, edit, and build upon Claude’s creations in real-time, seamlessly integrating AI-generated content into their projects and workflows,” the company says. “This preview feature marks Claude’s evolution from a conversational AI to a collaborative work environment.”
Anthropic is offering free access to Claude 3.5 through claude.ai and the Claude iOS app. Existing Claude Pro and Team plan subscribers will also receive access to the new model with “higher rate limits,” enabling them to send more queries to the chatbot before encountering restrictions.
The company also plans on upgrading its two other AI models, Claude 3 Haiku and Claude 3 Opus, with the new 3.5 tech later this year.
(Credit: Anthropic)