Report: “Anthropic Debuts Its Most Powerful Chatbot Yet, as Generative AI Battle Heats Up”

From  CNBC:

Anthropic on Monday debuted Claude 3, a suite of artificial intelligence models that it says are its fastest and most powerful yet. The new tools are called Claude 3 Opus, Sonnet and Haiku.

The company said the most capable of the new models, Claude 3 Opus, outperformed OpenAI’s GPT-4 and Google’s Gemini Ultra on industry benchmark tests, such as undergraduate level knowledge, graduate level reasoning and basic mathematics.

This is the first time Anthropic has offered multimodal support. Users can upload photos, charts, documents and other types of unstructured data for analysis and answers.

[Clip]

Anthropic said Claude 3 can summarize up to about 150,00 words, or a sizeable book (think: around the length range of “Moby Dick” or “Harry Potter and the Deathly Hallows”). Its previous version could only summarize 75,000 words. Users can input large data sets, and ask for summaries in the form of a memo, letter or story. ChatGPT, by contrast, can handle about 3,000 words.

Read the Complete CNBC Article

Learn More, From Anthropic

Businesses of all sizes rely on our models to serve their customers, making it imperative for our model outputs to maintain high accuracy at scale. To assess this, we use a large set of complex, factual questions that target known weaknesses in current models. We categorize the responses into correct answers, incorrect answers (or hallucinations), and admissions of uncertainty, where the model says it doesn’t know the answer instead of providing incorrect information. Compared to Claude 2.1, Opus demonstrates a twofold improvement in accuracy (or correct answers) on these challenging open-ended questions while also exhibiting reduced levels of incorrect answers.

In addition to producing more trustworthy responses, we will soon enable citations in our Claude 3 models so they can point to precise sentences in reference material to verify their answers.

Read the Complete Anthropic Post

Filed under: Data Files, News, Patrons and Users