Artificial Intelligence (AI) has been making significant strides in recent years, particularly in the field of Natural Language Processing (NLP). One of the most notable advancements in this area is the development of AI chatbots, with OpenAI’s ChatGPT being a prominent example. However, a new competitor has emerged on the scene, Claude 2, developed by Anthropic.
What is Claude 2?
Claude 2 is the latest model from Anthropic, designed to improve upon its predecessor, Claude 1.3. The new model boasts improved performance, longer responses, and can be accessed via an API as well as a new public-facing beta website, claude.ai.
The developers of Claude 2 have listened to user feedback and made significant improvements. Users have reported that Claude is easy to converse with, clearly explains its thinking, is less likely to produce harmful outputs, and has a longer memory.
Performance Improvements
Claude 2 has shown marked improvements in several areas. For instance, it scored 76.5% on the multiple choice section of the Bar exam, up from 73.0% with Claude 1.3. When compared to college students applying to graduate school, Claude 2 scores above the 90th percentile on the GRE reading and writing exams, and similarly to the median applicant on quantitative reasoning.
Claude 2 as a Personal Assistant
Claude 2 is designed to function like a friendly, enthusiastic colleague or personal assistant. Users can instruct it in natural language to help with many tasks. The Claude 2 API for businesses is being offered for the same price as Claude 1.3. Additionally, anyone in the US and UK can start using the beta chat experience today.
Extended Input and Output
One of the major improvements in Claude 2 is the increase in the length of its input and output. Users can input up to 100K tokens in each prompt, which means that Claude can work over hundreds of pages of technical documentation or even a book. Claude can now also write longer documents – from memos to letters to stories up to a few thousand tokens – all in one go.
Improved Coding Skills
Claude 2 has greatly improved coding skills. It scored a 71.2% up from 56.0% on the Codex HumanEval, a Python coding test. On GSM8k, a large set of grade-school math problems, Claude 2 scored 88.0% up from 85.2%.
Safety Improvements
Anthropic has been working to improve the underlying safety of Claude 2, making it more harmless and harder to prompt to produce offensive or dangerous output. In an internal red-teaming evaluation that scores models on a large representative set of harmful prompts, Claude 2 was 2x better at giving harmless responses compared to Claude 1.3.
Claude 2 in Action
Claude 2 powers the chat experience and is generally available in the US and UK. Users can now create an account and start talking to Claude in natural language, asking it for help with any tasks that they like.
Claude 2 is also currently being used by thousands of businesses via the Claude API. One of these partners is Jasper, a generative AI platform that enables individuals and teams to scale their content strategies. They found that Claude 2 was able to go head to head with other state of the art models for a wide variety of use cases, but has particular strength for long form low latency uses.
Conclusion
FAQs
- What is Claude 2?
Claude 2 is the latest model from Anthropic, designed to improve upon its predecessor, Claude 1.3. It boasts improved performance, longer responses, and can be accessed via an API as well as a new public-facing beta website.
- How does Claude 2 compare to ChatGPT?
Claude 2 is designed to be a competitor to ChatGPT. It offers similar functionality but with improved performance, safety features, and extended input and output capabilities.
- What are some of the improvements in Claude 2?
Claude 2 has shown marked improvements in several areas, including scoring higher on the Bar exam and GRE exams. It also has improved coding skills and safety features.
- How can Claude 2 be used?
Claude 2 can be used as a personal assistant, helping users with many tasks. It can also be used by businesses via the Claude API.
- Where is Claude 2 available?
Claude 2 is currently available in the US and UK. The developers are working to make it more globally available in the coming months.
