ChatGPT finally has competition — Google Bard with Gemini just matched it with a huge upgrade | Tom's Guide
LMSys Chatboat Arena leaderboard | |||
Rank | Model | Organization | License |
1 | GPT-4 Turbo | OpenAI | Proprietary |
2 | Bard (Gemini Pro) | Google | Proprietary |
3 | GPT-4-0314 | OpenAI | Proprietary |
4 | GPT-4-0613 | OpenAI | Proprietary |
5 | Mistral Medium | Mistral | Proprietary |
6 | Claude-1 | Anthropic | Proprietary |
7 | Claude-2.0 | Anthropic | Proprietary |
8 | Mixtral-8x7b | Mistral | Apache 2.0 |
9 | Gemini Pro (Dev API) | Google | Proprietary |
10 | Claude 2.1 | Anthropic | Proprietary |
How does Bard compare with the competition?
Gemini Pro on its own, as an API and not part of Bard with live internet access comes in at number 9 and an earlier version of Gemini Pro is at number 12 in the current leaderboard.
While Bard with Gemini Pro has come in strong at number two, three of the top five are all versions of OpenAI's GPT-4 model with GPT-4-Turbo taking the top spot.
Nine of the top ten models are proprietary, with French startup Mistral's Mixtra-8x7b the only open-source large language model in the upper region of the table.
Anthropic's Claude and Mistral's Mistral Medium, a proprietary version of the Mixtral model, are the only non-Google or OpenAI models in the top ten.
What is new with Google Bard?
Bard, powered by the Gemini Pro-scale model, debuts at the #2 position on the independent lmsys leaderboard. 🔥Give it a try at https://t.co/m9D7JYUfls. Bard is much better & has many more capabilities since its debut in March, thanks to everyone on the Bard/Gemini teams! https://t.co/rOPTbOE4v8January 26, 2024