Google launched its latest artificial intelligence powerhouse, Gemini 1.5 Pro, today, making the experimental “version 0801” available for early testing and feedback through Google AI Studio and the Gemini API. This release marks a major leap forward in the company’s AI capabilities and has already sent shockwaves through the tech community. The new model has quickly claimed the top spot on the prestigious LMSYS Chatbot Arena leaderboard (built with Gradio), boasting an impressive ELO score of 1300. This achievement puts Gemini 1.5 Pro ahead of formidable competitors like OpenAI’s GPT-4o (ELO: 1286) and Anthropic’s Claude-3.5 Sonnet (ELO: 1271), potentially signaling a shift in the AI landscape. Simon Tokumine, a key figure in the Gemini team, celebrated the release in a post on X.com, describing it as “the strongest, most intelligent Gemini we’ve ever made.” Early user feedback supports this claim, with one Redditor calling the model “insanely good” and expressing hope that its capabilities won’t be scaled back.Gemini 1.5 Pro demonstrates strengths across a wide range of tasks. According to LMSYS data, the model excels in multi-lingual tasks and shows robust performance in technical areas such as mathematics, complex prompts, and coding. It has also secured the top position on LMSYS’s Vision Leaderboard, underscoring its multimodal capabilities. This release builds on the foundation laid by Gemini 1.5, which Google unveiled in February. A standout feature of the 1.5 series is its expansive context window of up to two million tokens, far surpassing many competing models. This allows Gemini 1.5 Pro to process and reason about vast amounts of information, including lengthy documents, extensive code bases, and extended audio or video content.
Full report : Google Gemini 1.5 Pro leaps ahead in AI race, challenging GPT-4o.
