There’s a new release from Google Gemini this morning: the first in the Gemini 2.5 series. Google call it “a thinking model, designed to tackle increasingly complex problems”. It’s already sat at the top of the LM Arena leaderboard, and from initial impressions looks like it may deserve that top spot. I just released llm-gemini 0.16 adding support for the new model to my LLM command-line tool. Let’s try it out. First up, my classic generate an SVG of a pelican riding a bicycle prompt. This task is meant to be almost impossible: pelicans are the wrong shape to ride bicycles! Given that, I think this is a good attempt—I like it slightly better than my previous favourite Claude 3.7 Sonnet, which produced this a month ago. I had an MP3 lying around from a previous experiment which mixes English and Spanish. I tried running it with the prompt transcribe to see what would happen. This inspired me to try again, this time including a JSON schema (using LLM’s custom schema DSL). I got an excellent response from that.

Full in-depth : Gemini 2.5 Pro hands-on: a very strong model with 1M input tokens, 64K output tokens, a January 2025 knowledge cut-off, and very, very impressive coding skills.