Model Comparison

Andrej Karpathy on X: "I was given early access to Grok 3 earlier today, making me I think one of the first few who could run a quick vibe check. Thinking ✅ First, Grok 3 clearly has an around state of the art thinking model ("Think" button) and did great out of the box on my Settler's of Catan https://t.co/qIrUAN1IfD" / X

A comprehensive hands-on evaluation of Grok 3 reveals performance comparable to top-tier models like OpenAI's o1-pro, particularly excelling in complex reasoning tasks with its 'Think' button feature. The model demonstrates strong capabilities in coding, mathematics, and general knowledge queries, while showing some limitations in humor generation and ethical reasoning.