2025-02-27

Hot take: GPT 4.5 is a nothing burger

Recent releases of GPT-4.5 and Grok 3 demonstrate diminishing returns in AI scaling, despite massive investments. Industry leaders show uncharacteristic restraint in announcements, while market indicators suggest a cooling period for AI enthusiasm.

Original archive.is archive.ph web.archive.org

Log in to get one-click access to archived versions of this article.

read comments on news aggregators:

Related articles

Making Cloudflare the best platform for building AI Agents

Cloudflare announces the agents-sdk framework for building AI agents, along with updates to Workers AI including JSON mode and longer context windows. The platform enables developers to create autonomous AI systems that can execute tasks through dynamic decision-making, with seamless deployment and scaling capabilities on Cloudflare's infrastructure.

Claude 3.7 Sonnet and Claude Code

Anthropic introduces Claude 3.7 Sonnet, a groundbreaking hybrid reasoning model featuring instant responses and extended thinking capabilities, alongside Claude Code for agentic coding tasks. The model demonstrates superior performance in coding and web development, with significant improvements in handling complex codebases and advanced tool usage. Available across multiple platforms, it maintains the same pricing while offering enhanced reasoning capabilities and GitHub integration.

Home | Substack

The progression of AI capabilities should be measured by the ratio of useful output per unit of human input, rather than through AGI timelines. Drawing parallels between self-driving cars and language models, the focus should shift to measuring how long AI systems can operate effectively without human intervention. While AI systems are becoming increasingly productive, they may never achieve complete autonomy without human guidance.

The most underreported and important story in AI right now is that pure scaling has failed to produce AGI

Recent developments suggest that the scaling hypothesis in AI - investing massive resources in data and GPUs to achieve artificial general intelligence - is hitting significant limitations. Major tech companies and investors are acknowledging diminishing returns from pure scaling approaches, with persistent issues like hallucinations and unreliability remaining unsolved. A market correction appears likely as the industry grapples with sustainability concerns and the need for new innovative approaches.

Software engineering job openings hit five-year low?

Software developer job listings have dropped to a five-year low, showing 35% fewer vacancies than in 2020 and 3.5x fewer than the mid-2022 peak. The decline is attributed to multiple factors including GenAI impact, interest rate changes, and potential over-recruitment during 2021-2022. Despite the downturn, emerging trends suggest opportunities in AI-driven development and non-developer software creation.

Open Euro LLM

OpenEuroLLM represents a collaborative European initiative to develop transparent, compliant foundation models for AI, focusing on EU languages and cultural diversity. The project aims to create accessible, open-source language models while ensuring compliance with EU regulations and AI standards.

Grok 3: Another Win For The Bitter Lesson

xAI's Grok 3 demonstrates unprecedented performance, matching or exceeding models from established labs like OpenAI and Google DeepMind. The success reinforces the 'Bitter Lesson' principle that scaling compute power consistently outperforms algorithmic optimization in AI development. The paradigm shift from pre-training to post-training has leveled the playing field for newcomers while highlighting the critical importance of GPU access.

Andrej Karpathy on X: "I was given early access to Grok 3 earlier today, making me I think one of the first few who could run a quick vibe check. Thinking ✅ First, Grok 3 clearly has an around state of the art thinking model ("Think" button) and did great out of the box on my Settler's of Catan https://t.co/qIrUAN1IfD" / X

A comprehensive hands-on evaluation of Grok 3 reveals performance comparable to top-tier models like OpenAI's o1-pro, particularly excelling in complex reasoning tasks with its 'Think' button feature. The model demonstrates strong capabilities in coding, mathematics, and general knowledge queries, while showing some limitations in humor generation and ethical reasoning.