Topic
An analysis of 352 sized benchmarks in The Frontier Wire's AI benchmarks dataset finds agent benchmarks are about 4.5 times smaller than the rest. That makes many leaderboard gaps statistical noise. The data, the method, and a table of the smallest score gap worth taking seriously at each benchmark size.
The Frontier Wire compared every per-prompt energy and water figure in its dataset. The extremes differ 2,300-fold for energy and over 1,600-fold for water, but four independent estimates for an ordinary text prompt sit within a factor of 1.75. Scope, request length and modality explain the rest.
An analysis of company sustainability reports in The Frontier Wire's AI water and energy dataset. Every one of the six companies that publish two years of water and electricity used less water per kilowatt-hour. None used less water. Together they added about 17.7 million cubic meters in a year.