A new way of measuring AI models suggests China's threat to OpenAI and Anthropic may have been overblown
Source: Business Insider ·
Chinese AI models fell behind US rivals after Artificial Analysis revamped its tests, raising questions about open-weight AI's performance.
From the source
The DeepSeek logo on a smartphoneIllustration by Omar Marques/SOPA Images/LightRocket via Getty ImagesArtificial Analysis's revamped ranking widened the gap between top closed and open-weight AI models.Many tests are now private, but the firm also changed the tasks and how it weights them.Open-weight AI remains competitive in coding. Usage figures offer only a limited view of demand.Chinese AI models have fallen sharply behind American rivals in a closely watched ranking, raising fresh questions about whether the threat from cheaper, freely available AI technology has been exaggerated.Artificial Analysis, a prominent independent firm that measures AI performance, recently overhauled its testing system to better reflect how people actually use the technology.One crucial change: Many of the tests are now kept secret, making it harder for AI companies to train their models specifically to perform well on them.The results were striking.Artificial Analysis said the best so-called…
BestAIBroker analysis
- Finance-aware sentiment: slightly positive (+0.10 on a -1 to +1 scale).
- Event classification: OTHER.
- Market importance score: 35/100, weighting entity relevance, source credibility, multi-outlet coverage and recency.