Unless I didn't look properly, I meant that it's not higher on everything. At higher effort and reasoning levels, for more complex tasks, Astra is better.
Also, these benchmarks are becoming less and less reflective of real-world use.
I'm just glad I'm not in this arms race. The pressure for Anthropic and OpenAI to stay ahead given the investment and market expectations of future revenue and profit must be huge!
Right, they don't directly claim that Terra beats Astra, but isn't that what the chart shows? A higher score, for less money? Higher is better, right?
Agreed that the falling cost is a good thing. Makes you wonder about the valuation of Anthropic at IPO though. Earning that…
commit f5391c9