aifollow.news
Back Tibo
Tibo· @thsottiaux · X· · Original publication time AI score13

OpenAI models draw mixed reactions as speaker says rough edges will be improvedMachine translation

AI introduction

A speaker described the models as highly capable but said they still have rough edges to address. A quoted user said Astra 6.2 saturated a research benchmark they ran at low effort; the material does not provide the benchmark methodology or independent verification.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@thsottiaux

@JoshPurtell Beauty is in the eye of the beholder, but clearly the models are polarizing. A bit like we had in the early codex days. These models are clearly extremely capable but have a couple of rough edges that we will sand down over time.

ReplyJosh@JoshPurtell
Days like this I genuinely feel like I live in a different universe from the rest of the world. Saw ubiquitous 6.2 hate / it's over for OpenAI yada yada ... ran the highest-signal autoresearch bench and 6.2 sol/astr are *absolute monsters*. Astra 6.2 saturates it at low effort https://t.co/YFhXQbC9dc
View this post on X ↗
Related contextJosh@JoshPurtell
@_arohan_ Astra 6 was better than Fable 5.2 and Opus 5.5 on my highest signal OOD autoresearch eval. Haven't tested Astra 6.2 but assume it's modestly better. I can't speak to internal models but do you really prefer their public models for research that much? https://t.co/nuYWwNILyj
View this post on X ↗

Source: Tibo · x.com

Opinion
Found an error? Send a correction