Original post · Original
Tibo@thsottiaux
@charliermarsh Actual engineering going on here.
In Codex, we use a WebSocket for model requests, to send data incrementally over time.
We’ve now increased the WebSocket size limit from 16 to 128 MB (8x), so large turns avoid falling back to HTTP (bad!).
And if a request _does_ go over the limit, it’s now ~5x faster.
View this post on X ↗
· UTC+8