aifollow.news
Back Tibo
Tibo· @thsottiaux · X· · Original publication time AI score27

Codex raises WebSocket size limit for model requests to 128 MBMachine translation

AI introduction

Codex uses WebSocket to send model request data incrementally. Its team says it has raised the size limit from 16 MB to 128 MB, helping large turns avoid falling back to HTTP; requests that exceed the limit are now about five times faster.

Original post · Original

@thsottiaux

@charliermarsh Actual engineering going on here.

ReplyCharlie Marsh@charliermarsh
In Codex, we use a WebSocket for model requests, to send data incrementally over time. We’ve now increased the WebSocket size limit from 16 to 128 MB (8x), so large turns avoid falling back to HTTP (bad!). And if a request _does_ go over the limit, it’s now ~5x faster.
View this post on X ↗

Source: Tibo · x.com

Products
Found an error? Send a correction