Together AI releases Together Compiler for continual inference optimizationMachine translation

Together Compiler uses coding agents to rewrite a model’s forward pass and re-optimizes it as traffic changes. It runs on several Together AI serverless endpoints and is in limited beta for customers. Together AI reports up to 2.6 times higher per-user throughput than the best published InferenceX configurations in its tests, with gains varying substantially by setting.