aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

CPU-ARC study proposes reusing repeated reasoning as CPU codeMachine translation

AI introduction

A paper on CPU-ARC proposes having Claude Opus 4.5 turn a reasoning trace into Python functions with variable inputs. The functions then run on a CPU, with a fine-tuned 1B model used only for small text tasks such as extracting values. The cited summary says the cache matched or beat the source model’s accuracy on seven of eight math and science benchmarks; those results do not establish that it works for every repeated task.

Original post · Original

@rohanpaul_ai

– https://arxiv.org/abs/2611.09891

Title: "CPU-ARC: Agentic Reasoning Caching for on-CPU Reasoning Reuse"

ReplyRohan Paul@rohanpaul_ai
New NVIDIA paper finds that once an LLM has reasoned through a problem, the solution can run as CPU code for rephrased and re-numbered versions of it. that answers similar questions 16x to 291x cheaper. LLMs re-solve every problem from scratch, even when only wording or numbers change. Agents sending the same instructions with new data pay for that repeated reasoning each time. Their method has Claude Opus 4.5 turn a reasoning trace into small Python functions, with changeable inputs as parameters. At run time they execute on a CPU, calling a fine-tuned 1B model only for small text jobs like extracting values. The cache matched or beat the source model's accuracy on 7 of 8 math and science benchmarks, scoring 93.3% versus 83.3% on AIME '25. It handled at least 90% of rephrased or re-numbered variants. If your agent runs the same prompt on new inputs all day, cache the reasoning as code and use the LLM only on misses.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction