tooling · program-aided-computation

Offload arithmetic to code

Have the model write a short program for the numeric part and run it, instead of computing in text.

The model reads the problem and produces code that performs the calculation, then an interpreter executes it. The model does the decomposition it is good at and the interpreter does the arithmetic it is bad at. Works with any tool-calling setup that can run Python.

Requires: Requires a sandboxed interpreter.

Addresses: Digit-level arithmetic

Contexts: Math, Data analysis

Does it work?

argued, not measured1 supporting · 0 contesting source · last moved 2026-09-04

Efficacy claims — what this technique actually moves, under which conditions, and whether that has been contested.

mechanismmechanism reasoning
Offloading the calculation to generated code removes the arithmetic as a source of error but does not remove error — what remains is the translation from problem to program, which is now the only thing the model is doing. Verification has to move there with it.

Code

https://github.com/reasoning-machines/pal — Reference implementation with prompts and evaluation on math word problems.verified 2026-09-02

Sources

PAL: Program-aided Language Models (2022)