ResearchResearch paperEfficiency & Inference · Reasoning & Planning · Large Language Models1 source · Oct 6, 2026

SCOPE: Certified Theorem Proving with a Language Model as the Policy Planner

Direct generation fails on multi-step numeric propositions: a proof is valid only if every content integer is correct, so the pass rate is bounded by the k-th power of the per-integer accuracy.

Key points

  • In proof assistants such as Lean, a generated proof must pass machine compilation checks, so evaluation needs no human scoring.
  • Controlled corruption across 2,617 reference proofs confirms this power law.
  • SCOPE (State-Conditioned Operator Planning and Execution) enforces the natural division of labor: the model plans over an operator vocabulary, a symbolic engine executes the numerics, and a compiler renders the proof.
  • On a 218-problem suite it certifies 191/218 (87.6%) with a 135M backbone; the 7B DeepSeek-Prover-V1.5-RL certifies 18/218 at 27.5 times the tokens and 37.5 times the wall-clock, and DeepSeek-Prover-V2-7B certifies zero on a bidirectional dual suite.

Sources (1)

  • [1]SCOPE: Certified Theorem Proving with a Language Model as the Policy Planner
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 6, 01:22 PM
    Direct generation fails on multi-step numeric propositions: a proof is valid only if every content integer is correct, so the pass rate is bounded by the k-th power of the per-integer accuracy.
    In proof assistants such as Lean, a generated proof must pass machine compilation checks, so evaluation needs no human scoring.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 6, 2026Introducing Mistral Large 4
  2. Oct 6, 2026[AINews] Reflection Beam - 501B-A23B American Open Model
  3. Sep 9, 2026vllm-project/vllm v0.29.0
  4. Aug 10, 2026vllm-project/vllm v0.27.0
  5. Jul 11, 2026vllm-project/vllm v0.25.0
  6. Jun 29, 2026vllm-project/vllm v0.24.0

Related