Back to all

deterministic-inference

by Monxun

00Feb 6, 2026Visit Source
Techniques for achieving reproducible LLM inference outputs. Use when: requiring exact reproducibility, batch-invariant inference, RL training reproducibility, consistent heuristic evaluation. Supports: SGLang deterministic mode, seed configuration, validation.