structured-output · output-formatting · dream-7b, llada-8b
recommended confidence: moderate no check recorded
FA-constrained decoding substantially improves accuracy on schema-constrained generation
- On BFCL-Live, constrained decoding raises Dream-7B accuracy from 63.9% to 71.5% under greedy decoding and from 22.3% to 69.0% under stochastic sampling, with under 5% wall-clock overhead. arXiv:2607.07026
- The unconstrained baseline degrades sharply when the required output format switches from JSON to Python, and constrained decoding largely closes this format gap, indicating the failures are formatting-related rather than intent-related. arXiv:2607.07026
Constrained Decoding for Diffusion Language Models via Efficient Inference over Finite Automata · arXiv preprint, 2026 not read in full