Formatron: A High-Performance Constrained Decoding Python Library that Allows Users to Control the Output Format of Language Models with Minimal Overhead
Language models (LMs), while powerful in generating human-like text, often produce unstructured and inconsistent outputs. The lack of structure in...