Jsonformer: A bulletproof way to generate structured output from LLMs

Problem: Getting models to output structed JSON is hard Solution: Only generate the content tokens and fill in the fixed tokens Generating structured JSON from language models is a challenging task… https://github.com/1rgs/jsonformer