Wednesday 15:10
in Europium2
Introduction to structured generation with LMQL and open-source LLMs
- Key differences between constrained and free-form generation
- Why structure matters for production applications
- Setting up LMQL with Llama
Building a RAG system with structured outputs
- Implementing context retrieval with constraints
- Enforcing response formats through LMQL decorators
- Handling edge cases and error states
Tool usage and function calling
- Implementing tool calls through LMQL
- Managing tool execution flow
- Error handling and fallbacks
Interactive segment
- Audience members will write and test their own LMQL prompts through a live demo environment
Production considerations
- Scaling structured generation
- Monitoring and logging strategies
Attendees will leave with practical knowledge of how to implement structured generation in their own projects using LMQL, understanding both the technical implementation and best practices for production deployment.
Christiaan Swart
On a mission to structure unstructured text with NLP
Ex-cofounder with 8 years experience in NLP
I come from a mixed Hungarian-Dutch background and live in Nuremberg at the moment
In my free time I enjoy improv theatre and swimming