Beyond Basic Prompting: Supercharging Open Source LLMs with LMQL's Structured Generation

Christiaan Swart

Wednesday 15:10 in Europium2
  1. Introduction to structured generation with LMQL and open-source LLMs

    • Key differences between constrained and free-form generation
    • Why structure matters for production applications
    • Setting up LMQL with Llama
  2. Building a RAG system with structured outputs

    • Implementing context retrieval with constraints
    • Enforcing response formats through LMQL decorators
    • Handling edge cases and error states
  3. Tool usage and function calling

    • Implementing tool calls through LMQL
    • Managing tool execution flow
    • Error handling and fallbacks
  4. Interactive segment

    • Audience members will write and test their own LMQL prompts through a live demo environment
  5. Production considerations

    • Scaling structured generation
    • Monitoring and logging strategies

Attendees will leave with practical knowledge of how to implement structured generation in their own projects using LMQL, understanding both the technical implementation and best practices for production deployment.

Christiaan Swart

On a mission to structure unstructured text with NLP

Ex-cofounder with 8 years experience in NLP

I come from a mixed Hungarian-Dutch background and live in Nuremberg at the moment

In my free time I enjoy improv theatre and swimming