Bootcamp
Structured Output from LLM

Structured Output from LLM

Plain text is boring. Let's make it structured!

Working on Getting that JSON

Working on Getting that JSON

Working with Large Language Models (LLMs) can be challenging, especially when you need structured output. The output from LLMs is often malformed and requires post-processing to make it structured. However, you can guide the model to generate the desired output. In this tutorial, I'll show you my favorite way to get structured output from LLMs - using prompts and Pydantic.

Tutorial Goals

In this tutorial you will:

  • Learn about different ways of getting structured outputs
  • Prompt models that support JSON response
  • Use prompting and Pydantic to get valid JSON response

Ways to Get Structured Output from LLMs

MLExpert is loading...

References

Footnotes

  1. Outlines - Structured Text Generation (opens in a new tab)

  2. Every Way To Get Structured Output From LLMs (opens in a new tab)