Building LLM Applications with Llama Stack
In this talk, we will describe what it takes to build production grade LLM applications. Unlike regular applications, LLM applications are non-deterministic, and require a unique set of building blocks to support the full software development lifecycle from building to testing to deploying to monitoring to then improving the application. We will show how Llama Stack can be used to build and improve LLM applications in different environments – local development, cloud, on-prem, and mobile.