Self-Hosted Open Source LLMs: Best Practices and Strategies

Abstract

While a lot of organizations utilize 3^rd-party APIs and services to build generative AI-powered applications, we are seeing more teams set up their own self-hosted large language models (LLMs). In this session, we will discuss various best practices when building and managing self-hosted LLMs.