Are you curious to see a full deployment, from nuts and bolts (open source) to delivery? This presentation details the design and deployment of a locally hosted, open-source LLM within a government organization, from ordering individual parts and building a server by hand, to developing the software and integrating it into existing systems. It covers LLM fundamentals, an overview of Retrieval-Augmented Generation (RAG), and operational best practices, followed by a practical discussion of secure, on-premises implementation. Attend this talk to see the full picture!
