Skip to content

Bring an LLM provider to the Foundation Models framework

Extend the Foundation Models framework by implementing a LanguageModelExecutor for new models. Explore how to interface with the LanguageModelSession’s transcript, manage session state effectively, and optimize KV cache utilization. Find out how to support custom segment types and unlock advanced capabilities for your generative AI features.

✍️

No notes available yet

Be the hero who changes that. Watch the video, jot down what matters, and open a pull request – it's genuinely quick.

Learn how to contribute