Skip to main content

Chat models

Chat models are language models that use a sequence of messages as inputs and return messages as outputs (as opposed to using plain text). These are generally newer models.

info

If you'd like to write your own chat model, see this how-to. If you'd like to contribute an integration, see Contributing integrations.

ModelStreamJSON modeTool CallingwithStructuredOutput()Multimodal
BedrockChat🟡 (Bedrock Anthropic only)🟡 (Bedrock Anthropic only)🟡 (Bedrock Anthropic only)
ChatBedrockConverse
ChatAnthropic
ChatCloudflareWorkersAI
ChatCohere
ChatFireworks
ChatGoogleGenerativeAI
ChatVertexAI
ChatGroq
ChatMistralAI
ChatOllama
ChatOpenAI
ChatTogetherAI

All chat models

NameDescription
Alibaba TongyiLangChain.js supports the Alibaba qwen family of models.
AnthropicAnthropic is an AI safety and research
Azure OpenAIAzure OpenAI is a Microsoft Azure service that provides powerful
Baidu QianfanSetup
Amazon BedrockAmazon Bedrock is a fully managed
Amazon Bedrock Converse[Amazon Bedrock
Cloudflare Workers AIWorkers AI allows you
CohereCohere is a Canadian startup that provides
Deep InfraLangChain supports chat models hosted by Deep Infra through the ChatD...
Fake LLMLangChain provides a fake LLM chat model for testing purposes. This a...
FireworksFireworks AI is an AI inference platform to run
FriendliFriendli enhances AI application performance and optimizes cost savin...
Google GenAIGoogle AI offers a number of different chat
Google Vertex AIGoogle Vertex is a service that
GroqGroq is a company that offers fast AI inference,
Llama CPPOnly available on Node.js.
MinimaxMinimax is a Chinese startup that provides natural language processin...
MistralAIMistral AI is a platform that offers hosting for
MoonshotLangChain.js supports the Moonshot AI family of models.
OllamaOllama allows you to run open-source large
Ollama FunctionsThe LangChain Ollama integration package has official support for too...
OpenAIOpenAI is an artificial
PremAISetup
PromptLayer OpenAIYou can pass in the optional returnPromptLayerId boolean to get a pro...
Tencent HunyuanLangChain.js supports the Tencent Hunyuan family of models.
TogetherTogether AI offers an API to query [50+
WebLLMOnly available in web environments.
YandexGPTLangChain.js supports calling YandexGPT chat models.
ZhipuAILangChain.js supports the Zhipu AI family of models.

Was this page helpful?


You can also leave detailed feedback on GitHub.