Model Name	Extra	Capabilities	Engine
All OpenAI Models	openai	🛠️ 🖼	kani.engines.openai.OpenAIEngine
All Anthropic Models	anthropic	🛠️ 🖼	kani.engines.anthropic.AnthropicEngine
All Google AI Models	google	🛠️ 🖼	kani.engines.google.GoogleAIEngine
🤗 transformers[3]	huggingface[1]	(model-specific)	kani.engines.huggingface.HuggingEngine
llama.cpp[2]	cpp	(model-specific)	kani.engines.llamacpp.LlamaCppEngine
vLLM[2]	vllm	(model-specific)	kani.ext.vllm.VLLMEngine, VLLMServerEngine, or VLLMOpenAIEngine

Additional models using the classes above are also supported - see the model zoo for a more comprehensive list of models!

Legend

• 🛠️: Supports function calling.

• 🖼: Supports multimodal inputs.

[1]

You will also need to install PyTorch manually.

[2] (1,2)

This is a model runtime that can support multiple models using a PromptPipeline.

[3]

The HuggingEngine can run most models directly from HuggingFace using Chat Templates. For more fine-grained control over prompting, see PromptPipeline.