Skip to main content

Model Providers

Spice supports various model providers for traditional machine learning (ML) models and large language models (LLMs).

SourceDescriptionML Format(s)LLM Format(s)*
fileLocal filesystemONNXGGUF, GGML, SafeTensor
huggingfaceModels hosted on HuggingFaceONNXGGUF, GGML, SafeTensor
spice.aiModels hosted on the Spice Cloud PlatformONNX-
openaiOpenAI (or compatible) LLM endpoint-Remote HTTP endpoint
anthropicModels hosted on Anthropic-Remote HTTP endpoint
grokComing soon-Remote HTTP endpoint
  • LLM Format(s) may require additional files (e.g. tokenizer_config.json).

The model type is inferred based on the model source and files. For more detail, refer to the model reference specification.

For details about augmenting language models (e.g. using tools), see the LLM documentation.