Model Providers
Spice supports various model providers for traditional machine learning (ML) models and large language models (LLMs).
Source | Description | ML Format(s) | LLM Format(s)* |
---|---|---|---|
file | Local filesystem | ONNX | GGUF, GGML, SafeTensor |
huggingface | Models hosted on HuggingFace | ONNX | GGUF, GGML, SafeTensor |
spice.ai | Models hosted on the Spice Cloud Platform | ONNX | - |
openai | OpenAI (or compatible) LLM endpoint | - | Remote HTTP endpoint |
anthropic | Models hosted on Anthropic | - | Remote HTTP endpoint |
grok | Coming soon | - | Remote HTTP endpoint |
- LLM Format(s) may require additional files (e.g.
tokenizer_config.json
).
The model type is inferred based on the model source and files. For more detail, refer to the model
reference specification.
For details about augmenting language models (e.g. using tools), see the LLM documentation.