AI/ML Models

Spice supports traditional machine learning (ML) models and language models (LLMs).

• Filesystem: ONNX models.
• HuggingFace: ONNX models hosted on HuggingFace.
• Spice Cloud Platform: Models hosted on the Spice Cloud Platform.
• OpenAI: OpenAI (or compatible) LLM endpoints.

Model Sources

Name	Description	ML Format(s)	LLM Format(s)*
file	Local filesystem	ONNX	GGUF, GGML, SafeTensor
huggingface:huggingface.co	Models hosted on HuggingFace	ONNX	GGUF, GGML, SafeTensor
spice.ai	Models hosted on the Spice Cloud Platform	ONNX	-
openai	OpenAI (or compatible) LLM endpoint	-	Remote HTTP endpoint

• LLM Format(s) may require additional files (e.g. tokenizer_config.json).

The model type is inferred based on the model source and files. For more detail, refer to the model reference specification.