Skip to main content

ML Model Deployment

Models can be loaded from a variety of sources:

  • Local filesystem: Local ONNX files.
  • HuggingFace: Models Hosted on HuggingFace.
  • SpiceAI: Models trained on the Spice.AI Cloud Platform

A model component, within a Spicepod, has the following format.

nameUnique, readable name for the model within the Spicepod.
fromSource-specific address to uniquely identify a model
datasetsDatasets that the model depends on for inference
files (HF only)Specify an individual file within the HuggingFace repository to use

Model Source Docs