Giving Language Models Runtime Tools
Spice provides a set of tools that let LLMs interact with the runtime. To provide these tools to a Spice model, specify them in its params.spice_tools
.
models:
- name: sql-model
from: openai:gpt-4o
params:
spice_tools: list_datasets, sql, table_schema
- name: full-runtime
from: openai:gpt-4o
params:
spice_tools: auto # Use all available tools
Available tools​
list_datasets
: List all available datasets in the runtime.sql
: Execute SQL queries on the runtime.table_schema
: Get the schema of a specific SQL table.document_similarity
: For datasets with an embedding column, retrieve documents based on an input query. It is equivalent to /v1/search.