POST /v1/chat/completions

The POST /v1/chat/completions endpoint is an OpenAI compatible endpoint for generating chat completions.

Specify the model by providing the component name in the model key. For example:

curl http://localhost:8090/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "my_language_model",
    "messages": [
      {
        "role": "system",
        "content": "I am just like any other OpenAI server!"
      },
      {
        "role": "user",
        "content": "That\'s cool!"
      }
    ]
  }'