LLMModelCreate

Payload used to create LLM Model. Required fields are name, type, provider.

nameName (string)required

alias object

anyOf

• string
• null

string

typeType (string)required

Model placement: internal hosts the model in D.Hub; external registers an existing endpoint.

Possible values: [internal, external]

providerProvider (string)required

Provider identifier returned by the provider-list operation.

label object

anyOf

• string
• null

string

hint_i18n_key object

anyOf

• string
• null

string

model object

anyOf

• string
• null

string

context_window object

Maximum model context size in tokens.

anyOf

• integer
• null

integer

Possible values: >= 1

deployment object

anyOf

• LLMModelDeployment
• null

imageImage (string)required

Fully qualified container image reference for the model server.

command object

Optional container entrypoint override.

anyOf

• string[]
• null

Array [

string

]

options object

Runtime options converted to command-line flags when the model starts.

property name* object

anyOf

• string
• integer
• number
• boolean
• null

string

args object

Additional command-line arguments appended after rendered runtime options.

anyOf

• string[]
• null

Array [

string

]

portPort (integer)

Default value: 8080

cpu object

Requested CPU amount, such as 500m.

anyOf

• string
• null

string

memory object

Requested memory amount, such as 2Gi.

anyOf

• string
• null

string

gpu object

GPU count request

anyOf

• integer
• null

integer

replicasReplicas (integer)

Default value: 1

health_pathHealth Path (string)

Default value: /healthz

env object

Non-secret environment variables passed to the model container.

property name*string

node_selector object

property name*string

base_url object

anyOf

• string
• null

string

api_key object

anyOf

• string
• null

string

temperature object

anyOf

• number
• null

number

Possible values: >= 0 and <= 2

max_tokens object

anyOf

• integer
• null

integer

Possible values: >= 1

max_retries object

anyOf

• integer
• null

integer

Possible values: >= 0

request_timeout object

anyOf

• number
• null

number

Possible values: > 0

streaming object

anyOf

• boolean
• null

boolean

model_kwargs object

anyOf

• object
• null

object

reasoning object

anyOf

• LLMReasoningCapability
• null

supportedSupported (boolean)

Default value: false

levelsstring[]

Possible values: [low, medium, high, xhigh]

default object

anyOf

• string
• null

string

Possible values: [low, medium, high, xhigh]

collection_id object

Identifier of the containing collection.

anyOf

• string
• null

string

Possible values: non-empty

folder_id object

anyOf

• string
• null

string

tags object

anyOf

• string[]
• null

Array [

string

]

description object

anyOf

• string
• null

string

LLMModelCreate

{
  "name": "string",
  "alias": "string",
  "type": "internal",
  "provider": "string",
  "label": "string",
  "hint_i18n_key": "string",
  "model": "string",
  "context_window": 0,
  "deployment": {
    "image": "string",
    "command": [
      "string"
    ],
    "options": {},
    "args": [
      "string"
    ],
    "port": 8080,
    "cpu": "string",
    "memory": "string",
    "gpu": 0,
    "replicas": 1,
    "health_path": "/healthz",
    "env": {},
    "node_selector": {}
  },
  "base_url": "string",
  "api_key": "string",
  "temperature": 0,
  "max_tokens": 0,
  "max_retries": 0,
  "request_timeout": 0,
  "streaming": true,
  "model_kwargs": {},
  "reasoning": {
    "supported": false,
    "levels": [
      "low"
    ],
    "default": "low"
  },
  "collection_id": "string",
  "folder_id": "string",
  "tags": [
    "string"
  ],
  "description": "string"
}