ModelToleration

Scheduling tolerance for an internally hosted model, allowing placement on a compute resource with a matching taint.

key object

Taint key matched by this toleration, or null to match every key when operator is Exists.

anyOf

• string
• null

string

operatorOperator (string)

'Equal' requires value; 'Exists' ignores it.

Possible values: [Exists, Equal]

Default value: Equal

value object

anyOf

• string
• null

string

effect object

Taint effect matched by this toleration, or null to match every effect.

anyOf

• string
• null

string

Possible values: [NoSchedule, PreferNoSchedule, NoExecute]

toleration_seconds object

For effect='NoExecute', evict after this many seconds.

anyOf

• integer
• null

integer

ModelToleration

{
  "key": "string",
  "operator": "Equal",
  "value": "string",
  "effect": "NoSchedule",
  "toleration_seconds": 0
}