990 B
990 B
Interface MlTrainedModelAssignmentTaskParameters
| Name | Type | Description |
|---|---|---|
cache_size |
ByteSize | The size of the trained model cache. |
deployment_id |
Id | The unique identifier for the trained model deployment. |
model_bytes |
ByteSize | The size of the trained model in bytes. |
model_id |
Id | The unique identifier for the trained model. |
number_of_allocations |
integer | The total number of allocations this model is assigned across ML nodes. |
per_allocation_memory_bytes |
ByteSize | |
per_deployment_memory_bytes |
ByteSize | |
priority |
MlTrainingPriority | |
queue_capacity |
integer | Number of inference requests are allowed in the queue at a time. |
threads_per_allocation |
integer | Number of threads per allocation. |