1.4 KiB
1.4 KiB
Interface InferenceInferenceRequest
| Name | Type | Description |
|---|---|---|
body |
string | ({ [key: string]: any; } & { task_type?: never; inference_id?: never; timeout?: never; query?: never; input?: never; task_settings?: never; }) |
inference_id |
Id | The unique identifier for the inference endpoint. |
input |
string | string[] |
query |
string | The query input, which is required only for the rerank task. It is not required for other tasks. |
querystring |
{ [key: string]: any; } & { task_type?: never; inference_id?: never; timeout?: never; query?: never; input?: never; task_settings?: never; } | All values in querystring will be added to the request querystring. |
task_settings |
InferenceTaskSettings | Task settings for the individual inference request. These settings are specific to the task type you specified and override the task settings specified when initializing the service. |
task_type |
InferenceTaskType | The type of inference task that the model performs. |
timeout |
Duration | The amount of time to wait for the inference request to complete. |