habsi/elasticsearch-js
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
b140fcda7f1d0e35dcf6fe3658ffe536a133c979
elasticsearch-js/docs/reference/api/InferenceAzureAiStudioTaskSettings.md
Josh Mock b140fcda7f Another round of tweaks
2025-05-28 10:02:30 -05:00

1.1 KiB
Raw Blame History

InferenceAzureAiStudioTaskSettings [interface-InferenceAzureAiStudioTaskSettings]

Name Type Description
do_sample float For a completion task, instruct the inference process to perform sampling. It has no effect unless temperature or top_p is specified.
max_new_tokens integer For a completion task, provide a hint for the maximum number of output tokens to be generated.
temperature float For a completion task, control the apparent creativity of generated completions with a sampling temperature. It must be a number in the range of 0.0 to 2.0. It should not be used if top_p is specified.
top_p float For a completion task, make the model consider the results of the tokens with nucleus sampling probability. It is an alternative value to temperature and must be a number in the range of 0.0 to 2.0. It should not be used if temperature is specified.
user string For a text_embedding task, specify the user issuing the request. This information can be used for abuse detection.