You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| spring.ai.oci.genai.cohere.chat.options.temperature | Inference temperature | -
94
+
| spring.ai.oci.genai.cohere.chat.options.topP | Top P parameter | -
95
+
| spring.ai.oci.genai.cohere.chat.options.topK | Top K parameter | -
96
+
| spring.ai.oci.genai.cohere.chat.options.frequencyPenalty | Higher values will reduce repeated tokens and outputs will be more random. | -
97
+
| spring.ai.oci.genai.cohere.chat.options.presencePenalty | Higher values encourage generating outputs with tokens that haven't been used. | -
98
+
| spring.ai.oci.genai.cohere.chat.options.stop | List of textual sequences that will end completions generation. | -
99
+
| spring.ai.oci.genai.cohere.chat.options.documents | List of documents used in chat context. | -
100
100
|====
101
101
102
-
TIP: All properties prefixed with `spring.ai.oci.genai.chat.cohere.options` can be overridden at runtime by adding a request specific <<chat-options>> to the `Prompt` call.
102
+
TIP: All properties prefixed with `spring.ai.oci.genai.cohere.chat.options` can be overridden at runtime by adding a request specific <<chat-options>> to the `Prompt` call.
103
103
104
104
== Runtime Options [[chat-options]]
105
105
106
106
The link:https://github.com/spring-projects/spring-ai/blob/main/models/spring-ai-oci-genai/src/main/java/org/springframework/ai/oci/cohere/OCICohereChatOptions.java[OCICohereChatOptions.java] provides model configurations, such as the model to use, the temperature, the frequency penalty, etc.
107
107
108
-
On start-up, the default options can be configured with the `OCICohereChatModel(api, options)` constructor or the `spring.ai.oci.genai.chat.cohere.options.*` properties.
108
+
On start-up, the default options can be configured with the `OCICohereChatModel(api, options)` constructor or the `spring.ai.oci.genai.cohere.chat.options.*` properties.
109
109
110
110
At run-time you can override the default options by adding new, request specific, options to the `Prompt` call.
111
111
For example to override the default model and temperature for a specific request:
0 commit comments