AnyscaleModelDto

@Serializable
data class AnyscaleModelDto(var model: String = "", var temperature: Double = -1.0, var maxTokens: Int = -1, var emotionRecognitionEnabled: Boolean? = null, var numFastTurns: Int = -1, var knowledgeBaseDto: KnowledgeBaseDto? = null, val messages: MutableList<RoleMessageDto> = mutableListOf(), val tools: MutableList<ToolDto> = mutableListOf(), val toolIds: MutableSet<String> = mutableSetOf(), val functions: MutableList<FunctionDto> = mutableListOf()) : AnyscaleModelProperties, CommonModelDto(source)

Constructors

Link copied to clipboard
constructor(model: String = "", temperature: Double = -1.0, maxTokens: Int = -1, emotionRecognitionEnabled: Boolean? = null, numFastTurns: Int = -1, knowledgeBaseDto: KnowledgeBaseDto? = null, messages: MutableList<RoleMessageDto> = mutableListOf(), tools: MutableList<ToolDto> = mutableListOf(), toolIds: MutableSet<String> = mutableSetOf(), functions: MutableList<FunctionDto> = mutableListOf())

Properties

Link copied to clipboard

This determines whether we detect user's emotion while they speak and send it as an additional info to model. Default false because the model is usually good at understanding the user's emotion from text.

Link copied to clipboard
open override val functions: MutableList<FunctionDto>
Link copied to clipboard
@SerialName(value = "knowledgeBase")
open override var knowledgeBaseDto: KnowledgeBaseDto?
Link copied to clipboard
open override var maxTokens: Int

This is the max number of tokens that the assistant will be allowed to generate in each turn of the conversation. Default is 250.

Link copied to clipboard
open override val messages: MutableList<RoleMessageDto>
Link copied to clipboard
open override var model: String

This is the name of the model.

Link copied to clipboard
open override var numFastTurns: Int

This sets how many turns at the start of the conversation to use a smaller, faster model from the same provider before switching to the primary model. Example, gpt-3.5-turbo if provider is openai. Default is 0.

Link copied to clipboard
@EncodeDefault
open override val provider: ModelType
Link copied to clipboard
open override var temperature: Double

This is the temperature that will be used for calls.

Link copied to clipboard
open override val toolIds: MutableSet<String>

These are the tools that the assistant can use during the call. To use transient tools, use tools.

Link copied to clipboard
open override val tools: MutableList<ToolDto>

Functions

Link copied to clipboard