*`i:ddlmZddlmZmZddlmZddlmZddl m Z ddl m Z m Z mZmZddlmZmZddlmZmZmZGd d eeZGd d eZGd de eeZGddeeeefZdS))Enum)AnyGeneric)Field) MistralBase)BaseCompletionRequest)_check_openai_fields_names_is_openai_field_nameconvert_openai_messagesconvert_openai_tools) ChatMessageChatMessageType)Tool ToolChoiceToolTypeceZdZdZdZdZdS)ResponseFormatszEnum of the different formats of an instruct response. Attributes: text: The response is a plain text. json: The response is a JSON object. Examples: >>> response_format = ResponseFormats.text text json_objectN)__name__ __module__ __qualname____doc__rjson|/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/mistral_common/protocol/instruct/request.pyrrs$ D DDDrrc,eZdZUdZejZeed<dS)ResponseFormatzThe format of the response. Attributes: type: The type of the response. Examples: >>> response_format = ResponseFormat(type=ResponseFormats.text) typeN)rrrrrrr __annotations__rrrrr$s1,0D/00000rrceZdZUdZdZedzed<eeed<e e Z e ed<dZ ee dzed<ejZeed<d Zeed <d Zeed <d ed eeeeeefffdZe ddeeeeeeeeeeefzfzfdeeeefdzd ed ed df dZdS)ChatCompletionRequestaRequest for a chat completion. Attributes: model: The model to use for the chat completion. messages: The messages to use for the chat completion. response_format: The format of the response. tools: The tools to use for the chat completion. tool_choice: The tool choice to use for the chat completion. truncate_for_context_length: Whether to truncate the messages for the context length. continue_final_message: Whether to continue the final message. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage, AssistantMessage >>> from mistral_common.protocol.instruct.tool_calls import ToolTypes, Function >>> request = ChatCompletionRequest( ... messages=[ ... UserMessage(content="Hello!"), ... AssistantMessage(content="Hi! How can I help you?"), ... ], ... response_format=ResponseFormat(type=ResponseFormats.text), ... tools=[Tool(type=ToolTypes.function, function=Function(name="get_weather", parameters={}))], ... tool_choice=ToolChoice.auto, ... truncate_for_context_length=True, ... ) Nmodelmessages)default_factoryresponse_formattools tool_choiceFtruncate_for_context_lengthcontinue_final_messagekwargsreturnc *|hdd}|dd}|||d<|jrtd|D][}||vrt d||t jvrt d |d t|st d |d \g}|jD])}| | *||d <|j d|j D|d<| ||S)a Convert the request messages and tools into the OpenAI format. Args: kwargs: Additional parameters to be added to the request. Returns: The request in the OpenAI format. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage >>> from mistral_common.protocol.instruct.tool_calls import Tool, Function >>> request = ChatCompletionRequest(messages=[UserMessage(content="Hello, how are you?")], temperature=0.15) >>> request.to_openai(stream=True) {'temperature': 0.15, 'top_p': 1.0, 'response_format': {'type': 'text'}, 'tool_choice': 'auto', 'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'stream': True} >>> request = ChatCompletionRequest(messages=[UserMessage(content="Hello, how are you?")], tools=[ ... Tool(function=Function( ... name="get_current_weather", ... description="Get the current weather in a given location", ... parameters={ ... "type": "object", ... "properties": { ... "location": { ... "type": "string", ... "description": "The city and state, e.g. San Francisco, CA", ... }, ... "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}, ... }, ... "required": ["location"], ... }, ... ), ... )]) >>> request.to_openai() {'temperature': 0.7, 'top_p': 1.0, 'response_format': {'type': 'text'}, 'tool_choice': 'auto', 'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'tools': [{'type': 'function', 'function': {'name': 'get_current_weather', 'description': 'Get the current weather in a given location', 'parameters': {'type': 'object', 'properties': {'location': {'type': 'string', 'description': 'The city and state, e.g. San Francisco, CA'}, 'unit': {'type': 'string', 'enum': ['celsius', 'fahrenheit']}}, 'required': ['location']}}}]} >r(r%r*Texclude exclude_none random_seedNseedzETruncating for context length is not implemented for OpenAI requests.Duplicate keyword argument: Keyword argument  is already set in the request.Invalid keyword argument: $, it should be an OpenAI field name.r%c6g|]}|Sr to_openai.0tools r z3ChatCompletionRequest.to_openai..s"&O&O&ODt~~'7'7&O&O&Orr() model_dumppopr*NotImplementedError ValueErrorr# model_fieldsr r%appendr;r(update)selfr,openai_requestr3kwargopenai_messagesmessages rr;zChatCompletionRequest.to_openaiTs{J*.HHHW[*9* *  !!-66  %)N6 "  + o%&mnn n k kE&& !G!G!GHHH/<<< ![U![![![\\\*511 k !ie!i!i!ijjj k} 8 8G  " "7#4#4#6#6 7 7 7 7%4z" : !&O&ODJ&O&O&ON7 #f%%%rc d|vrd|vrtd|ddp|dd}tt|jt|t |}|t|nd}|d||||d|S)aCreate a chat completion request from the OpenAI format. Args: messages: The messages in the OpenAI format. tools: The tools in the OpenAI format. continue_final_message: Whether to continue the final message. **kwargs: Additional keyword arguments to pass to the constructor. These should be the same as the fields of the request class or the OpenAI API equivalent. Returns: The chat completion request. r3r2z-Cannot specify both `seed` and `random_seed`.N)r%r(r2r+r)rCrAr setrDkeysr r )clsr%r(r+r,r2converted_messagesconverted_toolss r from_openaiz!ChatCompletionRequest.from_openais* V    7 7LMM Mjj..Q&**]D2Q2Q "3s'7'<'<'>'>#?#?V[[]]ASASTTT0G0Q0Q9>9J.u555PTs '!##9       rNF)rrrrr$strr!listrrrr'r(rrautor)r*boolr+rdictr; classmethodrRrrrr#r#1s4E3:?####&+eN&K&K&KO^KKK#E4: ###(oK---(----#(D(((G#G$sDc3h4H/H*IGGGGR.2', % % tCtDcDcN6J1J,K'L!LLMN% DcN#d*% !% %  % ! % % % [% % % rr#cdeZdZUdZeeed<dZedzed<dZ ee dzed<dZ e dzed<dZ eed<d ed eeeeeefffd Ze ddeeeeeeeeeeefzfzfd eeeefdzded ed df d ZdS)InstructRequestaA valid Instruct request to be tokenized. Attributes: messages: The history of the conversation. system_prompt: The system prompt to be used for the conversation. available_tools: The tools available to the assistant. truncate_at_max_tokens: The maximum number of tokens to truncate the conversation at. continue_final_message: Whether to continue the final message. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage, SystemMessage >>> request = InstructRequest( ... messages=[UserMessage(content="Hello, how are you?")], system_prompt="You are a helpful assistant." ... ) r%N system_promptavailable_toolstruncate_at_max_tokensFr+r,r-c 8|hdd}|D][}||vrtd||tjvrtd|dt |std|d\g}|j|d |jd |jD])}||*||d <|j d |j D|d<|j td| ||S)aConvert the request messages and tools into the OpenAI format. Args: kwargs: Additional parameters to be added to the request. Returns: The request in the OpenAI format. Examples: >>> from mistral_common.protocol.instruct.messages import UserMessage >>> from mistral_common.protocol.instruct.tool_calls import Tool, Function >>> request = InstructRequest(messages=[UserMessage(content="Hello, how are you?")]) >>> request.to_openai(temperature=0.15, stream=True) {'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'temperature': 0.15, 'stream': True} >>> request = InstructRequest( ... messages=[UserMessage(content="Hello, how are you?")], ... available_tools=[ ... Tool(function=Function( ... name="get_current_weather", ... description="Get the current weather in a given location", ... parameters={ ... "type": "object", ... "properties": { ... "location": { ... "type": "string", ... "description": "The city and state, e.g. San Francisco, CA", ... }, ... "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}, ... }, ... "required": ["location"], ... }, ... ), ... )]) >>> request.to_openai() {'continue_final_message': False, 'messages': [{'role': 'user', 'content': 'Hello, how are you?'}], 'tools': [{'type': 'function', 'function': {'name': 'get_current_weather', 'description': 'Get the current weather in a given location', 'parameters': {'type': 'object', 'properties': {'location': {'type': 'string', 'description': 'The city and state, e.g. San Francisco, CA'}, 'unit': {'type': 'string', 'enum': ['celsius', 'fahrenheit']}}, 'required': ['location']}}}]} >r%r]r^Tr/r4r5r6r7r8Nsystem)rolecontentr%c6g|]}|Srr:r<s rr?z-InstructRequest.to_openai..s"&Y&Y&YDt~~'7'7&Y&Y&Yrr(z@Truncating at max tokens is not implemented for OpenAI requests.) r@rCr[rDr r\rEr%r;r]r^rBrF)rGr,rHrIrJrKs rr;zInstructRequest.to_openais|N*.MMM\`*9* *  k kE&& !G!G!GHHH/666 ![U![![![\\\*511 k !ie!i!i!ijjj k13   )  " "HAS#T#T U U U} 8 8G  " "7#4#4#6#6 7 7 7 7%4z"   +&Y&YDDX&Y&Y&YN7 #  & 2%&hii if%%%rr(c Zd|vr'||d}ntdtt|jt|t |}|t|nd}|d|||d|S)aCreate an instruct request from the OpenAI format. Args: messages: The messages in the OpenAI format. tools: The tools in the OpenAI format. continue_final_message: Whether to continue the final message. **kwargs: Additional keyword arguments to pass to the constructor. These should be the same as the fields of the request class or the OpenAI API equivalent. Returns: The instruct request. r]Nz2Cannot specify both `tools` and `available_tools`.)r%r]r+r)rArCr rMrDrNr r )rOr%r(r+r,rPrQs rrRzInstructRequest.from_openai's,  & &} #455 !UVVV"3s'7'<'<'>'>#?#?V[[]]ASASTTT0G0Q0Q9>9J.u555PTs '+#9      rrS)rrrrrUrr!r\rTr]rr^intr+rWrrXr;rYrRrrrr[r[se ?#### $M3:$$$-1OT(^d*111)-C$J---#(D(((H#H$sDc3h4H/H*IHHHHT.2', & & tCtDcDcN6J1J,K'L!LLMN& DcN#d*& !% &  &  & & & [& & & rr[N)enumrtypingrrpydanticrmistral_common.basermistral_common.protocol.baser+mistral_common.protocol.instruct.convertersr r r r )mistral_common.protocol.instruct.messagesr r+mistral_common.protocol.instruct.tool_callsrrrrTrrr#r[rrrrns++++++>>>>>> SRRRRRRRRR     c4    1 1 1 1 1[ 1 1 1R R R R R 17?3KR R R jH H H H H k7?H+D#EH H H H H r