`i^ddlmZddlmZGddeZGddeZddgZdS) )PretrainedConfig) Qwen2ConfigcxeZdZdZdZ ddededededededededededeffd ZxZ S) Ovis2VisionConfiga This is the configuration class to store the configuration of a [`Ovis2VisionModel`]. It is used to instantiate a Ovis2VisionModel model according to the specified arguments, defining the model architecture. Instantiating a configuration with the defaults will yield a similar configuration to that of Ovis2. Args: hidden_size (`int`, *optional*, defaults to 1024): Dimensionality of the encoder layers and the pooler layer. intermediate_size (`int`, *optional*, defaults to 2816): Dimensionality of the "intermediate" (i.e., feed-forward) layer in the Transformer encoder. num_hidden_layers (`int`, *optional*, defaults to 24): Number of hidden layers in the Transformer encoder. num_attention_heads (`int`, *optional*, defaults to 8): Number of attention heads for each attention layer in the Transformer encoder. num_channels (`int`, *optional*, defaults to 3): Number of channels in the input images. image_size (`int`, *optional*, defaults to 224): The size (resolution) of each image. patch_size (`int`, *optional*, defaults to 14): The size (resolution) of each patch. rms_norm_eps (`float`, *optional*, defaults to 1e-05): The epsilon used by the RMSNorm layers. attention_dropout (`float`, *optional*, defaults to 0.0): The dropout ratio for the attention probabilities. qkv_bias (`bool`, *optional*, defaults to `False`): Whether to add a learnable bias to the query, key, and value sequences at each attention head. mlp_bias (`bool`, *optional*, defaults to `False`): Whether to add a learnable bias to the MLP layers. hidden_act (`str` or `function`, *optional*, defaults to `"silu"`): The non-linear activation function (function or string) in the encoder and pooler. If string, `"gelu"`, `"relu"`, `"selu"` and `"gelu_new"` `"quick_gelu"` are supported. vocab_size (`int`, *optional*, defaults to 16384): Vocabulary size of the Vision Transformer. hidden_stride (`int`, *optional*, defaults to 1): The stride of the hidden layer in the Vision Transformer. num_visual_indicator_tokens (`int`, *optional*, defaults to 5): Number of visual indicator tokens. initializer_range (`float`, *optional*, defaults to 0.02): The standard deviation of the truncated normal initializer for initializing all weight matrices. tokenize_function (`str`, *optional*, defaults to `"softmax"`): The function used to tokenize the visual indicator tokens. vision_config rh㈵>Fsilu@{Gz?softmax hidden_sizeintermediate_sizenum_hidden_layersnum_attention_heads num_channels image_size patch_size rms_norm_epsattention_dropoutqkv_biasmlp_biasc (tjdi|||_||_||_||_||_||_||_| |_ | |_ | |_ | |_ ||_ | |_||_||_||_||_dS)N)super__init__rrrrrrrr hidden_actr r!r vocab_size hidden_stridenum_visual_indicator_tokenstokenize_functioninitializer_range)selfrrrrrrrrrr r!r&r'r(r)r+r*kwargs __class__s /home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/transformers/models/ovis2/configuration_ovis2.pyr%zOvis2VisionConfig.__init__Bs* ""6"""&!2!2#6 ($$!2$    ($*+F(!2!2)r r r r rr rrrFFrrrrrr) __name__ __module__ __qualname____doc__base_config_keyintfloatboolr% __classcell__r.s@r/rrs))V&O !%!##$"#&$%#%(3(3(3(3 (3 ! (3  (3(3(3(3!(3(3(3(3(3(3(3(3(3(3(3(3r0rcBeZdZdZdZeedZdddgdddffd ZxZ S) Ovis2ConfigaQ This is the configuration class to store the configuration of a [`Ovis2ForConditionalGeneration`]. It is used to instantiate a Ovis2 model according to the specified arguments, defining the model architecture. Instantiating a configuration with the defaults will yield a similar configuration to that of Ovis2. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. e.g. [thisisiron/Ovis2-1B-hf](https://huggingface.co/thisisiron/Ovis2-1B-hf) Args: vision_config (`Union[AutoConfig, dict]`, *optional*, defaults to `Ovis2VisionConfig`): The config object or dictionary of the vision backbone. text_config (`Union[AutoConfig, dict]`, *optional*, defaults to `Qwen2Config`): The config object or dictionary of the text backbone. image_token_id (`int`, *optional*, defaults to 151665): The image token id to encode the image prompt. visual_indicator_token_ids (`List[int]`, *optional*, defaults to `[151666, 151667, 151668, 151669, 151670]`): The visual indicator token ids to encode the image prompt. vocab_size (`int`, *optional*, defaults to 151643): Vocabulary size of the text model. hidden_size (`int`, *optional*, defaults to 1536): Dimensionality of the encoder layers and the pooler layer. ```python >>> from transformers import Ovis2ForConditionalGeneration, Ovis2Config >>> # Initializing a Ovis2 style configuration >>> configuration = Ovis2Config() >>> # Initializing a model from the Ovis2-2B style configuration >>> model = Ovis2ForConditionalGeneration(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` ovis2) text_configrNiqP)irPisPitPiuPivPi[Pic t|trtdi||_nt|tr||_|"tt ||_t|trt di||_n2t|t r||_n|t |_||_||_||_ ||_ tj di|dS)N)r)r#) isinstancedictrrlenrr>r'rimage_token_idvisual_indicator_token_idsr$r%) r,rr>rCrDr'rr-r.s r/r%zOvis2Config.__init__s  mT * * /!2!C!C]!C!CD    '8 9 9 /!.D   !2sSmOnOn!o!o!oD  k4 ( ( -*99[99D    [ 1 1 -*D    *}}D $&,*D'""6"""""r0) r1r2r3r4 model_typerr sub_configsr%r9r:s@r/r<r<msw$$LJ"-@QRRK#K#K#K##########r0r<N)configuration_utilsrqwen2.configuration_qwen2rrr<__all__r#r0r/rJs 433333333333V3V3V3V3V3(V3V3V3rF#F#F#F#F#"F#F#F#R  .r0