^j[ddlmZddlmZddlmZddlmZedeGd d eZedeGd d eZ d d gZ y ))strict)PreTrainedConfig)auto_docstring) Qwen2Configzthisisiron/Ovis2-1B-hf) checkpointcBeZdZUdZdZdZeed<dZeed<dZ eed<d Z eed <d Z eed <d Z ee ezeeefzed<dZee ezeeefzed<dZeed<dZeezed<dZeed<dZeed<dZeed<dZeed<dZeed<dZeed<d Zeed!<d"Zeed#<y$)%Ovis2VisionConfigas hidden_stride (`int`, *optional*, defaults to 1): The stride of the hidden layer in the Vision Transformer. num_visual_indicator_tokens (`int`, *optional*, defaults to 5): Number of visual indicator tokens. tokenize_function (`str`, *optional*, defaults to `"softmax"`): The function used to tokenize the visual indicator tokens. vision_configi hidden_sizei intermediate_sizenum_hidden_layersnum_attention_headsr num_channels image_size patch_sizegh㈵> rms_norm_epsgattention_dropoutFqkv_biasmlp_biassilu hidden_acti@ vocab_size hidden_stridenum_visual_indicator_tokensg{Gz?initializer_rangesoftmaxtokenize_functionN)__name__ __module__ __qualname____doc__base_config_keyr int__annotations__rrrrrlisttuplerrfloatrrboolrrstrrr r"r#r%x/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/ovis2/configuration_ovis2.pyr r s&OK!s!s  L#47Jd3i%S/1746Jd3i%S/16L%%(us{(HdHdJJM3'((#u#&s&r3r ceZdZUdZdZeedZdZe e zdze d<dZ e e zdze d<dZ ee d<d Zeeeed fze d <d Zee d <dZee d<dZee d<fdZxZS) Ovis2ConfigaL visual_indicator_token_ids (`List[int]`, *optional*, defaults to `[151666, 151667, 151668, 151669, 151670]`): The visual indicator token ids to encode the image prompt. ```python >>> from transformers import Ovis2ForConditionalGeneration, Ovis2Config >>> # Initializing a Ovis2 style configuration >>> configuration = Ovis2Config() >>> # Initializing a model from the Ovis2-2B style configuration >>> model = Ovis2ForConditionalGeneration(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` ovis2) text_configr Nr r8iqPimage_token_id)irPisPitPiuPivP.visual_indicator_token_idsi[Prir Ttie_word_embeddingsc t|jtrtdi|j|_|j$tt |j |_t|j trtdi|j |_n|j t|_t|$di|y)N)r"r2) isinstancer dictr lenr:r8rsuper __post_init__)selfkwargs __class__s r4rAzOvis2Config.__post_init__Xs d(($ /!2!HT5G5G!HD     %!2sSWSrSrOs!tD  d&& -*>T-=-=>D     %*}D  ''r3)r&r'r(r) model_typerr sub_configsr r>rr,r8r9r+r:r-r.rr r;r0rA __classcell__)rDs@r4r6r68s$J"-@QRK48M4**T1826K((4/6 NC >fS E#s(O ;fJK $$ ( (r3r6N) huggingface_hub.dataclassesrconfiguration_utilsrutilsrqwen2.configuration_qwen2rr r6__all__r2r3r4rMst /3#334'('5'>34)(")(5)(X  .r3