^jdZddlmZddlmZddlmZmZddlm Z m Z eje Z ed eGd d eZed eGd d eZed eGddeZgdZy)zIdefics2 model configuration)strict)PreTrainedConfig)auto_docstringlogging)CONFIG_MAPPING AutoConfigzHuggingFaceM4/idefics2-8b) checkpointceZdZUdZdZdZdZeed<dZ eed<dZ eed <dZ eed <d Z eed <d Z eeezeeefzed<dZeeezeeefzed<dZeed<dZeed<dZeezed<dZeed<y)Idefics2VisionConfiga Example: ```python >>> from transformers.models.idefics2.modeling_idefics2 import Idefics2VisionTransformer >>> from transformers.models.idefics2.configuration_idefics2 import Idefics2VisionConfig >>> # Initializing a Idefics2VisionConfig with google/siglip-base-patch16-224 style configuration >>> configuration = Idefics2VisionConfig() >>> # Initializing a Idefics2VisionTransformer (with random weights) from the google/siglip-base-patch16-224 style configuration >>> model = Idefics2VisionTransformer(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```idefics2_vision vision_configi hidden_sizei intermediate_size num_hidden_layersnum_attention_headsr num_channels image_size patch_sizegelu_pytorch_tanh hidden_actư>layer_norm_epsattention_dropout{Gz?initializer_rangeN)__name__ __module__ __qualname____doc__ model_typebase_config_keyrint__annotations__rrrrrlisttuplerrstrrfloatrr!~/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/idefics2/configuration_idefics2.pyr r s "#J%OK!s!s!!L#47Jd3i%S/1746Jd3i%S/16)J) NE %(us{(#u#r/r ceZdZUdZdZdZeed<dZe ed<dZ e ed<d Z e ed <d Z e ed <d Ze ed<dZe ed<dZe ed<dZe e zed<dZe ed<dZy)Idefics2PerceiverConfigaX resampler_n_latents (`int`, *optional*, defaults to 64): Number of latent embeddings to resample ("compress") the input sequence to (usually < 128). resampler_depth (`int`, *optional*, defaults to 3): Depth of the Perceiver Resampler (Transformer w/ cross attention). Should be shallow (<= 3). resampler_n_heads (`int`, *optional*, defaults to 16): Number of heads in each Transformer block (for multi-headed self-attention). resampler_head_dim (`int`, *optional*, defaults to 96): Dimensionality of each head projection in the Transformer block. idefics2_perceiversilurirr rms_norm_eps@resampler_n_latentsrresampler_depthresampler_n_heads`resampler_head_dimnum_key_value_headsrrr r!c|j|jkDr%td|jd|jy)zOPart of `@strict`-powered validation. Validates the architecture of the config.znum_key_value_heads=z1 must be less than or equal to resampler_n_heads=N)r>r: ValueError)selfs r0validate_architecturez-Idefics2PerceiverConfig.validate_architectureXsM  # #d&<&< <&t'?'?&@A&&*&<&<%=?  =r/N)r"r#r$r%r&rr,r)rr(r5r-r7r8r:r<r>rr!rBr.r/r0r2r2=s &JJKL%!!OSs    %(us{(#u#r/r2ceZdZUdZdZeeedZdZ e e d<dZ e e d<dZe e d <d Zeezd ze d <d Zeezd ze d <d Zeezd ze d <fdZxZS)Idefics2Configa perceiver_config (`IdeficsPerceiverConfig` or `dict`, *optional*): Custom perceiver config or dict Example: ```python >>> from transformers import Idefics2Model, Idefics2Config >>> # Initializing configuration >>> configuration = Idefics2Config() >>> # Initializing a model from the configuration >>> model = Idefics2Model(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```idefics2) text_configperceiver_configrT use_cachei}image_token_idFtie_word_embeddingsNrrGrFc |j%t|_tjdn4t |jt rtd i|j|_|j %t|_tjdn4t |j t rtd i|j |_t |jt rT|jjdd|jd<t|jdd i|j|_n7|j+tjdtdddd |_|jj|jjk7r_|jj|j_ |jj|j_ tjd t|<d i|y) Nz7perciver_config is None, using default perceiver configz2vision_config is None, using default vision configr&mistralz.text_config is None, using default text configigh㈵>r)max_position_embeddingsr5 pad_token_idzPerceiver config has a different `hidden_size` than text config, which means default values were used. In your model's config on the hub, add `hidden_size` and `rms_norm_eps` keys under the `perceiver_config` dict. r.)rGr2loggerinfo isinstancedictrr rFgetr rr5 warning_oncesuper __post_init__)rAkwargs __class__s r0rVzIdefics2Config.__post_init__s  ($;$=D ! KKQ R --t 4$;$Td>S>S$TD !    %!5!7D  KKL M **D 1!5!K8J8J!KD  d&& --1-=-=-A-A,PY-ZD  \ *-d.>.>|.LMaPTP`P`aD     % KKH I-i8(0!  D     ' '4+@+@+L+L L040@0@0L0LD ! ! -151A1A1N1ND ! ! .   C  ''r/)r"r#r$r%r&r r2r sub_configsrHboolr)rIr(rJrrRrrGrFrV __classcell__)rXs@r0rDrDas  J!3-K It NC %%48M4**T187;d--4;26K((4/6!(!(r/rD)rDr2r N)r%huggingface_hub.dataclassesrconfiguration_utilsrutilsrrautor r get_loggerr"rOr r2rD__all__r.r/r0rbs#.3,-   H %67$+$8$D67.8D67?(%?(8?(D Pr/