^jdZddlmZddlmZddlmZmZddlm Z m Z eje Z ed eGd d eZed eGd d eZd d gZy)zIdefics3 model configuration)strict)PreTrainedConfig)auto_docstringlogging)CONFIG_MAPPING AutoConfigz HuggingFaceM4/Idefics3-8B-Llama3) checkpointceZdZUdZdZdZdZeed<dZ eed<dZ eed <d Z eed <d Z eed <dZ eeezeeefzed<dZeeezeeefzed<dZeed<dZeed<dZeezed<dZeed<y)Idefics3VisionConfiga Example: ```python >>> from transformers.models.idefics3.modeling_idefics3 import Idefics3VisionTransformer >>> from transformers.models.idefics3.configuration_idefics3 import Idefics3VisionConfig >>> # Initializing a Idefics3VisionConfig with google/siglip-base-patch16-224 style configuration >>> configuration = Idefics3VisionConfig() >>> # Initializing a Idefics3VisionTransformer (with random weights) from the google/siglip-base-patch16-224 style configuration >>> model = Idefics3VisionTransformer(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```idefics3_vision vision_configi hidden_sizei intermediate_size num_hidden_layersnum_attention_headsr num_channels image_size patch_sizegelu_pytorch_tanh hidden_actgư>layer_norm_epsgattention_dropoutg{Gz?initializer_rangeN)__name__ __module__ __qualname____doc__ model_typebase_config_keyrint__annotations__rrrrrlisttuplerrstrrfloatrr~/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/idefics3/configuration_idefics3.pyr r s "#J%OK!s!s!!L#47Jd3i%S/1746Jd3i%S/16)J) NE %(us{(#u#r-r ceZdZUdZdZeedZdZe e d<dZ e e d<dZ e e d <d Zeezd ze d <d Zeezd ze d <d Ze e d<dZe d ze d<fdZxZS)Idefics3Configa scale_factor (`int`, *optional*, defaults to 2): The scale factor for the image encoder. Example: ```python >>> from transformers import Idefics3Model, Idefics3Config >>> # Initializing configuration >>> configuration = Idefics3Config() >>> # Initializing a model from the configuration >>> model = Idefics3Model(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```idefics3) text_configrT use_cacheiimage_token_idFtie_word_embeddingsNrr2r scale_factori pad_token_idc J|j%t|_tjdn4t |jt rtdi|j|_t |j t rT|j jdd|j d<t|j ddi|j |_n@|j 4tjdtdd|j|_t|,di|y)Nz2vision_config is None, using default vision configr$llamaz4text_config is None, using default Llama text configgh㈵>) rms_norm_epsr7r,) rr loggerinfo isinstancedictr2getr r7super __post_init__)selfkwargs __class__s r.rAzIdefics3Config.__post_init__Zs    %!5!7D  KKL M **D 1!5!K8J8J!KD  d&& --1-=-=-A-A,PW-XD  \ *-d.>.>|.LMaPTP`P`aD     % KKN O-g6!!.. D  ''r-)r r!r"r#r$r r sub_configsr3boolr'r4r&r5rr>rr2r6r7rA __classcell__)rDs@r.r0r0=s  J",?STKIt NC %%48M4**T1826K((4/6L#&L#*&((r-r0N)r#huggingface_hub.dataclassesrconfiguration_utilsrutilsrrautor r get_loggerr r;r r0__all__r,r-r.rNs#.3,-   H %=>$+$?$D=>,(%,(?,(^ 3 4r-