^jddlmZddlmZddlmZmZddlmZm Z eje Z edeGd d eZ edeGd d eZedeGd deZgdZy))strict)PreTrainedConfig)auto_docstringlogging)CONFIG_MAPPING AutoConfigzdeepseek-community/Janus-Pro-1B) checkpointcfeZdZUdZdZdZdZeed<dZ eed<dZ eed <d Z eed <d Z ee ezeeefzed <dZee ezeeefzed<dZeed<dZeed<dZeezed<dZeezed<dZeed<dZeezed<dZeed<dZeezed<dZeed<dZeed <d!Zeed"<d#Zeed$<y%)&JanusVisionConfigz projection_dropout (`float`, *optional*, defaults to 0.0): Dropout probability for the projection layer. num_image_tokens (`int`, *optional*, defaults to 576): Number of image tokens. janus_vision_model vision_configi hidden_sizenum_hidden_layersnum_attention_headsr num_channelsi image_size patch_sizegelu hidden_actgư>layer_norm_epsattention_dropoutg@ mlp_ratioTattention_biashidden_dropout_rateprojection_dimprojection_dropoutF use_qk_norm{Gz?initializer_rangerdepthi@num_image_tokensN)__name__ __module__ __qualname____doc__ model_typebase_config_keyrint__annotations__rrrrlisttuplerrstrrfloatrrrboolrr!r"r#r%r&r'x/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/janus/configuration_janus.pyr r s&J%OKs!!L#47Jd3i%S/1746Jd3i%S/16J NE %(us{( Ius{ ND'**NC&) )K#u#E3Ncr6r ceZdZUdZdZdZdZeed<dZ eed<dZ e ed <d Z eed <d Z eed <dZeed<dZeeeedfzed<dZeed<dZeezed<dZeed<dZeed<d Zeed<dZeed<dZeed<dZeed <dZeed!<y")#JanusVQVAEConfiga base_channels (`int`, *optional*, defaults to 128): Base channel count. channel_multiplier (`list[int]`, *optional*, defaults to `[1, 1, 2, 2, 4]`): Channel multipliers for each resolution. num_res_blocks (`int`, *optional*, defaults to 2): Number of residual blocks. num_patches (`int`, *optional*, defaults to 32): Num of patches the input images can be divided into. out_channels (`int`, *optional*, defaults to 3): Number of out channels. image_token_embed_dim (`int`, *optional*, defaults to 2048): Dimension of image embeddings. It should be same as the dimensionality of text embeddings. janus_vqgan vq_config embed_dimi@num_embeddingsF double_latentlatent_channelsr in_channels base_channels)rErr.channel_multiplierrnum_res_blocksrdropoutr$r% num_patches out_channelsr r!rrrimage_token_embed_dimN)r(r)r*r+r,r-r=r.r/r>r?r4rArBrDrGr0r1rHrIr3r%rKrLr!rrr2rMr5r6r7r9r9@s J!OIsNCM4OSKM36ES E#s(O3ENCGUS[#u#KL#NCsJ!%3%r6r9ceZdZUdZdZeeedZdZ e e zdze d<dZ e e zdze d<dZe e zdze d<dZee d <d Zee d <fd ZxZS) JanusConfiga Example: ```python >>> from transformers import JanusForConditionalGeneration, JanusConfig, JanusVisionConfig, JanusVQVAEConfig, LlamaConfig >>> # Initializing a Janus vision config >>> vision_config = JanusVisionConfig() >>> # Initializing a Llama config >>> text_config = LlamaConfig() >>> # Initializing a VQ config >>> vq_config = JanusVQVAEConfig() >>> # Initializing a Janus Pro 1B style configuration >>> configuration = JanusConfig(vision_config=vision_config, text_config=text_config, vq_config=vq_config) >>> # Initializing a model from the Janus Pro 1B style configuration >>> model = JanusForConditionalGeneration(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```janus) text_configrr;NrQrr;iimage_token_idTtie_word_embeddingsc rt|jtrT|jjdd|jd<t |jddi|j|_n3|j't j dt d|_|j%t j dt|_n4t|jtrtdi|j|_|j%t j dt|_ n4t|jtrtdi|j|_ |jj|jjz|j_ t|<di|y)Nr,llamaz7`text_config` is None. Initializing with default valueszK`vision_config` is None. Initializing with default JanusVisionConfig valueszF`vq_config` is None. Initializing with default JanusVQVAEConfig valuesr5) isinstancerQdictgetr loggerinforr r;r9rrrKsuper __post_init__)selfkwargs __class__s r7r\zJanusConfig.__post_init__sN d&& --1-=-=-A-A,PW-XD  \ *-d.>.>|.LMaPTP`P`aD     % KKQ R-g68D     % KKe f!2!4D  **D 1!2!HT5G5G!HD  >> ! KK` a-/DN  --??DN&*%7%7%B%BdFXFXFcFc%c" ''r6)r(r)r*r+r,r r r9 sub_configsrQrWrr/rr;rRr.rSr4r\ __classcell__)r_s@r7rOrOgs 2J!*%K 37K((4/648M4**T1804It&&-4 NC $$((r6rO)r9r rON)huggingface_hub.dataclassesrconfiguration_utilsrutilsrrautor r get_loggerr(rYr r9rO__all__r5r6r7rhs*/3,-   H %<= ( > ><="&'"&>"&J<==("=(>=(@ Cr6