^j jdZddlmZddlmZddlmZedeGdd eZd gZy ) zCANINE model configuration)strict)PreTrainedConfig)auto_docstringzgoogle/canine-s) checkpointcJeZdZUdZdZdZeed<dZeed<dZ eed<dZ eed <d Z e ed <d Z eezed <d Zeezed<dZeed<dZeed<dZeed<dZeed<dZedzed<dZedzed<dZeeezdzed<dZeed<dZeed <d!Zeed"<dZeed#<d$Zeed%<y)& CanineConfiga. downsampling_rate (`int`, *optional*, defaults to 4): The rate at which to downsample the original character sequence length before applying the deep Transformer encoder. upsampling_kernel_size (`int`, *optional*, defaults to 4): The kernel size (i.e. the number of characters in each window) of the convolutional projection layer when projecting back from `hidden_size`*2 to `hidden_size`. num_hash_functions (`int`, *optional*, defaults to 8): The number of hash functions to use. Each hash function has its own embedding matrix. num_hash_buckets (`int`, *optional*, defaults to 16384): The number of hash buckets to use. local_transformer_stride (`int`, *optional*, defaults to 128): The stride of the local attention of the first shallow Transformer encoder. Defaults to 128 for good TPU/XLA memory alignment. Example: ```python >>> from transformers import CanineConfig, CanineModel >>> # Initializing a CANINE google/canine-s style configuration >>> configuration = CanineConfig() >>> # Initializing a model (with random weights) from the google/canine-s style configuration >>> model = CanineModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```caninei hidden_size num_hidden_layersnum_attention_headsi intermediate_sizegelu hidden_actg?hidden_dropout_probattention_probs_dropout_probi@max_position_embeddingstype_vocab_sizeg{Gz?initializer_rangeg-q=layer_norm_epsrN pad_token_idi bos_token_idi eos_token_iddownsampling_rateupsampling_kernel_sizenum_hash_functionsnum_hash_bucketslocal_transformer_stride)__name__ __module__ __qualname____doc__ model_typer int__annotations__r rrrstrrfloatrrrrrrrrlistrrr r!r#z/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/canine/configuration_canine.pyr r s <JKs!!!s!J'**03 %#+3#(S(OS#u#!NE! L#* %L#*%+1L#S /D(1s"#C#!c!$'c'r/r N) r'huggingface_hub.dataclassesrconfiguration_utilsrutilsrr __all__r.r/r0r5sH!.3#,-3(#3(.3(l  r/