^j jdZddlmZddlmZddlmZedeGdd eZd gZy ) zDistilBERT model configuration)strict)PreTrainedConfig)auto_docstringzgoogle/distilbert-base-uncased) checkpointcFeZdZUdZdZddddZdZeed<d Z eed <d Z e ed <d Z eed<dZ eed<dZeed<dZeed<dZeezed<dZeezed<dZeed<dZeed<dZeezed<dZeezed<dZedzed<dZeeezdzed<dZedzed <d!Ze ed"<y)#DistilBertConfiga sinusoidal_pos_embds (`boolean`, *optional*, defaults to `False`): Whether to use sinusoidal positional embeddings. dim (`int`, *optional*, defaults to 768): Dimensionality of the encoder layers and the pooler layer. qa_dropout (`float`, *optional*, defaults to 0.1): The dropout probabilities used in the question answering model [`DistilBertForQuestionAnswering`]. seq_classif_dropout (`float`, *optional*, defaults to 0.2): The dropout probabilities used in the sequence classification and the multiple choice model [`DistilBertForSequenceClassification`]. Examples: ```python >>> from transformers import DistilBertConfig, DistilBertModel >>> # Initializing a DistilBERT configuration >>> configuration = DistilBertConfig() >>> # Initializing a model (with random weights) from the configuration >>> model = DistilBertModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` distilbertdimn_headsn_layers) hidden_sizenum_attention_headsnum_hidden_layersi:w vocab_sizeimax_position_embeddingsFsinusoidal_pos_embds ii hidden_dimg?dropoutattention_dropoutgelu activationg{Gz?initializer_range qa_dropoutg?seq_classif_dropoutrN pad_token_id eos_token_id bos_token_idTtie_word_embeddings)__name__ __module__ __qualname____doc__ model_type attribute_maprint__annotations__rrboolr r r rrfloatrrstrrrrrrlistr r!/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/distilbert/configuration_distilbert.pyr r s 4J('M J#&S&!&$&HcGSCNJGUS[%(us{(J#u#!J !'** L#* +/L#S /D(/#L#*# $$r/r N) r%huggingface_hub.dataclassesrconfiguration_utilsrutilsrr __all__r.r/r0r5sH%.3#;<2%'2%=2%j  r/