ї ЯїgfЦС^≈dZddlmZddlmZejeі╚ZGd└deі╚ZdS)zPixtral model configurationИ)зPretrainedConfig)зloggingcС<┤≈eZdZdZdZ d┬fd└ Z┬xZS) зPixtralVisionConfigaє This is the configuration class to store the configuration of a [`PixtralVisionModel`]. It is used to instantiate an Pixtral vision encoder according to the specified arguments, defining the model architecture. Instantiating a configuration with the defaults will yield a similar configuration to the vision encoder used by Pixtral-12B. e.g. [pixtral-hf/pixtral-9b](https://huggingface.co/pixtral-hf/pixtral-9b) Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: hidden_size (`int`, *optional*, defaults to 1024): Dimension of the hidden representations. intermediate_size (`int`, *optional*, defaults to 4096): Dimension of the MLP representations. num_hidden_layers (`int`, *optional*, defaults to 24): Number of hidden layers in the Transformer encoder. num_attention_heads (`int`, *optional*, defaults to 16): Number of attention heads in the Transformer encoder. num_channels (`int`, *optional*, defaults to 3): Number of input channels in the input images. image_size (`int`, *optional*, defaults to 1024): Max dimension of the input images. patch_size (`int`, *optional*, defaults to 16): Size of the image patches. hidden_act (`str`, *optional*, defaults to `"gelu"`): Activation function used in the hidden layers. attention_dropout (`float`, *optional*, defaults to 0.0): Dropout probability for the attention layers. rope_theta (`float`, *optional*, defaults to 10000.0): The base period of the RoPE embeddings. Example: ```python >>> from transformers import PixtralVisionModel, PixtralVisionConfig >>> # Initializing a Pixtral-12B style configuration >>> config = PixtralVisionConfig() >>> # Initializing a model (with randomly initialized weights) from the configuration >>> model = PixtralVisionModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```зpixtralИИИИrзgeluГГ┬ц@cСз∙≈tі╚jdi|є▌||_||_||_||_||_||_||_| |_ ||_ | |_||z|_dS)N╘) зsuperз__init__зhidden_sizeзintermediate_sizeзnum_hidden_layersзnum_attention_headsзnum_channelsз patch_sizeз image_sizeзattention_dropoutз hidden_actз rope_thetaзhead_dim) зselfrrrrrrrrrrзkwargsз __class__s ─Зm/var/www/html/ai-engine/env/lib/python3.11/site-packages/transformers/models/pixtral/configuration_pixtral.pyrzPixtralVisionConfig.__init__IsЬ─П █┴▄тп"п"≤6п"п"п"Ю&┬ть!2┬ть!2┬ть#6┬т ь(┬ть$┬▄ь$┬▄ь!2┬ть$┬▄ь$┬▄ь#п':я:┬▄ ┬ ┬ С) rr r rrrrrr r)з__name__з __module__з__qualname__з__doc__з model_typerз __classcell__)r s@r!rrsoЬ─────П-П-П^─JПьььььььььП;П;П;П;П;П;П;П;П;П;r"rN) r&зconfiguration_utilsrзutilsrз get_loggerr#зloggerrrr"r!Зr-s└ПП"п!Ю3п3п3п3п3п3ьпппппП ┬т ≤Hя %т %─ПL;ПL;ПL;ПL;ПL;п*ЯL;ТL;ПL;ПL;ПL;r"