gvdZddlZddlmZmZmZddlmZddlm Z m Z m Z m Z m Z ddlmZGdd eZdS) z Processor class for ViLT. N)ListOptionalUnion)ProcessorMixin) BatchEncodingPaddingStrategyPreTokenizedInput TextInputTruncationStrategy) TensorTypec"eZdZdZddgZdZdZd!fd Z d"d ee e e e e e fd e d ee e efdee e efdeededeedee dee de de de de de deee efdef dZdZdZedZedZed ZxZS)# ViltProcessorau Constructs a ViLT processor which wraps a BERT tokenizer and ViLT image processor into a single processor. [`ViltProcessor`] offers all the functionalities of [`ViltImageProcessor`] and [`BertTokenizerFast`]. See the docstring of [`~ViltProcessor.__call__`] and [`~ViltProcessor.decode`] for more information. Args: image_processor (`ViltImageProcessor`, *optional*): An instance of [`ViltImageProcessor`]. The image processor is a required input. tokenizer (`BertTokenizerFast`, *optional*): An instance of ['BertTokenizerFast`]. The tokenizer is a required input. image_processor tokenizerViltImageProcessor) BertTokenizerBertTokenizerFastNc d}d|vr/tjdt|d}||n|}|t d|t dt |||j|_dS)Nfeature_extractorzhThe `feature_extractor` argument is deprecated and will be removed in v5, use `image_processor` instead.z)You need to specify an `image_processor`.z"You need to specify a `tokenizer`.) warningswarn FutureWarningpop ValueErrorsuper__init__rcurrent_processor)selfrrkwargsr __class__s d/var/www/html/ai-engine/env/lib/python3.11/site-packages/transformers/models/vilt/processing_vilt.pyrzViltProcessor.__init__-s  & ( ( M    !' +> ? ? -<-H//N_  "HII I  ABB B )444!%!5TFrtextadd_special_tokenspadding truncation max_lengthstridepad_to_multiple_ofreturn_token_type_idsreturn_attention_maskreturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverbosereturn_tensorsreturnc |jd|||||||| | | | | |||d|}|||}|||S)a  This method uses [`ViltImageProcessor.__call__`] method to prepare image(s) for the model, and [`BertTokenizerFast.__call__`] to prepare text for the model. Please refer to the docstring of the above two methods for more information. )r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2)r2)rrupdate)rimagesr$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r encodingencoding_image_processors r"__call__zViltProcessor.__call__@s4"4> 1!!1"7"7&?'A#9')  !  &$(#7#7~#7#^#^ 0111r#c&|jj|i|S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r batch_decoderargsr s r"r<zViltProcessor.batch_decoders +t~*D;F;;;r#c&|jj|i|S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )rdecoder=s r"r@zViltProcessor.decodeys %t~$d5f555r#c|jj}|jj}tt||zS)N)rmodel_input_namesrlistdictfromkeys)rtokenizer_input_namesimage_processor_input_namess r"rBzViltProcessor.model_input_namess: $ @&*&:&L#DMM"7:U"UVVWWWr#cDtjdt|jS)Nzg`feature_extractor_class` is deprecated and will be removed in v5. Use `image_processor_class` instead.)rrrimage_processor_classrs r"feature_extractor_classz%ViltProcessor.feature_extractor_classs' u    ))r#cDtjdt|jS)Nz[`feature_extractor` is deprecated and will be removed in v5. Use `image_processor` instead.)rrrrrJs r"rzViltProcessor.feature_extractors' i    ##r#)NN)NTFNNrNNNFFFFTN)__name__ __module__ __qualname____doc__ attributesrItokenizer_classrrr r rboolstrr r rintr rr:r<r@propertyrBrKr __classcell__)r!s@r"rrs   $[1J0r\s((((((((((......wwwwwwwwwwwwwwy$y$y$y$y$Ny$y$y$y$y$r#