gaddlZddlZddlZddlZddlmZddlmZmZm Z m Z m Z m Z ddl ZddlZddlmZddlmZddlmZmZmZmZmZmZmZmZmZmZm Z erddl!m"Z"e j#e$Z%Gd d eZGd d eZ&ee&j'e&_'e&j'j(.e&j'j()d dde&j'_(dSdS)N)BytesIO)AnyDictListOptionalTupleUnion)custom_object_save) BatchFeature) IMAGE_PROCESSOR_NAMEPushToHubMixinadd_model_info_to_auto_map"add_model_info_to_custom_pipelines cached_file copy_func download_urlis_offline_mode is_remote_urlis_vision_availablelogging)ImageceZdZdZdS)r a Holds the output of the image processor specific `__call__` methods. This class is derived from a python dictionary and can be used as a dictionary. Args: data (`dict`): Dictionary of lists/arrays/tensors returned by the __call__ method ('pixel_values', etc.). tensor_type (`Union[None, str, TensorType]`, *optional*): You can give a tensor_type here to convert the lists of integers in PyTorch/TensorFlow/Numpy Tensors at initialization. N)__name__ __module__ __qualname____doc__^/var/www/html/ai-engine/env/lib/python3.11/site-packages/transformers/image_processing_base.pyr r 5s    rr cLeZdZdZdZdZdefdZe d!de ee j fd e e ee j fd e d e d e e ee fd ef dZd"de ee j fde fdZede ee j fdeeeefeeefffdZedeeeffdZdeeeffdZede ee j ffdZdefdZde ee j ffdZdZed#dZde eeeffd ZdS)$ImageProcessingMixinz This is an image processor mixin used to provide saving/loading functionality for sequential and image feature extractors. Nc .|dd|dd|_|D]N\}} t|||#t$r*}t d|d|d||d}~wwxYwdS)z'Set elements of `kwargs` as attributes.feature_extractor_typeNprocessor_classz Can't set z with value z for )pop_processor_classitemssetattrAttributeErrorloggererror)selfkwargskeyvalueerrs r __init__zImageProcessingMixin.__init__Ms  +T222 & + To test a pull request you made on the Hub, you can pass `revision="refs/pr/"`. return_unused_kwargs (`bool`, *optional*, defaults to `False`): If `False`, then this function returns just the final image processor object. If `True`, then this functions returns a `Tuple(image_processor, unused_kwargs)` where *unused_kwargs* is a dictionary consisting of the key/value pairs whose keys are not image processor attributes: i.e., the part of `kwargs` which has not been used to update `image_processor` and is otherwise ignored. subfolder (`str`, *optional*, defaults to `""`): In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can specify the folder name here. kwargs (`Dict[str, Any]`, *optional*): The values in kwargs of any keys which are image processor attributes will be used to override the loaded values. Behavior concerning key/value pairs whose keys are *not* image processor attributes is controlled by the `return_unused_kwargs` keyword parameter. Returns: A image processor of type [`~image_processing_utils.ImageProcessingMixin`]. Examples: ```python # We can't instantiate directly the base class *ImageProcessingMixin* so let's show the examples on a # derived class: *CLIPImageProcessor* image_processor = CLIPImageProcessor.from_pretrained( "openai/clip-vit-base-patch32" ) # Download image_processing_config from huggingface.co and cache. image_processor = CLIPImageProcessor.from_pretrained( "./test/saved_model/" ) # E.g. image processor (or model) was saved using *save_pretrained('./test/saved_model/')* image_processor = CLIPImageProcessor.from_pretrained("./test/saved_model/preprocessor_config.json") image_processor = CLIPImageProcessor.from_pretrained( "openai/clip-vit-base-patch32", do_normalize=False, foo=False ) assert image_processor.do_normalize is False image_processor, unused_kwargs = CLIPImageProcessor.from_pretrained( "openai/clip-vit-base-patch32", do_normalize=False, foo=False, return_unused_kwargs=True ) assert image_processor.do_normalize is False assert unused_kwargs == {"foo": False} ```r7r8r9r;use_auth_tokenNrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.V`token` and `use_auth_token` are both specified. Please set only the argument `token`.r:)r&warningswarn FutureWarning ValueErrorget_image_processor_dict from_dict) clsr6r7r8r9r:r;r.r=image_processor_dicts r from_pretrainedz$ImageProcessingMixin.from_pretrained`st({#1 %5!"%z$4d;;  % ME     l#E  #F7O'Cs'CDa'l'lek'l'l$fs}1<r:r?zProvided path (z#) should be a directory, not a fileT)exist_okcommit_messagerepo_id)configzImage processor saved in )rMr:)r&r@rArBgetrCospathisfileAssertionErrormakedirssplitsep _create_repo_get_files_timestamps _auto_classr joinr to_json_filer+info_upload_modified_files) r-rIrJr.r=rMrNfiles_timestampsoutput_image_processor_files r save_pretrainedz$ImageProcessingMixin.save_pretraineds $4d;;  % ME   zz'4((4 l-F7O 7>>. ) ) h !f>!f!f!fgg g NT2222  J#ZZ(8$??NjjN,@,@,M,Mb,QRRG'd'::6::G#99.II    ' t^D A A A A')gll>CW&X&X# 5666 M0KMMNNN    ' ' -jj)) (   ,,,rreturnc |dd}|dd}|dd}|dd}|dd}|dd}|d d} |d d} |d d } |d d} |dd} |-tjdt|t d|}d| d}| | |d<t r| st dd} t|}tj |}tj |r%tj |t}tj |r|}d}nzt|r|}t!|}nYt} t#||||||| ||| |  }n6#t$$rt&$rt%d|d|dtdwxYw t)|dd5}|}dddn #1swxYwYt-j|}n&#t,j$rt%d|dwxYw|rt d |n t d |d!||s:d"|vrt3|d"||d"<d#|vrt5|d#||d#<||fS)$a From a `pretrained_model_name_or_path`, resolve to a dictionary of parameters, to be used for instantiating a image processor of type [`~image_processor_utils.ImageProcessingMixin`] using `from_dict`. Parameters: pretrained_model_name_or_path (`str` or `os.PathLike`): The identifier of the pre-trained checkpoint from which we want the dictionary of parameters. subfolder (`str`, *optional*, defaults to `""`): In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can specify the folder name here. Returns: `Tuple[Dict, Dict]`: The dictionary(ies) that will be used to instantiate the image processor object. r7Nr8Fresume_downloadproxiesr:r=r9r; subfolder_from_pipeline _from_autor>r?image processor) file_typefrom_auto_classusing_pipelinez+Offline mode: forcing local_files_only=TrueT) r7r8rfrer9r: user_agentr;rgz Can't load image processor for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z2' is the correct path to a directory containing a z filerutf-8encodingz"It looks like the config file at 'z' is not a valid JSON file.zloading configuration file z from cache at auto_mapcustom_pipelines)r&r@rArBrCrr+r^strrRrSisdirr\r rTrrrEnvironmentError ExceptionopenreadjsonloadsJSONDecodeErrorrr)rFr6r.r7r8rerfr:r=r9r;rg from_pipelinermrois_localimage_processor_fileresolved_image_processor_filereadertextrGs r rDz-ImageProcessingMixin.get_image_processor_dictsh$JJ{D11 $4e<< **%6==**Y-- 7D))$4d;;!::&8%@@::j$//JJ{B//  #3T::  **\599  % ME     l#E#4YY  $+8J' (    $%5 $ KKE F F F# (+,I(J(J%7==!>?? 7==6 7 7 e#%7<<0MOc#d#d 7>>7 8 8" ,I )HH 8 9 9 #@ ,89V,W,W ) )#7  0;1('#1#$3%5)%' 1 1 1--$      &K7TKK9VKK0DKKK  3S7KKK %v{{}} % % % % % % % % % % % % % % %#':d#3#3 #   "o5Rooo     KKU6SUU V V V V KKr.BrrSprr    1113M(46S44$Z0"%999;]();<>[<<$%78$V++s<H443I'+J>=J J>J""J>%J"&J>>#K!rGc |}|dd}d|vrd|vr|d|d<d|vrd|vr|d|d<|di|}g}|D];\}}t||r&t |||||<|D]}||dt d||r||fS|S)a Instantiates a type of [`~image_processing_utils.ImageProcessingMixin`] from a Python dictionary of parameters. Args: image_processor_dict (`Dict[str, Any]`): Dictionary that will be used to instantiate the image processor object. Such a dictionary can be retrieved from a pretrained checkpoint by leveraging the [`~image_processing_utils.ImageProcessingMixin.to_dict`] method. kwargs (`Dict[str, Any]`): Additional parameters from which to initialize the image processor object. Returns: [`~image_processing_utils.ImageProcessingMixin`]: The image processor object instantiated from those parameters. return_unused_kwargsFsize crop_sizeNzImage processor r)copyr&r(hasattrr)appendr+r^)rFrGr.rimage_processor to_remover/r0s r rEzImageProcessingMixin.from_dictsR" 488::%zz*@%HH V  *> > >+1::f+=+=  ( & [4H%H%H06 ;0G0G  -#55 455  ,,.. & &JC,, &e444  %%% " "C JJsD ! ! ! ! 888999  #"F* *" "rcVtj|j}|jj|d<|S)z Serializes this instance to a Python dictionary. Returns: `Dict[str, Any]`: Dictionary of all the attributes that make up this image processor instance. image_processor_type)rdeepcopy__dict__ __class__r)r-outputs r to_dictzImageProcessingMixin.to_dicts*t}--)-)@%& r json_filect|dd5}|}dddn #1swxYwYtj|}|di|S)a Instantiates a image processor of type [`~image_processing_utils.ImageProcessingMixin`] from the path to a JSON file of parameters. Args: json_file (`str` or `os.PathLike`): Path to the JSON file containing the parameters. Returns: A image processor of type [`~image_processing_utils.ImageProcessingMixin`]: The image_processor object instantiated from that JSON file. rprqrrNr)rzr{r|r})rFrrrrGs r from_json_filez#ImageProcessingMixin.from_json_files)S7 3 3 3 !v;;==D ! ! ! ! ! ! ! ! ! ! ! ! ! ! !#z$//s**)***s 488c.|}|D]6\}}t|tjr|||<7|dd}|||d<tj|dddzS)z Serializes this instance to a JSON string. Returns: `str`: String containing all the attributes that make up this feature_extractor instance in JSON format. r'Nr%T)indent sort_keys ) rr( isinstancenpndarraytolistr&r|dumps)r- dictionaryr/r0r's r to_json_stringz#ImageProcessingMixin.to_json_strings\\^^ $**,, 1 1JC%,, 1"',,.. 3&>>* This API is experimental and may have some slight breaking changes in the next releases. Args: auto_class (`str` or `type`, *optional*, defaults to `"AutoImageProcessor "`): The auto class to register this new image processor with. rNz is not a valid auto class.) rrvrtransformers.models.automodelsautorrCr[)rF auto_class auto_modules r register_for_auto_classz,ImageProcessingMixin.register_for_auto_classsn *c** -#,J666666666{J// I GGGHH H$rimage_url_or_urlsc\ddi}t|trfd|DSt|trQtj|d|}|t jt|j Stdt|)z Convert a single or a list of urls into the corresponding `PIL.Image` objects. If a single url is passed, the return value will be a single object. If a list is passed a list of objects is returned. z User-AgentzuMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36c:g|]}|Sr) fetch_images).0xr-s r z5ImageProcessingMixin.fetch_images..s'DDDQD%%a((DDDrT)streamheadersz=only a single or a list of entries is supported but got type=) rlistrvrequestsrQraise_for_statusrrzrcontent TypeErrortype)r-rrresponses` r rz!ImageProcessingMixin.fetch_imagess !  ' . . wDDDD2CDDD D )3 / / w|$5dGTTTH  % % ' ' ':gh&67788 8u\`ar\s\suuvv vr)NFFNr5)F)r)rrrrr[r2rvr4 classmethodr rRPathLikerboolrHrbrrrrDrErrrr]rrrrrrr r"r"Es K   0C00008<$!&,0o=o=',S"+-='>o=E#r{"234o= o=  o= c4i() o=o=o=o=[o=b;-;-eC4D.E;-TX;-;-;-;-zt,,1#r{2B,Ct, tCH~tCH~- .t,t,t,[t,l*#T#s(^*#*#*#[*#X c3h    +uS"+-='>+++[+$GGGGG* 05bk1A+B 0 0 0 0DDD%%%[%2weCcN.Cwwwwwwrr"rkrzimage processor file)object object_class object_files)*rr|rRr@iortypingrrrrrr numpyrrdynamic_module_utilsr feature_extraction_utilsr BaseBatchFeatureutilsr rrrrrrrrrrPILr get_loggerrr+r"rJrformatrrr rs+" ::::::::::::::::444444FFFFFF                            H % %     #    ^w^w^w^w^w>^w^w^wB$-9-A-M#N#N #+7/C/O/W/^/^ /CRh0_00$,,,87r