Ng1dZddlmZddlZddlZddlmZmZddlZ ddl Z ddl m Z ddlZ ddlmcmZ d"d#dZdZd$dZGddZ d%d&d!ZdS)'zXImplements function make_large_model to easily create and save models bigger than 2 Gb. ) annotationsN)AnyIterabletensoronnx.TensorProtolocationstroffset int | Nonelengthchecksum str | NonebasepathreturnNonec|jdd=tjj|_|||||dD];\}}|4|j}||_t||_  7 7Cu 7e /666666666 777r! tensor_name tensor_typeintshapetuple[int, ...]c|}tj}||_t||||_|j||S)a Create an external tensor. Arguments: location: unique identifier (not necessary a path) tensor_name: tensor name in the graph tensor_type: onnx type shape: shape the of the initializer Returns: the created tensor )rrnamer data_typedimsextend)rr*r+r-tensor_locationrs rmake_large_tensor_protor54sQO    FFKv///"F Ku Mr!ceZdZdZdZdZddZed d Zej d!d Zd"dZ d#dZ d$dZ dZ d%dZ d&d%dZd'd(dZdZdS))ModelContaineraImplements an API to store large tensors outside the main ModelProto, it avoids copying large initializers when defining the model and these initializers are never serialized through protobuf. No tensor is stored on disk until the user explicitly saves the model. c"d|_i|_dSr#) model_proto_large_initializersselfs r__init__zModelContainer.__init__Rs489;r!c`|j&tj|jdSdSr#) model_protorchecker check_modelr;s rrAzModelContainer.check_modelVs2   ' L $ $T%5 6 6 6 6 6 ( 'r!r0r r np.ndarrayc~||jvr(td|dt|jd|j|S)z*Returns an external tensor given its name.zUnable to find large tensor z among .)r: ValueErrorsortedr<r0s r __getitem__zModelContainer.__getitem__ZsS t. . .`t``fTE\>]>]``` &t,,r!onnx.ModelProtoc<|jtd|jS)NzModelContainer is empty.)r9 RuntimeErrorr;s rr?zModelContainer.model_protobs#   $9:: :  r!r?c`||_t||_dSr#)r9listenumerate_graph_protosgraphs_)r<r?s rr?zModelContainer.model_protohs)'D7799:: r!Iterable[onnx.GraphProto]c#dK|jjVt|jjEd{VdS)z&Enumerates all GraphProtos in a model.N)r?r(r'r;s rrNz%ModelContainer.enumerate_graph_protosmsD$$$$'(8(>???????????r!boolc,|dS)zTells if an initializer name is an external initializer stored in memory. The name must start with '#' in that case. #) startswithrGs r!is_in_memory_external_initializerz0ModelContainer.is_in_memory_external_initializerrss###r!r:dict[str, np.ndarray]cn|D]*}||std|d+||_dS)z1Adds all large tensors (not stored in the model).z The location z2 must start with '#' to be ignored by check model.N)rVrEr:)r<r:rs rset_large_initializersz%ModelContainer.set_large_initializersxs\#  A99!<<  [A[[[ #5r!c Ttj|jD]}tj|sd}|jD]}|jdkr|}|t d|jd|j|j vr5t d|jd|jdt|j ddS)Nr"No location found for tensor name rD"Unable to find large tensor named  with location  in ) ext_data_get_all_tensorsr?uses_external_datarrrKr0rr:rF)r<rpropexts rcheck_large_initializersz'ModelContainer.check_large_initializerss/0@AA  F.v66 7;D+  7j((D|"IIIIz!888":::%)Z::d566:::9  r! file_pathall_tensors_to_one_filec dd}i}tj|}tj|st d|d |j}tj}| |tj tj |d d }|rXtj |d d } |d } d } t| d5} dddn #1swxYwYtj|D]} tj| sd}| jD]}|jdkr|}|t%d| jd|j|jvr5t%d| jd|jdt-|jd|j|j}t.jdkr'|}n|}|rqt7| | | t9|| t9|z } t| d5} | |dddn #1swxYwY^|||j|d }t7| |tj||}||_t|d5} | |dddn #1swxYwYt|d5} | |dddn #1swxYwY|S)aSave the large model into a main onnx file and one file per tensor. Follows the same format as :func:`write_external_data_tensors `. The main model needs to be modified to update the file location, the function returns this modified copy. Arguments: file_path: model file all_tensors_to_one_file: all tensors in one file Returns: modified main model proto prefixr r0 unique_namesdict[str, int]rc|r|d|}dD]}||d}|}||vr||dz}|||<|d|Sd||<|S)N-z:/\;,!_)replace)rhr0ric base_nameis r _clean_namez2ModelContainer._save_external.._clean_names * ))4)) + +||Ar**I|## &*%& T"#))a)))!"L Kr!zFolder z does not exist.rrnz.weightwbNrr[rDr\r]r^big)rr r abr)rhr r0r rirjrr )ospathdirnameexistsFileNotFoundErrorr?SerializeToStringr ModelProtoParseFromStringsplitextsplitopenr_r`rarrrKr0rr:rFsys byteorderbyteswaptobytesr lenwritejoin)r<rerfrtrifolderprotocopyrh file_weightfull_file_weightr frrbrc np_tensor tensor_bytesr0 full_names r_save_externalzModelContainer._save_externals"    (* ++w~~f%% J#$Hf$H$H$HII I 2244   U###!!"'-- ":":2">??B " W]]955a8AAAK"+444 F&--                /55( *( *F.v66 7;D+  7j((D|"IIIIz!888":::%)Z::d566::: / ;I}%%(1133;;== (0022 & *"(!|,,  #l+++*D11*QGGL)))***************&+fdj,GGPPP"6D9999GLL66 ! )T***aGGL)))***************)T " " .a GGD**,, - - - . . . . . . . . . . . . . . . sH"D00D47D4>J  J$ 'J$ L,,L0 3L0 (M==NNFc0|||S)aSave the large model. The function returns a ModelProto, the current one if the model did not need any modification, a modified copy of it if it required changes such as giving file names to every external tensor. Arguments: file_path: model file all_tensors_to_one_file: saves all large tensors in one file or one file per lerge tensor Returns: the saved ModelProto )rf)r)r<rerfs rsavezModelContainer.saves'&"" /F#   r!Tload_large_initializerscntj|d|_|r||dSdS)avLoad the large model. Arguments: file_path: model file load_large_initializers: loads the large initializers, if not done, the model is incomplete but it can be used to look into the model without executing it and method :meth:`_load_large_initializers` can be used to load them later F)load_external_dataN)r load_modelr9_load_large_initializers)r<rers rloadzModelContainer.loadsG!OI%PPP " 5  ) )) 4 4 4 4 4 5 5r!c|jtdi|_tj|}t tj|jD]\}}tj |stj |}tj ||j |j}d|}t||t!|d5}|jr||j|jr||jn|} t*j|j} t3|j} t6jdkr>>,,... r!)NNNN)rrrr r r r r r rrrrr) rr r*r r+r,r-r.rrr#)r(rr:rrrrr7)r __future__rrzrtypingrrnumpyrronnx.external_data_helperexternal_data_helperr_ onnx.helperonnx.onnx_cpp2py_export.checkeronnx_cpp2py_exportr@rr r'r5r7rrr!rrs>#"""""  ,,,,,,333333333  !!!!!.777.q9q9q9q9q9q9q9q9l8<r!