Ng9 JddlmZmZmZddlZddlmZmZm Z m Z m Z m Z m Z ddlmZmZmZmZmZmZmZmZmZddlmZde deded ee fd Zd ee efd ee effd Zd ee efded ee effd Z dd eee e fdedeededef dZ dS))ListOptionalUnionN)AttributeProto FunctionProto GraphProto ModelProto NodeProtoSparseTensorProto TensorProto) make_attribute make_function make_graph make_model make_node make_tensormake_tensor_value_infoset_model_propstensor_dtype_to_np_dtype) from_arraynode thresholdvalue_constant_of_shapereturnc |jdkrtd|jd|jD]"}|jdkrt d|jd|jdkr|j}|jd}|j}tj|}||kr|gcSttj t|tj | }t|j} tdg|g| } td |g|jttj |g|  } | | gcSt d |j|gS)zReplaces a Constant node with a large tensor (with more than threshold elements) by a sequence of nodes that produces a dummy constant of same shape as original tensor.Constantz!Node type must be 'Constant' not . sparse_valuezEThis feature is not yet implemented for a sparse constant (node name=).value__SHAPEdtypenamer ConstantOfShapez'Replacement of constant with attribute )op_type TypeError attributer%NotImplementedErrortdimsnpprodrarraylistint64r data_typeroutput) rrrattr new_namer-sizeinitr# node_shapenew_nodes X/var/www/html/ai-engine/env/lib/python3.11/site-packages/onnx/tools/replace_constants.py_replace_constantr<s |z!!MDLMMMNNN~   8~ % %%."i...  8w  EE*---H:D74==Dy  v bhtDzzBBBRRRD,U_==E"  J !!   +B*C5!Q!Q!QRR H ) ) ) )! Bch B B    6Monxc t|trt|j}nJt|trt|j}n t dt |dt|D]0}t|jzt|j z1fd}tdg|dgd}tdg|dgd }i}t|D]x\}}|j d kr|jd}td |g||d g} td |j d| j d|j dg||dg} t|jd kr|jdjj} n t"j} td| j dg||dg| } td| j dg||dg| } td| j d| j dg||dg}td|j d|g|j }| | | | ||g||<zt'|dD]\}}||||d z<|d||d |t|tr0t-||j|j|j |j|j}|St|tr0t5|j|j|j|j ||j}|St dt |d)zReplaces all *ConstantOfShape* by node *Range* to avoid constant tensors. The function is not recursive. The recursivity is done by *replace_initializer_by_constant_of_shape*. Not implemented for type rc|vr||Sd} |d|}|vr||S|dz }()NT_)add RuntimeError)prefixir%existing_namess r; _find_namez9_replace_constant_of_shape_with_range.._find_name[sr  ' '   v & & &M  ??q??D>))""4((( FA  r=rzeror) value_intonerDr' ReduceProd_NRange_RANGECast_RANGEf)to_NfDiv_FLATReshapeT)reverse initializersparse_initializer opset_imports) isinstancerr1rrr)typesetinputr4r enumerater(lenr*r,r3r FLOATsorteditemsinsertrr%r[r\rdomain opset_import)r>nodesrrJcst0cst1updateinodeshapenarTaccldreshupgraphnew_onxrIs @r;%_replace_constant_of_shape_with_rangerzGs#z""BSX C ' 'BSX@DII@@@AAAUUN++#dj//)#dk*** N N N N N Zjj&8&8%9Q G G GD Zjj&7&7%8A F F FD F ''00 t <, , ,  1  lUGjjE.F.F-G H H   [^QXa[$+a. 9 Z5((( ) ) *   t~  ! # #"$.BB"B v }zzU:K:K:K/L/L.MRT U U U v }zzU---/H/H.Ib Q Q Q  BIaL")A,/**___2M2M1N  QXa[%$8$+FFAr2q$/u FLLNND999&& r#%eeai   LLD LLD#z""   H I J"5     #}%%  J H I J *     <S <<< = ==r=cZt|trt|j}nJt|trt|j}n t dt |dt}|D]0}|t|jz}|t|j z}1i}t|D]\}}|j dkr|j dj }t|j|jdg|g}t#d|j|j } t%|j dj|} | j | | ||<|D] \}} | ||< t|tr0t+||j|j|j |j|j} | St|tr0t1|j|j|j|j ||j} | St dt |d) z7Replaces all fill value of all nodes *ConstantOfShape*.r@rr'rrDr&rZr])r_rr1rrr)r`rarbr4rcr(r*r,rr%r3rr appendrgrr[r\rrirj)r>rrkrIrrnrotensor new_tensorr:r5rwrxrys r; _replace_constant_of_shape_valuers;#z""BSX C ' 'BSX@DII@@@AAAUUN++#dj//)#dk*** F '' ! ! t <, , , "$ K)A31H0I  . DKHHT^A.3:FFF!!#&&& u \\^^ re #z""   H I J"5     #}%%  J H I J *     <S <<< = ==r=F? ir_version use_rangec "  ttrd}g}jD]^}|jdkrs tAdtCdd }g}tE g}g}j#D]h}tI|j%}tMj'|}|kr||G|dz }|j d}|tQtMj)tU|tLj+|tY|j-}t]d|g|j gtQtMj)dg|}|| |j Bdkr<|t_|t`j1t |gjg}j2D]o}tI|j%}tMj'|}|kr||Ftgd|j4j d|j5j djD]^}|jdkr?t |}t |dkr|dz }||Md}g}|j6D]}|j!tnj8krlts|dr\|j:Ut#|j:}tw|tw|j:krd}ty|j |}|||rVt]|j|j |j }|j6||||dz }I||`|d kr\t{|j fd j D|zj ||!}rt|Sdkrt|S|SrtSdkrtSS)"aReplace initializers or constant node by nodes *ConstantOfShape* to reduce the size. This reduce the cost to write a unit test about a specific graph structure. Args: onx: ModelProto threshold: every initializer under this threshold is not impacted ir_version: initializer must be specified as input for `ir_version <= 3`, this must be specified if onx is :class:`FunctionProto` or :class:`GraphProto` use_range: if uses operator *Range* instead of *ConstantOfShape* to avoid constant tensors value_constant_of_shape: value to use as a value for all nodes *ConstantOfShape*, a high value may produce nan or inf predictions Returns: onx, modified ModelProto The function is designed so that the function can be reapplied on a modified model and either replace *ConstantOfShape* with *Range* operators, either replace the fill value for every *ConstantOfShape*. FrrBTr]rD)rrrrc Fg|]}t|pjS)rrrr)(replace_initializer_by_constant_of_shaper).0frr>rrrs r; z.sP     5#%7#(?        r=) functions producer_nameproducer_versionr doc_stringri model_versionrc(i|]}|j|jS)keyr )rps r; z.3sAAAaeQWAAAr=N z.Range was introduced in opset 11 but opset is r z7ConstantOfShape was introduced in opset 9 but opset is z-onx should be a GraphProto at this stage not r!r"r$r'rr&zKThis feature is not yet implemented for a sparse initializer (indices.name=z, values.name=rgrc&g|] }|jv |Srr$)rrHremoveds r;rz.s% ; ; ;1QV7%:%:Q%:%:%:r=rZ)>r_rrr(r<rdextendr|rrir%rbr4rjrzrr rrxrrrrrrrmetadata_propsrrEversionrFrr)r`rar[tupler-r.r/rr0r1r2rr3rrr INT64r\r+indicesvaluesr*rGRAPHhasattrridr r)!r>rrrrmodified new_nodesr cst_nodesry new_graph new_functionsmodelroimpop_setn_modificationsadditional_inputs new_initsr8r-r7r6r#new_sparse_initssp_init shape_nodesattsr5rr:rxrs!````` @r;rrs>#}%%%' H # #D|z))-dI?VWW y>>Q&&#H  +++   T " " " "  #   !. G F8== = "a ' '3C9PQQ Q #z"".< I!3S^$;             ]     #+ 1!3S^~:+     s! " "Q & &AAc.@AAAF E6 * * *  qqq !$ * *D'++--F{b  T\B%6%69%6"TT\TTT{b  T\A%5%5"<,0L<<<!KFM!\FNN c: & &VTS TTTUUUOIeeG#%ITYwt}} 9     T " " " 1i((( rxT "(;;;( K K K   )88  J YKRXse5999::      DI  !jAoo  $ $&x1BSYYKPP   13)   W\""wt}} 9    # #G , , , ! 5$_1 5 5">. 5 5 5    # # <: % %+D)=TUUK;1$$1$   [ ) ) ) >  CN000C%%1E%<E')',C a55BsuII%%#H(155C KK      # tz4;GGH   % %d + + +   X & & & q OO   T " " " "  H ; ; ; ; ; ; ;>O O J!/      @8?? ? "a ' '3E;RSS S :4S999!##/5LMMM Jr=)rNFr)!typingrrrnumpyr.onnxrrrr r r r onnx.helperr rrrrrrrronnx.numpy_helperrintfloatr<rzrboolrrr=r;rsA)(((((((((                      )(((((% % #%>C% )_%%%%PU> z=( )U> :} $%U>U>U>U>p4> z=( )4>DI4> :} $%4>4>4>4>r $%( SS }j*4 5SS S S # SSSSSSr=