קgS ddlmZmZmZmZmZddlZddlmZddl m Z m Z m Z m Z ddlmZddlmZmZmZmZddlmZddlmZmZmZdd lmZmZmZdd lm Z d gZ!d ed eeefdefdZ"deded eeefddfdZ#deded eeeffdZ$dedeeefd eeefdefdZ%dedefdZ&dedefdZ'dej(jdeeeffdZ)dZ*deeefdeee+ffdZ,deee+fdeeefd e-deee ffd!Z.d"eeefd#e d$edej/j0d%ee1ej/j0fd&eee fd e-de fd'Z2d"ed$edej/j0d%ee1ej/j0fd&eee fd e-ddfd(Z3d"edej/j0d%ee1ej/j0fd)ed&eee fd e-deefd*Z4d"edej(jd&eee fd e-fd+Z5ded,ee1ee1e6ffd e-defd-Z7dS).)AnyDictOptionalTupleUnionN) FakeTensor) CUSTOM_KEYNUMERIC_DEBUG_HANDLE_KEYObserverOrFakeQuantizeQConfigMapping)PrepareCustomConfig)_create_obs_or_fq_from_qspec_insert_obs_or_fq _is_activation_post_process_node _save_state) QConfigAny) EdgeOrNodeQuantizationSpecBaseSharedQuantizationSpec)Graph GraphModuleNode)Argumentprepare edge_or_nodeshared_with_mapreturncP||}||kr|St||}|||<|S)zFind the root node for the sharing tree Args: edge_or_node: edge/node that we want to find the root shared_with_map: each edge/node points to the parent, the root node will points to itself Returns: root edge/node _find_root_edge_or_node)rrparentroots ^/var/www/html/ai-engine/env/lib/python3.11/site-packages/torch/ao/quantization/pt2e/prepare.pyr r #s=\ *F  "6? ; ;D$(OL! Kr!childcPt||}t||}|||<dS)zHMerge the subtree for `child` with `parent`, the order is important hereNr)r!r%r root_parent root_childs r#_unionr)7s2 *&/BBK(@@J"-OJr$qspeccdt|tr|j}t|||dSdS)aUpdate the `shared_with_map` based on the qspec, this applies the `SharedQuantizationSpec` configuration and established the relationship between `edge_or_node` with the edge/node that it is pointing to, we'll use this information in the end to get the group id N) isinstancerrr))r%r*rr!s r#_update_shared_withr-CsC%/00/# vuo..... //r$edge_or_node_to_qspecct|tr0|j}t||}||}t |||S|S)aUnwraps qspec to get the final root qspec (non SharedQuantizationSpec) if qspec is SharedQuantizationSpec (1). tries to find the root edge or node for the node that the qspec points to (2). recursively find the root qspec based on the qspec for the root node )r,rrr _unwrap_shared_qspec)r*r.r sharing_withr"s r#r0r0SsQ%/00S) &|_EE%d+#E+@/RRR Lr$qspec_aqspec_bcbt|dot|do|j|jkS)Ndtype)hasattrr5r2r3s r#_has_same_dtyper8es7!! + GW % % + MW] *r$cbt|dot|do|j|jkS)N is_dynamic)r6r:r7s r#_has_same_is_dynamicr;ms9&& 5 G\ * * 5  '"4 4r$modelci}|jjD]e}t|drSd|jvrJ|jd}|jD]\}}||f}|||<|j|}|j}|||<f|S)zPGet a map from EdgeOrNode to quantization spec based on annotations on the nodesmetaquantization_annotation)graphnodesr6r>input_qspec_mapitems output_qspec)r<r.nqa input_to_nr* input_edge output_nodes r#_get_edge_or_node_to_qspecrJusEG [  ; ; 1f   ;";qv"E"E12B%'%7%=%=%?%? : :! E(!_ 49%j11* 5:%k2  r$cd}||vr||}t|||}|3t||r%t||rt|||dSdSdSdS)zUnion input edge with another edge or node, used in implicit sharing to point the current input edge to other user edges of the producer node, or the output of producer node since these are referring to the same Tensor N)r0r8r;r))rHinput_edge_root_qspecrr.r root_qspecr*s r#_union_input_edge_withrNsJ,,,%l3)%1FXX   J(= > >  -B C C  |Z99999 r$c d|D}|D]\}}t|tjjr|}t |||9|}t|||}t|tsJ|\}}|j dj rwt|t rt|t std||f|j D]} | |ur|| f} t||| ||t|||||t |||d} i} |D]+}t||} | | vr | | | <| dz } | | | |<,| S)aMap from edge/node to the group ID, generated from quantization annotations, edge/node with the same group ID should use the same observer/fake_quant instance This is applying SharedQuantizationSpec configuration and map each edge/node to a group There is another implicit sharing that's built in the quantization, when we have the following: * op1 -> op2 * output of op1: int8_qspec * (op1 -> op2) input edge: int8_qspec we'll assume sharing between the output of op1 and input of (op1 -> op2) since these are the same Tensor. Figuring out the correct group ID for all edge/node is a standard union find problem: https://www.geeksforgeeks.org/introduction-to-disjoint-set-data-structure-or-union-find-algorithm/ Args: edge_or_node_to_qspec: Dictionary from edge_or_node to the qspec, derived from annotations Returns: edge_or_node_to_group_id: Dictionary from edge_or_node to group_id (int), all edge or node that belongs to the same group should have the same id Example: op2 -> cat1 -> cat2 op1 / / op3 edge_or_node_to_qspec: { op1: int8_qspec, op2: int8_qspec, (op1, cat1): int8_qspc, (op2, cat1): SharedQuantizationSpec((op1, cat1)), cat1: SharedQuantizationSpec((op1, cat1)), (op3, cat2): int8_qspec, (cat1, cat2): SharedQuantizationSpec((op3, cat2)), cat2: SharedQuantizationSpec((op3, cat2)), } edge_or_node_to_group_id = _get_edge_or_node_to_group_id(edge_or_node_to_qspec) edge_or_node_to_group_id: { op1: 1, op2: 1, (op1, cat1): 1, (op2, cat1): 1, cat1: 1, (op3, cat2): 1, (cat1, cat2): 1, cat2: 1, } # everything are in the same group because (cat1) and (cat1, cat2) are implicitly shared, which # connects the two sharing group around cat1 and cat2 op due to transitive sharing ci|]}||SrQ).0ks r# z1_get_edge_or_node_to_group_id..s'5551555r$r?z=Expected input_edge to have type Tuple[Node, Node], but got: r)keysrCr,torchfxrr-r0tupler>allow_implicit_sharing ExceptionusersrNr )r.rrr*rIrHrLargrEuserarg_to_user_edge cur_group_idedge_or_node_to_group_idr"s r#_get_edge_or_node_to_group_idrbsj55+0022555O 5::<<7D7D e lEHM 2 26 D&K  UO D D D D%J$8,o%% !j%00 0 0 0FCv/0G) $"#t,,Jq$4G4G#`X[]^W_`` I  Dqyy (+T{$*"-(-' '))#  E? C C C CL68',,..PP &|_EE / / /-9 $T * A L1I$1O .. ##r$rais_qatci}i}|D]0\}}||}||vrt|||||<||||<1|S)zGenerates the EdgeOrNode to observer/fake_quant instances Makes sure that for EdgeOrNode that has the same group_id should have the same observer or fake quant instances )rCr)rar.rc obs_or_fq_mapgroup_id_to_obs_or_fqrr*group_ids r#_get_obs_or_fq_maprh!s?AM?A4::<<FF e+L9 0 0 0/K}f// !( +' cur_node To prev_node -> obs -> cur_node rz, expecting kwargs for aten op IR to be emptyN)rqrnrortrWopsatenclonedefault zeros_likegelulenkwargsrY) rirjr<rkrercnew_argsr]rxs r#&_maybe_insert_input_observers_for_noders.Hy ! !?              uy~+333 ;%).3; ; ; ;%).-5 5 5 t{  q 5 ! hDIIIr$r@c||vr||}t|||||}t|trt|tryt|jvrkt |jtvrRt|jvri|jt<|jtt |jtt <|SdSN)rr,rr r>r )rir<rkr@rercoutput_act_obs_or_fq new_outputs r#&_maybe_insert_output_observer_for_noders },T2& &}e  tT " " (:t,, (di''(DIj,AAA00.0  +DHIE&E(JOJ '(@ A 4r$cd|jvr |jdnd}|dSt|d}t|d||||d|jvot |jdt }|sdSt ||||j||}|dSt|j }|D]} | |ur| ||dS)Nr?F)remove_duplicateval) r>dictrkrr,rrr@rmr\rVreplace_input_with) rir<rerc!this_node_quantization_annotationrkoutput_is_a_tensormaybe_output_obs_node orig_users user_nodes r#1_maybe_insert_input_and_output_observers_for_noders: % 1 1 +,, & )0,,e,DDEEM*    $)+X 49U;KZ0X0X C e]EK$ djoo''((JBB - - - $$T+@AAAABBr$node_name_to_scopec bt|jj}t|}t |}t |||}|D]}t ||||t||j}t|i|tit|t|Sr) rmr@rArJrbrhrrrr r set)r<rrcnodes_before_observationr.rareris r#rrs $EK$566 7u==<=RSS& "7M)  9 %     u{ + +E        Lr$)8typingrrrrrrWtorch._subclassesrtorch.ao.quantizationr r r r &torch.ao.quantization.fx.custom_configr torch.ao.quantization.fx.preparerrrrtorch.ao.quantization.qconfigrtorch.ao.quantization.quantizerrrrtorch.fxrrr torch.fx.noder__all__r r)r-r0r8r;rXrJrNintrbboolrhnnModulestrrnrrrrprrQr$r#rs44444444444444 (((((( GFFFFF 544444 .---------""""""   /3J 4J/K( .  .  .*j01 . . . . . /  /  /*j01 / / / /   ,@ @A*j01 $1