קgtddlZddlmZddlmZddlmZddlmZddl m Z ddl Z GddeZ d ZdS) N)CapabilityBasedPartitioner)OperatorSupport)CALLABLE_NODE_OPS)FakeTensorProp)_pytreec2eZdZdejjdefdZdS)CudaGraphsSupportnodereturncT|jtvrdS|jtjjjjfvrdS|jtj fvrdSdd}fd}|j D]%}tj |||j &tj |||j  S)NFTc*d|vr|dn|dS)Nval fake_result)metas _/var/www/html/ai-engine/env/lib/python3.11/site-packages/torch/fx/passes/backends/cudagraphs.pymeta_fkz4CudaGraphsSupport.is_node_supported..meta_fks"'4--4;;T-5H Hcht|tjr|jjdkrddSdSdS)NcudaT) isinstancetorchTensordevicetype)tfound_not_cudas r find_not_cudaz:CudaGraphsSupport.is_node_supported..find_not_cudas>!U\** &qx}/F/F!% & &/F/Fr)oprtargetropsatenembedding_dense_backwarddefaultoperatorgetitemall_input_nodespytree tree_map_r)self submodulesr rrnrs @ris_node_supportedz#CudaGraphsSupport.is_node_supported s 7+ + +5 ;59>BJK K K5 ;8+, , ,4 I I I & & & & & % = =A  ]GGAFOO < < < < (:(:;;; "!!rN)__name__ __module__ __qualname__rfxNodeboolr-rrrr r s:"%(-"D""""""rr ct|j|t}t||d}|}||}|S)z Partition an FX graph into sub-GraphModules that can be validly run under CUDA graphs. For a subgraph to be runnable under CUDA, all of the operations must involve CUDA tensors only/ T)allows_single_node_partition)r propagater rpropose_partitionsfuse_partitions)gminputs supported_ops partitioner partitions fused_graphs rpartition_cudagraphsr?+sh!N2 &))%''M-R]abbbK//11J--j99K r)r!torch.fx.passes.infra.partitionerr torch.fx.passes.operator_supportrtorch.fx.passes.tools_commonr torch.fx.passes.fake_tensor_propr torch.utilsrr(r%r r?rrrrEs HHHHHH<<<<<<::::::;;;;;;))))))""""""""@r