קgdZddlmZddlmZmZmZddlZddlm Z ddlm Z gd Z ee e edfZd efd Zd efd Zd efd Zd efdZd efdZd efdZd efdZd ded dfdZGddZGddZeZead ded efdZGddeZded efdZd efdZ ded dfdZ!d e fdZ"dS)!zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )AbstractContextManager)AnyOptionalUnionNdevice)amp) is_available synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventreturncHtjjS)z/Returns a bool indicating if CPU supports AVX2.)torch_C_cpu_is_avx2_supportedN/var/www/html/ai-engine/env/lib/python3.11/site-packages/torch/cpu/__init__.pyrr s 8= + + - --rcHtjjS)z1Returns a bool indicating if CPU supports AVX512.)rrr_is_avx512_supportedrrrr r %s 8= - - / //rcHtjjS)z6Returns a bool indicating if CPU supports AVX512_BF16.)rrr_is_avx512_bf16_supportedrrrr"r"*s 8= 2 2 4 44rcHtjjS)z/Returns a bool indicating if CPU supports VNNI.)rrr_is_avx512_vnni_supportedrrr_is_vnni_supportedr%/s 8= 2 2 4 44rcHtjjS)z3Returns a bool indicating if CPU supports AMX_TILE.)rrr_is_amx_tile_supportedrrrr'r'5s 8= / / 1 11rcHtjjS)zInitializes AMX instructions.)rrr _init_amxrrrr)r):s 8= " " $ $$rcdS)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrr r ?s 4rr cdS)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrs rr r Hrc,eZdZdZddeddfdZd dZdS) rzH N.B. This class only exists to facilitate device-agnostic code priorityrNcdSNr)selfr/s r__init__zStream.__init__W rcdSr1rr2rs r wait_streamzStream.wait_streamZr4r)r.rN)__name__ __module__ __qualname____doc__intr3r7rrrrrRsY   d          rrc6eZdZdefdZdddZddZdddZdS) rrcdS)NTrr2s rqueryz Event.query_strNcdSr1rr6s rrecordz Event.recordbr4rcdSr1rr@s rr zEvent.synchronizeer4rcdSr1rr6s rwaitz Event.waithr4rr1r8)r9r:r;boolrArCr rFrrrrr^sut                rrctS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrs rrrps  rcNeZdZUdZeeed<dZdZde de de dd fd Z d S) rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code cur_streamc,||_t|_dSr1)r_default_cpu_stream prev_streamr6s rr3zStreamContext.__init__s .rc8|j}|dSt|_|adSr1)rrIrN)r2rKs r __enter__zStreamContext.__enter__s'[   F+$rtypevalue tracebackrNc*|j}|dS|jadSr1)rrNrI)r2rQrRrSrKs r__exit__zStreamContext.__exit__s"[   F*r) r9r:r;r<rr__annotations__r3rPrrUrrrrr|s     ///%%%+S+++++++++rrrc t|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rs rrrs   rcdS)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrs 1rcdS)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code Nrrs rrrr,rcdS)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrs 5rr1)#r< contextlibrtypingrrrrr _devicer __all__strr= _device_trGrr r"r%r'r)r r rrrMrIrrrrrrrrrrcs .-----''''''''''     '3T) * .D.... 0d0000 545555 5D5555 22222 %4%%%% d T                  fhh%  9     +++++*+++>!6!4!!!! c    yTr