ΧgUdZddlmZddlZddlmZeejddZdaejj e d<dejj fd Z de fd Z dd Zdd ee eejfdefdZ dded ee eejfddfdZde ddfdZddZddZddZde fdZde fdZde fdZdefdZddlmZddlmZgdZ dS) ag This package enables an interface for accessing MPS (Metal Performance Shaders) backend in Python. Metal is Apple's API for programming metal GPU (graphics processor unit). Using MPS means that increased performance can be achieved, by running work on the metal GPU(s). See https://developer.apple.com/documentation/metalperformanceshaders for more details. )UnionN)Tensor_mps_is_in_bad_forkcdS)NFrN/var/www/html/ai-engine/env/lib/python3.11/site-packages/torch/mps/__init__.pyr s5r_default_mps_generatorreturncZttjatS)N)r torch_C_mps_get_default_generatorrrr _get_default_mps_generatorrs"%!&!D!D!F!F !!rczttjjotjS)z,Returns the number of available MPS devices.)intrr_has_mps_mps_is_availablerrr device_countrs( ux AUX%?%?%A%A B BBrc>tjS)zAWaits for all kernels in all streams on a MPS device to complete.)rr_mps_deviceSynchronizerrr synchronizers 8 * * , ,,rmpsdevicecBtS)zReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mps'`` (i.e., ``torch.device('mps')``, the current MPS device). )r get_state)rs r get_rng_stater$s & ' ' 1 1 3 33r new_statec|tj}t|dS)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mps'`` (i.e., ``torch.device('mps')``, the current MPS device). ) memory_formatN)clonercontiguous_formatr set_state)rrnew_state_copys r set_rng_stater&.s:__53J_KKN  **>:::::rseedctjjsdSt|}t |dS)zbSets the seed for generating random numbers. Args: seed (int): The desired seed. N)rrrrr manual_seed)r's r r)r)<sA 8  t99D  ,,T22222rcFtdS)z?Sets the seed for generating random numbers to a random number.N)rr'rrr r'r'Ls   %%'''''rcBtjdS)zReleases all unoccupied cached memory currently held by the caching allocator so that those can be used in other GPU applications. N)rr_mps_emptyCacherrr empty_cacher-Qs Hrct|tstd|dks|dkrtd|dtj|dS)aSet memory fraction for limiting process's memory allocation on MPS device. The allowed value equals the fraction multiplied by recommended maximum device memory (obtained from Metal API device.recommendedMaxWorkingSetSize). If trying to allocate more than the allowed value in a process, it will raise an out of memory error in allocator. Args: fraction(float): Range: 0~2. Allowed memory equals total_memory * fraction. .. note:: Passing 0 to fraction means unlimited allocations (may cause system failure if out of memory). Passing fraction greater than 1.0 allows limits beyond the value returned from device.recommendedMaxWorkingSetSize. z3Invalid type for fraction argument, must be `float`rzInvalid fraction value: z. Allowed range: 0~2N) isinstancefloat TypeError ValueErrorrr_mps_setMemoryFraction)fractions r set_per_process_memory_fractionr6Xsm" h & &OMNNN!||x!||RHRRRSSS H##H-----rc>tjS)zReturns the current GPU memory occupied by tensors in bytes. .. note:: The returned size does not include cached allocations in memory pools of MPSAllocator. )rr_mps_currentAllocatedMemoryrrr current_allocated_memoryr9qs 8 / / 1 11rc>tjS)zReturns total GPU memory allocated by Metal driver for the process in bytes. .. note:: The returned size includes cached allocations in MPSAllocator pools as well as allocations from MPS/MPSGraph frameworks. )rr_mps_driverAllocatedMemoryrrr driver_allocated_memoryr<{s 8 . . 0 00rc>tjS)zReturns recommended max Working set size for GPU memory in bytes. .. note:: Recommended max working set size for Metal. returned from device.recommendedMaxWorkingSetSize. )rr_mps_recommendedMaxMemoryrrr recommended_max_memoryr?s 8 - - / //rc&tdkS)Nr)rrrr is_availablerAs >>A r)profiler)Event)rrr)r'r&rr-r6r9r<rDrCr?rA)r N)r)!__doc__typingrrrgetattrr_is_in_bad_forkr Generator__annotations__rrrrstrrrr&r)r'r-r6r9r<r?boolrArCeventrD__all__rrr rPsG  '%($9==II-1*111"EH$6""""CcCCCC ---- 44%S%, 674F4444@E ; ; ;$S#u|%;< ;  ; ; ; ; 3c 3d 3 3 3 3 (((( ....22#22221111100000d   r