קgUddlmZmZmZddlZddlmcmZddlm Z gZ ee e d<ej jGddZdS))DictListOptionalN)Tensor__all__ceZdZ ddeededed ed ed ed ed ededefdZdeeefdZ dS)_FunctionalRMSprop{Gz?Gz?:0yE>Fparamslralphaeps weight_decaymomentumcenteredforeachmaximize_allow_empty_param_listc T|||||d|_||_||_| |_t |dkr| st dd|i|_tj ttj tttj ffi|_ dS)N)rrrrrrz%optimizer got an empty parameter listr)defaultsrrrlen ValueError param_grouptorchjitannotaterrstrstate) selfrrrrrrrrrrs f/var/www/html/ai-engine/env/lib/python3.11/site-packages/torch/distributed/optim/functional_rmsprop.py__init__z_FunctionalRMSprop.__init__s(    !    v;;!  $; DEE E%f-Y''U\4U\@Q;R-R(SUWXX gradientscD|jd}g}g}g}g}g}g}|jd} |jd} |jd} |jd} |jd} t|t|kr6tddt|d zd t|zd }t ||D]}\}}|t|t j|z}||||||jvri|j|<|j|}t j d |d <t j |t j |d<| dkr#t j |t j |d<|j r#t j |t j |d<|j|}||d| dkr||d|j r||d||d t j 5tj||||||| | | | | |j |j|j|ddddS#1swxYwYdS)NrrrrrrzEthe gradients passed in does not equal to the size of the parameters!zParams length: z. zGradients length: Fr step) memory_format square_avgrmomentum_buffergrad_avg) rrrrrrrr has_complex)rrrrzipr is_complexappendr!tensor zeros_likepreserve_formatrno_gradFrmsproprr)r"r&rparams_with_gradgrads square_avgs grad_avgsmomentum_buffer_list state_stepsrrrrrr-paramgradientr!s r#r(z_FunctionalRMSprop.step8s)!(+  ! ]4  g&mE"=,}^4 v;;#i.. ( (W3CKK33347s9~~778   "6955 2 2OE8#u/666  ''... X&&& **(*DJu% Ju-E$)L$5$5E&M*/*:U-B+++E,' !||383C!1F444/0},1,<!1F---j) 5)""5#6777a<<(//6G0HIII=8$$U:%6777""5=111 ]__   I $)! '                      s3JJJN) r r r r r FFFF) __name__ __module__ __qualname__rrfloatboolr$rr(r%r#r r s !(-YYV Y Y Y  Y  YYYYY"&YYYYBFd8F#34FFFFFFr%r )typingrrrrtorch.optim._functionaloptim _functionalr5rrr __annotations__rscriptr rDr%r#rKs''''''''''' #########chhhhhhhhhhr%