קgUddlmZmZmZddlZddlmcmZddlm Z gZ ee e d<ej jGddZdS))DictListOptionalN)Tensor__all__cveZdZ ddeededed ed ed ed ed efdZdeeefdZ dS)_FunctionalAdadelta??ư>Fparamslrrhoeps weight_decayforeachmaximize_allow_empty_param_listc D||||d|_||_||_t|dkr|st dd|i|_t jtt j ttt j ffi|_ dS)N)rrrrrz%optimizer got an empty parameter listr) defaultsrrlen ValueError param_grouptorchjitannotaterrstrstate) selfrrrrrrrrs g/var/www/html/ai-engine/env/lib/python3.11/site-packages/torch/distributed/optim/functional_adadelta.py__init__z_FunctionalAdadelta.__init__s(       v;;!  $; DEE E%f-Y''U\4U\@Q;R-R(SUWXX gradientscf|jd}g}g}g}g}g}|jd}|jd} |jd} |jd} t|t|kr6tddt|dzd t|zd } t ||D]%\} }|| t j| z} || ||| |jvrti|j| <|j| }t j d |d <t j | t j |d<t j | t j |d<|j| }||d||d||d 't j 5tj||||||| | | |j|j|  ddddS#1swxYwYdS)NrrrrrzEthe gradients passed in does not equal to the size of the parameters!zParams length: z. zGradients length: Fr step) memory_format square_avg acc_delta)rrrrrr has_complex)rrrrzipr is_complexappendrtensor zeros_likepreserve_formatno_gradFadadeltarr)r r$rparams_with_gradgrads square_avgs acc_deltas state_stepsrrrrr*paramgradientrs r!r&z_FunctionalAdadelta.step4s!(+   ]4 mE"mE"}^4 v;;#i.. ( (W3CKK33347s9~~778   "6955 2 2OE8#u/666  ''... X&&& **(*DJu% Ju-E$)L$5$5E&M*/*:U-B+++E,'*/)9U-B***E+& 5)""5#6777!!% "4555""5=111 ]__   J ) '                      s.+H&&H*-H*N)r r r r FFF) __name__ __module__ __qualname__rrfloatboolr"rr&r#r!r r s !(-YYV Y Y Y  Y  YYY"&YYYY:7d8F#34777777r#r )typingrrrrtorch.optim._functionaloptim _functionalr2rrr__annotations__rscriptr r@r#r!rGs''''''''''' #########cUUUUUUUUUUr#