NgdZddlmZmZmZddlTddlTddlmZm Z de e j j vZde e j j vZde e j j vZd e e j j vZed!iderejned erejned erejned ejd ejd ejdejdejdejdededede de!derej"ne#derej$ne%de&Z'eerejne(erejne(erejne)erej"ne*erej$ne+e,Z-e-e'fZ.e.D]TZ/e/0de/1de/0de/1dUed!idere j2ne3d ere j2ne3d ere j4ne4d e j5d e j6d e j7de j8de9de j:de j;de<de=de>de?de@dere jAneBdere jCneDdeEde jFZGeere j2neHere j2neHere j4neIere jAneJere jCneKeLZMeMeGfZNeND]TZ/e/0de/1de/0de/1dUd"deeeOffdZPd"deee jQeOffdZRd#deee jQeOffd ZSdS)$zF Activation Factory Hacked together by / Copyright 2020 Ross Wightman )UnionCallableType)*) is_exportable is_scriptablesilu hardswish hardsigmoidmishswishrelurelu6 leaky_relueluceluselugelu gelu_tanh quick_gelusigmoidtanh hard_sigmoid hard_swish hard_mish)r rr rrrpreluidentitynamec|sdSt|tr|S|}ts$t s|t vr t |St |S)z Activation Function Factory Fetching activation fns by name with this function allows export or torch script friendly functions to be returned dynamically based on current config. N) isinstancerlowerrr _ACT_FN_ME_ACT_FN_DEFAULTrs R/var/www/html/ai-engine/env/lib/python3.11/site-packages/timm/layers/create_act.py get_act_fnr'[so t$!! ::<>r0)r)N)T__doc__typingrrr activationsactivations_meconfigrr dirtorchnn functional _has_silu_has_hardswish_has_hardsigmoid _has_mishdictFr rr rrrrrrrrrrrr rr rrr$swish_memish_mehard_sigmoid_me hard_swish_me hard_mish_mer#_ACT_FNSa setdefaultgetSiLUSwishMishReLUReLU6 LeakyReLUELUPReLUCELUSELUGELUGELUTanh QuickGELUSigmoidTanh Hardsigmoid HardSigmoid Hardswish HardSwishHardMishIdentityr,SwishMeMishMe HardSigmoidMe HardSwishMe HardMishMer+ _ACT_LAYERSr*r'Moduler-r4r0r(r&ris/)(((((((((00000000 cc%(-.. . EH$7 8 88 CC(;$<$<< cc%(-.. . $ '% (!&&5 &$   ''  ||     iz G #3D  -r||;  01 33ALLn 5 5666LLaeeL112222!!U8S=)!!!!$$$d29os23$$$$& # #5bi#!56 # # # # # #r(