gBddlmZddlmZddlmZerddlmZd d Zd S) ) annotations) TYPE_CHECKING)is_torch_available)nnmodule nn.ModulereturnboolctsdSddl}t||jjjpt |ddS)NFr_is_fsdp_managed_module)rtorch.distributed.fsdp isinstance distributedfsdpFullyShardedDataParallelgetattr)rtorchs Z/var/www/html/ai-engine/env/lib/python3.11/site-packages/transformers/integrations/fsdp.pyis_fsdp_managed_modulersX   u!!!! fe/4M N N RY)5SSN)rr r r ) __future__rtypingrutilsrrrrrrrsw#""""" &&&&&&r