Ng%`dZddlmZddlmZmZddlmZddlm Z ddl m Z m Z ddl mZGd d ejZd(d Zd)dZe ededededddedddddedddddeddedddZe d(defdZe d(defd Ze d(defd!Ze d(defd"Ze d(defd#Ze d(defd$Ze d(defd%Ze d(defd&Zd'S)*a ResNeSt Models Paper: `ResNeSt: Split-Attention Networks` - https://arxiv.org/abs/2004.08955 Adapted from original PyTorch impl w/ weights at https://github.com/zhanghang1989/ResNeSt by Hang Zhang Modified for torchscript compat, and consistency with timm by Ross Wightman )nnIMAGENET_DEFAULT_MEANIMAGENET_DEFAULT_STD) SplitAttn)build_model_with_cfg)register_modelgenerate_default_cfgs)ResNetcjeZdZdZdZdddddddddddejejddddffd ZdZ d Z xZ S) ResNestBottleneckzResNet Bottleneck rN@Fc @tt|| dksJ|J|J|Jt||dz z|z}| p| } |r |dks| r|}d}nd}||_t j||dd|_|||_|d|_ |dkr| rt j d|d nd|_ |jdkrgt||d|| | |||| |_ t j|_t j|_t j|_nft j||d|| | |d |_ |||_| |nt j|_|d|_|dkr| st j d|d nd|_t j||d zdd|_||d z|_|d|_||_dS) NrgP@rF) kernel_sizebiasT)inplace)padding)rstriderdilationgroupsradix norm_layer drop_layer)rrrrrrr)superr__init__intrrConv2dconv1bn1act1 AvgPool2d avd_firstrconv2Identitybn2 drop_blockact2avd_lastconv3bn3act3 downsample)selfinplanesplanesrr/r cardinality base_widthavdr%is_first reduce_firstrfirst_dilation act_layerr attn_layeraa_layerr) drop_path group_width avd_stride __class__s O/var/www/html/ai-engine/env/lib/python3.11/site-packages/timm/models/resnest.pyrzResNestBottleneck.__init__sj, &&//111q    !!!   &J$4566D '38  FQJJ(JJFFJ Yx!%PPP :k**Id+++ CMPQ>>V_>aQ????ei :??"P^' 5U_lvxxxDJ{}}DH kmmDO DIIP^' %IIIDJ"z+..DH.8.Djjlll"+--DO! $///DIBLq..Yb. Q A>>>>hl Y{FQJAERRR :fQh''Id+++ $ct|jdd+tj|jjdSdS)Nweight)getattrr-rinitzeros_rC)r0s r@zero_init_lastz ResNestBottleneck.zero_init_lastWs< 48Xt , , 8 GNN48? + + + + + 9 8rAc`|}||}||}||}|j||}||}||}||}||}|j||}| |}| |}|j | |}||z }| |}|SN) r!r"r#r%r&r(r)r*r+r,r-r/r.)r0xshortcutouts r@forwardzResNestBottleneck.forward[sjjmmhhsmmiinn > %..%%Cjjoohhsmmooc""iinn = $--$$Cjjoohhsmm ? &q))H xiinn rA) __name__ __module__ __qualname____doc__ expansionrReLU BatchNorm2drrGrM __classcell__)r?s@r@rrsI g~)=%=%=%=%=%=%~,,,rArFc *tt||fi|SrI)r r )variant pretrainedkwargss r@_create_resnestrZxs,       rAc 4|dddddttddd |S) Ni)rr])r^g?bilinearzconv1.0fc) url num_classes input_size pool_sizecrop_pct interpolationmeanstd first_conv classifierr)rarYs r@_cfgrks5=vJ%.Bt      rAztimm/) hf_hub_id)rrm)rn)rlrcrd)r@ro) rpgJ +?bicubic)rlrcrdrerf)rrr) rsgV-?)rlrf)zresnest14d.gluon_in1kzresnest26d.gluon_in1kzresnest50d.in1kzresnest101e.in1kzresnest200e.in1kzresnest269e.in1kzresnest50d_4s2x40d.in1kzresnest50d_1s4x24d.in1kreturnc ttgddddddtddd  }td d |it|fi|S)z5 ResNeSt-14d model. Weights ported from GluonCV. )rrrrdeep TrrFrr5r%blocklayers stem_type stem_widthavg_downr4r3 block_args resnest14drX)rdictrrZrXrY model_kwargss r@rrk R$2STaTU;;;===L  _ _J _$|B^B^W]B^B^ _ __rAc ttgddddddtddd  }td d |it|fi|S)z5 ResNeSt-26d model. Weights ported from GluonCV. )rxrxrxrxrvrwTrrrxFryrz resnest26drX)rrrs r@rrrrAc ttgddddddtddd  }td d |it|fi|S)z ResNeSt-50d model. Matches paper ResNeSt-50 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'd' for deep stem, stem_width 32, avg in downsample. rrrrvrwTrrrxFryrz resnest50drX)rrrs r@rrsk  R$2STaTU;;;===L  _ _J _$|B^B^W]B^B^ _ __rAc ttgddddddtddd }td d |it|fi|S) z ResNeSt-101e model. Matches paper ResNeSt-101 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )rrrrvrTrrxFryrz resnest101erX)rrrs r@rrsk  R$2STaTU;;;===L  ` `Z `4 C_C_X^C_C_ ` ``rAc ttgddddddtddd }td d |it|fi|S) z ResNeSt-200e model. Matches paper ResNeSt-200 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r$rrvrTrrxFryrz resnest200erX)rrrs r@rrk R$2STaTU;;;===L  ` `Z `4 C_C_X^C_C_ ` ``rAc ttgddddddtddd }td d |it|fi|S) z ResNeSt-269e model. Matches paper ResNeSt-269 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r0rnrvrTrrxFryrz resnest269erX)rrrs r@rrrrAc ttgddddddtddd }td d |it|fi|S) z]ResNeSt-50 4s2x40d from https://github.com/zhanghang1989/ResNeSt/blob/master/ablation.md rrvrwT(rxrryrzresnest50d_4s2x40drX)rrrs r@rrk R$2STaTT:::<<rspAAAAAAAA!!!!!!******<<<<<<<<ccccc cccL%$!TG444!TG444tg... F444 HuT]___ HuT]___ $t ! ! ! $t ! ! !!&& ,``f``````f``````f````aavaaaaaavaaaaaavaaaahhfhhhhhhfhhhhhhrA