Ng6< dZddlmZddlmZmZmZmZddlZddl m Z ddl m Z m Z ddlmZmZmZmZmZmZddlmZdd lmZdd lmZdd lmZmZd gZGd de jZ Gdde jZ!Gdde jZ"Gdde jZ#Gdd e jZ$d%dZ%d&dZ&ee&dde&de&de&de&dde&dddZ'ed%de$fd Z(ed%de$fd!Z)ed%de$fd"Z*ed%de$fd#Z+ed%de$fd$Z,dS)'aPytorch impl of Aligned Xception 41, 65, 71 This is a correct, from scratch impl of Aligned Xception (Deeplab) models compatible with TF weights at https://github.com/tensorflow/models/blob/master/research/deeplab/g3doc/model_zoo.md Hacked together by / Copyright 2020 Ross Wightman )partial)ListDictTypeOptionalNIMAGENET_INCEPTION_MEANIMAGENET_INCEPTION_STD)ClassifierHead ConvNormActDropPathPadType create_conv2dget_norm_act_layer) to_3tuple)build_model_with_cfg)checkpoint_seq)register_modelgenerate_default_cfgsXceptionAlignedceZdZddddejejfdededededed ed eej d eej ffd Z d Z xZ S)SeparableConv2drin_chsout_chs kernel_sizestridedilationpadding act_layer norm_layerc tt|||_||_t ||||||d|_|||_| |dntj |_ t ||d|_ |||_ | |dntj |_ dS)NTrr!r depthwiseinplacerr)superr__init__rr rconv_dwbn_dwnnIdentityact_dwconv_pwbn_pwact_pw) selfrrrrr r!r"r# __class__s X/var/www/html/ai-engine/env/lib/python3.11/site-packages/timm/models/xception_aligned.pyr+zSeparableConv2d.__init__s ot$$--///&  % FKh$@@@  Z'' 1:1Fii----BKMM %VW!DDD Z(( 1:1Fii----BKMM c||}||}||}||}||}||}|SN)r,r-r0r1r2r3r4xs r6forwardzSeparableConv2d.forward4sa LLOO JJqMM KKNN LLOO JJqMM KKNNr7) __name__ __module__ __qualname__r.ReLU BatchNorm2dintrrModuler+r< __classcell__r5s@r6rrs !!)+*,.ZZZZ Z  Z  ZZBIZRYZZZZZZ6r7rceZdZddddejejdfdedededed ed ed eej d eej d e ffd Z dZ xZ S)PreSeparableConv2drrrTrrrrr r!r"r# first_actc Ftt|t||} ||_||_| r | |dnt j|_t||||||d|_ t||d|_ dS)Nr"Tr'r%rr)) r*rGr+rrr r.r/normrr,r1) r4rrrrr r!r"r#rHnorm_act_layerr5s r6r+zPreSeparableConv2d.__init__?s  $''00222+J)LLL&  r?r.r@rArBrrrCboolr+r<rDrEs@r6rGrG>s !!)+*,."EEEE E  E  EEBIERYEEEEEEE4r7rGceZdZdddddejddfdededed ed ed ed ed eej de eej de ej ffd Z dZ xZ S)XceptionModulerrTFNrrrr pad_typestart_with_reluno_skipr"r# drop_pathc tt|t|}||_|d|_||_|s6|j|jks|dkr t||jd|| d|_nd|_|rdn|} tj |_ tdD]} |r/|j d| dz|| dk|j d | dzt||| d| d kr|nd||| | || }| |_dS) NrF)rr# apply_actractrr'conv)rr r!r"r#)r*rPr+r in_channels out_channelsrSr shortcutr. Sequentialstackrange add_modulerrT)r4rrrr rQrRrSr"r#rTseparable_act_layerir5s r6r+zXceptionModule.__init__as nd##,,...G$$!#BK  !D-1AAAVq[[')1V ^ceeeDMM!DM&5Ddd9]__ q  A O %%mAEmmYYq1u5M5M5MNNN J ! !.Q../ AQffAPXbj-*3F3F3F G G GQZFF"r7c|}||}|j||}|js!|j||}||z}|Sr9)r_r]rSrTr4r;skips r6r<zXceptionModule.forwards` JJqMM = $==&&D| ~)NN1%%DAr7r=r>r?r.r@rBrrNrrCrr+r<rDrEs@r6rPrP`s  "$(!)+48-1"#"#"#"# "#  "#  "#""#"#BI"#!bi1"#  *"#"#"#"#"#"#H       r7rPceZdZddddejddfdedededed ed ed eej d e eej d e ej ffd Z dZ xZ S)PreXceptionModulerrFNrrrr rQrSr"r#rTc tt|t|}||_|d|_||_|s4|j|jks|dkrt||jd||_ntj |_t|||d|_ tj |_tdD]S} |jd| dzt#||| d| d kr|nd||||| d k || }T| |_dS) NrVr)rrJTr'rrYrZr)rr r!r"r#rH)r*rir+rr[r\rSrr]r.r/rrKr^r_r`rarGrT) r4rrrr rQrSr"r#rTrcr5s r6r+zPreXceptionModule.__init__sZ &&//111G$$!#BK  *D-1AAAVq[[)&$2CQvVVVDMMKMMDMG&zYGGGX\]]] ]__ q A J ! !.Q..2D !"avvQ! #%a% 3 3 3   QZFF"r7c||}|}||}|js4|j||}|||z}|Sr9)rKr_rSrTr]res r6r<zPreXceptionModule.forwardsc IIaLL JJqMM| (~)NN1%%DMM$'''Ar7rgrEs@r6riris  "!)+48-1&#&#&#&# &#  &#  &#&#BI&#!bi1&#  *&#&#&#&#&#&#Pr7ricveZdZdZddddejejdddf deed e d e d e d e d e ej de ej de de deffd ZejjddZejjddZejjdej fdZd d e deefdZdZdde fdZdZxZS)!rzModified Aligned Xception r Favg block_cfg num_classesin_chans output_stridepreactr"r# drop_ratedrop_path_rate global_poolc tt||dvsJ||_||_d|_t ||} tjt|dfddd| |rtdddd ntddd d| g|_ d } d} g|_ tj|_ |rtnt}t!|}d }t#|D]\}}| |z|d z z }|d krt%|nd|d <| |d <|dd krl|rd|dnd|d}|xj t t'|dd| |gz c_ | |dz}||kr| |dz} d |d<n|} |j t+||di|| |j dj|_|d z }|xj t |j| dt+t!|j d z zgz c_ |r |dntj|_|j|_t7|j|| ||_dS)N)rnF)r"r#rnrrZ)rr@rrrorTr rzblocks.z .stack.conv2z .stack.act3r)num_chs reductionmodulerVTr') in_featuresrr pool_typerv)rnr|)r*rr+rrrvgrad_checkpointingdictr.r^r rstem feature_infoblocksrirPlen enumerater rrastrr\ num_featuresr/rXhead_hidden_sizer head)r4rqrrrsrtrur"r#rvrwrx layer_args curr_dilation curr_stride module_fnnet_num_blocks net_block_idxrcb block_dprname next_strider5s r6r+zXceptionAligned.__init__s ot$$--/// ++++&""'I*EEE M " L!A L L L L>D GM"ba : : : :  FAa F F: F F$     moo )/C%%^ Y i((  DAq&6.1:LMI4=NNXi000AkN)AjM{Q4:X00000@X!@X@X@X!!d9Qy\3J3J23NZenr&s&s&s%tt!!)AhK7 ..!Qx[0M"#AhKK"-K K " "3q6699+G+Gq+GJ+G+G H H H $ B |j||dS)N)r)rreset)r4rrrxs r6reset_classifierz XceptionAligned.reset_classifiers   {;;;;;r7c||}|jr4tjst |j|}n||}||}|Sr9)rrtorchjit is_scriptingrrrXr:s r6forward_featuresz XceptionAligned.forward_featuressg IIaLL  " 59+A+A+C+C t{A..AA AA HHQKKr7 pre_logitsc^|r|||n||S)N)r)r)r4r;rs r6 forward_headzXceptionAligned.forward_head!s-6@Rtyyzy222diiPQllRr7cZ||}||}|Sr9)rrr:s r6r<zXceptionAligned.forward$s-  ! !! $ $   a r7F)Tr9)r=r>r?__doc__r.r@rArrrBrNrrCfloatrr+rrignorerrrrrrrr<rDrEs@r6rrs $!# )+*,.!$&$; ; Dz; ;  ;  ;  ; BI; RY; ; "; ; ; ; ; ; ; z Y     Y)))) Y <RRRJ  X Xz XT*=W=WPV=W=W X XXr7c ltdddtdddtdddgtdddgdztdd dtd d dd }t|d ttjdd}t dd|it|fi|S)z- Modified Aligned Xception-65 w/ Pre-Act r|rrZrrrrr{rrrT)rrrrSrrrr xception65pr)rrrs r6rrs BA... CQ/// CQ///  sC 2 2 2 3b 8  C!21===  D"4QMMM IDWR^QU`b5c5c5ceeeJ  X Xz XT*=W=WPV=W=W X XXr7r)r)-r functoolsrtypingrrrrrtorch.nnr. timm.datar r timm.layersr r r rrrtimm.layers.helpersr_builderr _manipulater _registryrr__all__rCrrGrPrirrr default_cfgsrrrrrrr7r6rs------------ EEEEEEEEiiiiiiiiiiiiiiii))))))******''''''<<<<<<<<  #####bi###LD.....RY...b11111 111hbbbbbbibbbJ%$4 $111$111$111 D!D&& *XXoXXXX$XXoXXXX$XXoXXXX(YYYYYY$YYYYYYYYr7