Ng* jUdZddlmZmZmZmZmZmZddlZddl m Z ddl m cm Z ddlmZmZddlmZddlmZddlmZdd lmZmZd gZgd gd gd gddZeeeeeeffed<eGdde jZ Gdd e jZ!dZ"dede#dede!fdZ$d(dZ%ee%de%de%de%de%de%de%de%ddZ&ed)de#dede!fd Z'ed)de#dede!fd!Z(ed)de#dede!fd"Z)ed)de#dede!fd#Z*ed)de#dede!fd$Z+ed)de#dede!fd%Z,ed)de#dede!fd&Z-ed)de#dede!fd'Z.dS)*zVGG Adapted from https://github.com/pytorch/vision 'vgg.py' (BSD-3-Clause) with a few changes for timm functionality. Copyright 2021 Ross Wightman )AnyDictListOptionalUnioncastNIMAGENET_DEFAULT_MEANIMAGENET_DEFAULT_STD)ClassifierHead)build_model_with_cfg)register_notrace_module)register_modelgenerate_default_cfgsVGG) @Mrrrrrrrr)rrrrrrrrrrrrrrr)rrrrrrrrrrrrrrrrrr)rrrrrrrrrrrrrrrrrrrrr)vgg11vgg13vgg16vgg19cfgscVeZdZ d dedejd ejffd Zd ZxZS) ConvMlpr?皙?N drop_rate act_layer conv_layercJtt|||_t ||z}||||d|_|d|_tj||_ |||dd|_ |d|_ dS)NT)biasr ) superr__init__input_kernel_sizeintfc1act1nnDropoutdropfc2act2) self in_features out_features kernel_size mlp_ratior#r$r% mid_features __class__s K/var/www/html/ai-engine/env/lib/python3.11/site-packages/timm/models/vgg.pyr)zConvMlp.__init__"s gt%%'''!,<)344 :k<4PPPIdOO Jy)) :lL!$GGGIdOO c|jd|jks|jd|jkrUt|j|jdt|j|jdf}tj||}||}||}||}||}| |}|S)N) shaper*maxFadaptive_avg_pool2dr,r-r0r1r2)r3x output_sizes r:forwardzConvMlp.forward5s 72;/ / /172;AW3W3Wt5qwr{CCSI_abahikalEmEmnK%a55A HHQKK IIaLL IIaLL HHQKK IIaLLr;)rrr r!r"NN) __name__ __module__ __qualname__floatr.Moduler)rE __classcell__r9s@r:rrs "#'$($$  $y$ $$$$$$&       r;rceZdZddddejejdddf deed ed ed ed e d ej dej dej de de ddffd Z e jjd dZe jjd!dZe jjdej fdZd"d edee fdZde jde jfdZd de jdefdZde jde jfdZd#dZxZS)$r r!Navggcfg num_classesin_chans output_strider7r$r% norm_layer global_poolr#returnc tt||dksJ||_| |_d|_|du|_g|_|} d} tj } g}|D]}t|dz }|dkrD|j t| | d||| ddgz }| dz} ^tt|}|| |d d }||||||d gz }n|||d gz }|} tj||_|j t| | dt|dz | |_d |_t'| |jd|| |||_t+|j|| | |_|dS)NrPFr rz features.)num_chs reductionmodule)r6striderO)r6paddingT)inplacerr )r7r#r$r%) pool_typer#)r(rr)rSr#grad_checkpointinguse_norm feature_infor. MaxPool2dlenappenddictrr+ Sequentialfeatures num_featureshead_hidden_sizer pre_logitsr head_initialize_weights)r3rRrSrTrUr7r$r%rVrWr#prev_chs net_stride pool_layerlayersvlast_idxconv2dr9s r:r)z VGG.__init__Ds3 c4!!###""""&""'"$.  \ "$  A6{{QHCxx!((h*]siq]s]s)t)t)tuuu::!A>>>??a aLL#HaQJJJ)vzz!}}ii6M6M6MNNFFvyy'>'>'>??F v.    h*UradekalalopapUrUr!s!s!sttt$ $!   ! !   #  ! !        """""r;Fc$tddS)Nz ^features\.0z^features\.(\d+))stemblocks)rh)r3coarses r: group_matcherzVGG.group_matchers1DEEEEr;Tc|r JddS)Nz$gradient checkpointing not supported)r3enables r:set_grad_checkpointingzVGG.set_grad_checkpointingsAAAAAAAAr;c|jjSN)rnfc)r3s r:get_classifierzVGG.get_classifiers y|r;cJ||_|j||dSr)rSrnreset)r3rSrWs r:reset_classifierzVGG.reset_classifiers&&  [11111r;rCc0||}|Sr)rjr3rCs r:forward_featureszVGG.forward_featuress MM!  r;rmc||}|r|||n||S)N)rm)rmrn)r3rCrms r: forward_headzVGG.forward_heads> OOA  6@Rtyyzy222diiPQllRr;cZ||}||}|Sr)rrrs r:rEz VGG.forwards-  ! !! $ $   a r;c|D];}t|tjrTtj|jdd|j%tj|jdqt|tj rKtj|jdtj|jdt|tj rKtj |jddtj|jd=dS)Nfan_outrelu)mode nonlinearityrr g{Gz?) modules isinstancer.Conv2dinitkaiming_normal_weightr' constant_ BatchNorm2dLinearnormal_)r3ms r:rozVGG._initialize_weightss  - -A!RY'' -''yv'VVV6%G%%afa000Ar~.. -!!!(A...!!!&!,,,,Ary)) -!T222!!!&!,,, - -r;F)Tr)rXN)rFrGrHr.ReLUrrrr+rIrJstrr)torchjitignorer{rrrrTensorrboolrrErorKrLs@r:rrBs $!#"#%7$&I$($!<#<#c<#<# <#  <#  <#y<# <# <#<#<# <#<#<#<#<#<#| YFFFF YBBBB Y 22C2hsm2222%,5<SSelSSSSS%, - - - - - - - -r;c@i}|D]\}}|}|dd}|dd}|dd}d|vr|dd d d }d |vr|dd d d }|||<|S)zJ convert patch embedding weight from manual patchify + linear proj to convz classifier.0zpre_logits.fc1z classifier.3zpre_logits.fc2z classifier.6head.fczclassifier.0.weightr>rr zclassifier.3.weightrr )itemsreplacereshape) state_dictout_dictkrtk_rs r: _filter_fnrsH  ""  1kk.*:;;kk.*:;;kk.)44 A % % "c1a((A A % % "dAq))A Or;variant pretrainedkwargsrXc |dd}|dd}tt||ft|t d|t d|}|S)N_r out_indices)rr r]rOT)flatten_sequentialr) model_cfg feature_cfgpretrained_filter_fn)splitpoprrrrhr)rrrrRrmodels r: _create_vggrs{ --  Q C**],>??K   s)DkJJJ'      E Lr;c 4|dddddttddd |S) NrN)rOr)r r g?bilinearz features.0r) urlrS input_size pool_sizecrop_pct interpolationmeanstd first_conv classifierr )rrs r:_cfgrs5=vJ%.B")      r;ztimm/) hf_hub_id)z vgg11.tv_in1kz vgg13.tv_in1kz vgg16.tv_in1kz vgg19.tv_in1kzvgg11_bn.tv_in1kzvgg13_bn.tv_in1kzvgg16_bn.tv_in1kzvgg19_bn.tv_in1kFc 6tdi|}tdd|i|S)zVGG 11-layer model (configuration "A") from `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rrr})rrhrrr model_argss r:rr, J  D D: D D DDr;c Ntddtji|}tdd|i|S)zVGG 11-layer model (configuration "A") with batch normalization `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rVvgg11_bnrr})rrhr.rrrs r:rr7 :::6::J  G Gj GJ G GGr;c 6tdi|}tdd|i|S)zVGG 13-layer model (configuration "B") `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rrr})rrrs r:rrrr;c Ntddtji|}tdd|i|S)zVGG 13-layer model (configuration "B") with batch normalization `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rVvgg13_bnrr})rrrs r:rrrr;c 6tdi|}tdd|i|S)zVGG 16-layer model (configuration "D") `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rrr})rrrs r:rr rr;c Ntddtji|}tdd|i|S)zVGG 16-layer model (configuration "D") with batch normalization `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rVvgg16_bnrr})rrrs r:rrrr;c 6tdi|}tdd|i|S)zVGG 19-layer model (configuration "E") `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rrr})rrrs r:rrrr;c Ntddtji|}tdd|i|S)zVGG 19-layer model (configuration 'E') with batch normalization `"Very Deep Convolutional Networks For Large-Scale Image Recognition" `._ rVvgg19_bnrr})rrrs r:rr$rr;)rr)/__doc__typingrrrrrrrtorch.nnr.torch.nn.functional functionalrA timm.datar r timm.layersr _builderr _features_fxr _registryrr__all__rrr+__annotations__rJrrrrrr default_cfgsrrrrrrrrr}r;r:rs:999999999999999 AAAAAAAA&&&&&&******111111<<<<<<<< 'N M M V V V e e e t t t **d3U38_% %&biDi-i-i-i-i-")i-i-i-X     $ # #     %$TG,,,TG,,,TG,,,TG,,,w///w///w///w/// & &   EEdEcEcEEEEHHHHHHHHEEdEcEcEEEEHHHHHHHHEEdEcEcEEEEHHHHHHHHEEdEcEcEEEEHHHHHHHHHHr;