U ʹj; @sTddlmZddlmZmZmZmZmZddlZddlm Z m Z ddl m Z ddlmZmZddlmZdd lmZdd lmZd d lmZmZmZd d lmZd dlmZmZdddddddddg Z Gddde j!Z"Gddde j#Z$GdddZ%Gddde j#Z&ee%e'eee(ee&dd d!Z)d"ed#d$d%Z*Gd&ddeZ+Gd'ddeZ,Gd(ddeZ-Gd)ddeZ.eed*e+j/fd+dd,d-ee+e(ee&d.d/dZ0eed*e,j/fd+dd,d-ee,e(ee&d.d0dZ1eed*e-j/fd+dd,d-ee-e(ee&d.d1dZ2eed*e.j/fd+dd,d-ee.e(ee&d.d2dZ3dS)3)partial)AnyCallableListOptionalSequenceN)nnTensor) functional)Conv2dNormActivationPermute)StochasticDepth)ImageClassification)_log_api_usage_once)register_modelWeights WeightsEnum)_IMAGENET_CATEGORIES)_ovewrite_named_paramhandle_legacy_interfaceConvNeXtConvNeXt_Tiny_WeightsConvNeXt_Small_WeightsConvNeXt_Base_WeightsConvNeXt_Large_Weights convnext_tinyconvnext_small convnext_baseconvnext_largec@seZdZeedddZdS) LayerNorm2dxreturncCs>|dddd}t||j|j|j|j}|dddd}|S)Nrr r)ZpermuteFZ layer_normZnormalized_shapeweightbiasepsselfr#r,Z/var/www/html/bwave/python/venv/lib/python3.8/site-packages/torchvision/models/convnext.pyforwardszLayerNorm2d.forwardN)__name__ __module__ __qualname__r r.r,r,r,r-r!sr!csHeZdZd eeeedejfddfdd Ze e dddZ Z S) CNBlockN.) layer_scalestochastic_depth_prob norm_layerr$c st|dkr ttjdd}ttj||dd|ddtdddd g||tj|d |dd t tjd ||dd tddd dg|_ t t |d d ||_t|d |_dS) Nư>r)r%T) kernel_sizepaddinggroupsr(rr r)Z in_featuresZ out_featuresr(row)super__init__rr LayerNorm SequentialConv2dr LinearZGELUblock ParametertorchZonesr3rstochastic_depth)r+dimr3r4r5 __class__r,r-r?'s  zCNBlock.__init__)inputr$cCs&|j||}||}||7}|SN)r3rDrG)r+rKresultr,r,r-r.>s zCNBlock.forward)N) r/r0r1floatrrrModuler?r r. __classcell__r,r,rIr-r2&sr2c@s2eZdZeeeeddddZedddZdS) CNBlockConfigN)input_channels out_channels num_layersr$cCs||_||_||_dSrL)rRrSrT)r+rRrSrTr,r,r-r?GszCNBlockConfig.__init__)r$cCs:|jjd}|d7}|d7}|d7}|d7}|jf|jS)N(zinput_channels={input_channels}z, out_channels={out_channels}z, num_layers={num_layers}))rJr/format__dict__)r+sr,r,r-__repr__Qs  zCNBlockConfig.__repr__)r/r0r1intrr?strrZr,r,r,r-rQEs  rQc sreZdZdeeeeeeede j feede j fe ddfdd Z e e d d d Ze e d d d ZZS)rr6N.) block_settingr4r3 num_classesrDr5kwargsr$c stt||s tdn$t|trjsz%ConvNeXt.__init__..z/The block_setting should be List[CNBlockConfig]r6r7rr%r<T)r9strider:r5Zactivation_layerr(css|] }|jVqdSrL)rT)rccnfr,r,r- sz$ConvNeXt.__init__..g?rr )r9reg{Gz?)Zstd)!r>r?r ValueErrorrbrall TypeErrorr2rr!rRappendr sumrangerTrrArSrBfeaturesZAdaptiveAvgPool2davgpoolZFlattenrC classifiermodulesinitZ trunc_normal_r'r(Zzeros_)r+r_r4r3r`rDr5raZlayersZfirstconv_output_channelsZtotal_stage_blocksZstage_block_idrfZstage_Zsd_probZ lastblockZlastconv_output_channelsmrIr,r-r?[sn            zConvNeXt.__init__r"cCs"||}||}||}|SrL)rorprqr*r,r,r- _forward_impls   zConvNeXt._forward_implcCs ||SrL)rvr*r,r,r-r.szConvNeXt.forward)r]r6r^NN)r/r0r1rrQrNr[rrrrOrr?r rvr.rPr,r,rIr-rZs"N)r_r4weightsprogressrar$cKsR|dk rt|dt|jdt|fd|i|}|dk rN||j|dd|S)Nr` categoriesr4T)rxZ check_hash)rlenmetarZload_state_dictZget_state_dict)r_r4rwrxramodelr,r,r- _convnexts r}) r~zNhttps://github.com/pytorch/vision/tree/main/references/classification#convnexta These weights improve upon the results of the original paper by using a modified version of TorchVision's `new training recipe `_. )Zmin_sizeryZrecipeZ_docsc @s@eZdZedeedddeddddd id d d d ZeZdS)rz>https://download.pytorch.org/models/convnext_tiny-983f1562.pthZ crop_sizeZ resize_sizeiH< ImageNet-1KgzGT@gMbX X@zacc@1zacc@5gm@gV-G[@Z num_paramsZ_metricsZ_ops _file_sizeurlZ transformsr{N r/r0r1rrr _COMMON_META IMAGENET1K_V1DEFAULTr,r,r,r-rs c @s@eZdZedeedddeddddd id d d d ZeZdS)rz?https://download.pytorch.org/models/convnext_small-0c510722.pthrriHZrgClT@g)X@rg|?5^!@g"~g@rrNrr,r,r,r-rs c @s@eZdZedeedddeddddd id d d d ZeZdS)rz>https://download.pytorch.org/models/convnext_base-6075fbad.pthrrihGrgU@gHz7X@rg(\µ.@g/$!u@rrNrr,r,r,r-rs c @s@eZdZedeedddeddddd id d d d ZeZdS)rz?https://download.pytorch.org/models/convnext_large-ea097f82.pthrrri rg"~U@gX9v>X@rg|?5.A@gK@rrNrr,r,r,r-r s Z pretrained)rwT)rwrx)rwrxrar$cKsTt|}tdddtdddtdddtdddg}|dd }t||||f|S) aConvNeXt Tiny model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Tiny_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Tiny_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Tiny_Weights :members: `r% Nr4g?)rverifyrQpopr}rwrxrar_r4r,r,r-r!s      cKsTt|}tdddtdddtdddtdddg}|dd }t||||f|S) aConvNeXt Small model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Small_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Small_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Small_Weights :members: rrr%rrNr4g?)rrrQrr}rr,r,r-r@s      cKsTt|}tdddtdddtdddtdddg}|dd }t||||f|S) aConvNeXt Base model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Base_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Base_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Base_Weights :members: r%iirNr4?)rrrQrr}rr,r,r-ras      cKsTt|}tdddtdddtdddtdddg}|dd }t||||f|S) aConvNeXt Large model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Large_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Large_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Large_Weights :members: rrr%rirNr4r)rrrQrr}rr,r,r-r s      )4 functoolsrtypingrrrrrrFrr Ztorch.nnr r&Zops.miscr r Zops.stochastic_depthrZtransforms._presetsrutilsrZ_apirrr_metarZ_utilsrr__all__r@r!rOr2rQrrNboolr}rrrrrrrrrr r,r,r,r-s       Z  $$