U ʹj6@sdZddlmZddlmZddlmZmZmZddl Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdeeeeeed ddZdddZdeeeeeeedddZGddde jZGddde jZdS)zV Classifier head and layer factory Hacked together by / Copyright 2020 Ross Wightman ) OrderedDict)partial)OptionalUnionCallableN) functional)SelectAdaptivePool2d) get_act_layer)get_norm_layeravgF) num_features num_classes pool_typeuse_conv input_fmtcCsD| }|s"|dks|stdd}t|||d}||}||fS)NrzUPooling can only be disabled if classifier is also removed or conv classifier is usedF)rflattenr)AssertionErrorr feat_mult)r rrrrZflatten_in_pool global_poolnum_pooled_featuresrU/var/www/html/bwave/python/venv/lib/python3.8/site-packages/timm/layers/classifier.py _create_pools rcCs>|dkrt}n(|r*tj||ddd}ntj||dd}|S)NrrT)bias)nnIdentityConv2dLinear)r rrfcrrr _create_fc's  r NCHW)r rrrr drop_ratec CsHt|||||d\}}t|||d}|dk r@t|} || |fS||fS)Nrrr)rr rDropout) r rrrrr"rrrZdropoutrrrcreate_classifier1s    r&csLeZdZdZdeeeeeedfdd Zdd d Z ded d dZ Z S)ClassifierHeadz;Classifier head w/ configurable global pooling and dropout.r Fr!) in_featuresrrr"rrc sntt|||_||_||_t|||||d\}}||_t ||_ ||_ |r`|r`t dnt |_dS)a. Args: in_features: The number of input features. num_classes: The number of classes for the final classifier layer (output). pool_type: Global pooling type, pooling disabled if empty string (''). drop_rate: Pre-classifier dropout rate. r#rN)superr'__init__r)rrr&rrr%droprFlattenrr) selfr)rrr"rrrr __class__rrr+Ns  zClassifierHead.__init__NcCsz|dk rT||jjkrTt|j|||j|jd\|_|_|jrH|rHtdnt |_ n"|j|j }t |||jd|_dS)N)rrrrr$) rrr&r)rrrrr-rrrr )r.rrrrrrresetos zClassifierHead.reset pre_logitscCs6||}||}|r"||S||}||SN)rr,rrr.xr3rrrforwards     zClassifierHead.forward)r r(Fr!)N)F) __name__ __module__ __qualname____doc__intstrfloatboolr+r1r7 __classcell__rrr/rr'Ks! r'c s^eZdZdeeeeeeeeefeeefdfdd Z dd d Z de d d dZ Z S)NormMlpClassifierHeadNr r( layernorm2dtanh)r)r hidden_sizerr" norm_layer act_layerc st||_||_||_| |_t|}t|}|jrHtt j ddnt j }t |d|_ |||_|rrt dnt |_|rt td|||fd|fg|_||_n t |_t ||_|dkr||j|nt |_dS)a Args: in_features: The number of input features. num_classes: The number of classes for the final classifier layer (output). hidden_size: The hidden size of the MLP (pre-logits FC layer) if not None. pool_type: Global pooling type, pooling disabled if empty string (''). drop_rate: Pre-classifier dropout rate. norm_layer: Normalization layer type. act_layer: MLP activation layer type (only used if hidden_size is not None). rZ kernel_sizerrZactrN)r*r+r)rDr rr r rrrrr rnormr-rrZ Sequentialrr3r%r,r) r.r)rrDrr"rErF linear_layerr/rrr+s(       zNormMlpClassifierHead.__init__c Cs|dk r,t|d|_|r"tdnt|_|j|_|jrLttj ddntj }|j rt |j jtj rn|jrt |j jtj r|jrtJ||j|j }|j|j jj|jj|j|j jj||j _W5QRX|dkr||j|nt|_dS)NrHrrGr)r rrr-rrZ is_identityrrrrrD isinstancer3rtorchZno_gradr)weightZcopy_Zreshapeshaperr )r.rrrJZnew_fcrrrr1s"   zNormMlpClassifierHead.resetFr2cCsH||}||}||}||}||}|r:|S||}|Sr4)rrIrr3r,rr5rrrr7s      zNormMlpClassifierHead.forward)Nr r(rBrC)N)F)r8r9r:r<rr=r>rrr+r1r?r7r@rrr/rrAs   + rA)r FN)F)r Fr!N)r; collectionsr functoolsrtypingrrrrLZtorch.nnrrFZadaptive_avgmax_poolr Z create_actr Z create_normr r<r=r?rr r>r&Moduler'rArrrrsD          ?