Model card for eca nfnet l0.ra2 in1k A ECA NFNet Lite (Lightweight NFNet w/ ECA attention) image classification model. Trained in timm by Ross Wightman. Normalization Free Networks are (pre activation) ResNet like models without any normalization layers. Instead of Batch Normalization or alternatives, they use Scaled Weight Standardization and specifically placed scalar gains in residual path and at non linearities based on signal propagation analysis. Lightweight NFNets are timm specific variants that reduce the SE and bottleneck ratio from 0.5 0.25 (reducing widths) and use a smaller group size while maintaining the same depth. SiLU activations used instead of GELU. This NFNet variant also uses ECA (Efficient Channel Attention) instead of SE (Squeeze and Excitation). Model Details Model Type: Image classification / feature backbone Model Stats: Params (M): 24.1 GMACs: 4.4 Activations (M): 10.5 Image size: train = 224 x 224, test = 288 x 288 Papers: High Performance Large Scale Image Recognition Without Normalization: https://arxiv.org/abs/2102.06171 Characterizing signal propagation to close the performance gap in unnormalized ResNets: https://arxiv.org/abs/2101.08692 Original: h…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy