Swin Transformer v2 (tiny sized model) Swin Transformer v2 model pre trained on ImageNet 1k at resolution 256x256. It was introduced in the paper Swin Transformer V2: Scaling Up Capacity and Resolution by Liu et al. and first released in this repository. Disclaimer: The team releasing Swin Transformer v2 did not write a model card for this model so this model card has been written by the Hugging Face team. Model description The Swin Transformer is a type of Vision Transformer. It builds hierarchical feature maps by merging image patches (shown in gray) in deeper layers and has linear computation complexity to input image size due to computation of self attention only within each local window (shown in red). It can thus serve as a general purpose backbone for both image classification and dense recognition tasks. In contrast, previous vision Transformers produce feature maps of a single low resolution and have quadratic computation complexity to input image size due to computation of self attention globally. Swin Transformer v2 adds 3 main improvements: 1) a residual post norm method combined with cosine attention to improve training stability; 2) a log spaced continuous position bi…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy