Will Transformers Replace CNNs in Computer Vision?

This article is about most probably the next generation of neural networks for all computer vision applications: The transformer architecture. You’ve certainly already heard about this architecture in the field of natural language processing, or NLP, mainly with GPT3 that made a lot of noise in 2020. Transformers can be used as a general-purpose backbone for many different applications and not onl

[misshiki]

“Swin Transformerと呼ばれる新しい論文を使用して、トランスアーキテクチャをコンピュータビジョンに適用する方法を理解”

[rawwell]

“The power of convolutions is that the filters use fixed weights globally, enabling the translation-invariance property of convolution, making it a powerful generalized. In self-attention, the weights are not fixed globally. Instead, they rely on the local context itself. Thus, self-attention take