MLP-Mixer: An all-MLP Architecture for Vision

Convolutional Neural Networks (CNNs) are the go-to model for computer vision. Recently, attention-based networks, such as the Vision Transformer, have also become popular. In this paper we show that while convolutions and attention are both sufficient for good performance, neither of them are necessary. We present MLP-Mixer, an architecture based exclusively on multi-layer perceptrons (MLPs). MLP-

[Ryobot]

入力を転置してMLPに突っ込むとパッチ間の情報を拾えるからCNN/Attentionいらなくね？って研究．性能が飛び抜けていいわけではないけどMLPを再評価する