3つの要点 ✔️ Efficient Transformerのベンチマーク「Long Range Arena」の提案 ✔️ 様々なモダリティにわたる、長いシーケンスからなるタスクを網羅 ✔️ 過去に提案された様々なモデルの内、10種類を比較・検証 High-Performance Large-Scale Image Recognition Without Normalization written by Andrew Brock, Soham De, Samuel L. Smith, Karen Simonyan (Submitted on 11 Feb 2021) Comments: Accepted to arXiv. Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG);
![Efficient Transformer専用ベンチマーク「Long Range Area」登場!](https://cdn-ak-scissors.b.st-hatena.com/image/square/c21865b39d1b4c55b6145697a14c2c0775e6e989/height=288;version=1;width=512/https%3A%2F%2Faisholar.s3.ap-northeast-1.amazonaws.com%2Fmedia%2FFebruary2021%2Fefficient_transformer%25E5%25B0%2582%25E7%2594%25A8_%25E3%2583%2598%25E3%2582%2599%25E3%2583%25B3%25E3%2583%2581%25E3%2583%259E%25E3%2583%25BC%25E3%2582%25AF%25E3%2580%258Clong_range_area%25E3%2580%258D1-min.png)