Improved robustness of vision transformers via prelayernorm in patch embedding

Bum Jun Kim; Hyeyeon Choi; Hyeonah Jang; Dong Gu Lee; Wonseok Jeong; Sang Woo Kim

doi:10.1016/j.patcog.2023.109659

ScienceGate Book Chapters

JOURNAL ARTICLE

Improved robustness of vision transformers via prelayernorm in patch embedding

Bum Jun Kim Hyeyeon Choi Hyeonah Jang Dong Gu Lee Wonseok Jeong Sang Woo Kim

Year: 2023 Journal: Pattern Recognition Vol: 141 Pages: 109659-109659 Publisher: Elsevier BV

DOI: 10.1016/j.patcog.2023.109659

Get Full-Text PDF Get Analytical Report

Keywords:

Embedding Robustness (evolution) Convolutional neural network Computer science Artificial intelligence Computer vision Transformer Pattern recognition (psychology) Engineering Chemistry

Metrics

Cited By

1.82

FWCI (Field Weighted Citation Impact)

Refs

0.82

Citation Normalized Percentile

Is in top 1%

Is in top 10%

Citation History

Topics

Advanced Neural Network Applications

Physical Sciences → Computer Science → Computer Vision and Pattern Recognition

Visual Attention and Saliency Detection

Physical Sciences → Computer Science → Computer Vision and Pattern Recognition

Image Enhancement Techniques

Physical Sciences → Computer Science → Computer Vision and Pattern Recognition

Improved robustness of vision transformers via prelayernorm in patch embedding

Metrics

Citation History

Topics

Related Documents

Certified Patch Robustness via Smoothed Vision Transformers

Adaptive Tokenization: Rethinking Patch Embedding for Vision Transformers

Adaptive Tokenization: Rethinking Patch Embedding for Vision Transformers

Harnessing Edge Information for Improved Robustness in Vision Transformers

Improving Robustness of Vision Transformers by Reducing Sensitivity to Patch Corruptions