Yi Li
1 Papers
Yi Li is an academic researcher. The author has contributed to research in topics: Computer science & Embedding. The author has co-authored 1 publications.
Chat about Author
Papers
EmbedFormer: Embedded Depth-Wise Convolution Layer for Token Mixing
TL;DR: In this article , the difference between the operation of self-attention and depth-wise convolutional layer was investigated and it was proved that the general architecture of the ViTs is more essential to the models' performance than selfattention mechanism.