Stéphane d'Ascoli
Stéphane d'Ascoli
Bio
Research
Outreach
Music
Travel
CV
Light
Dark
Automatic
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
Stéphane D'Ascoli
,
Hugo Touvron
,
Matthew L Leavitt
,
Ari S Morcos
,
Giulio Biroli
,
Levent Sagun
January 2021
Cite
ArXiv
ICML
Blog post
Code
Long talk
Short talk
Twitter
Type
Conference paper
Publication
Internation Conference on Machine Learning
Related
Transformed CNNs: recasting pre-trained convolutional layers with self-attention
On the interplay between data structure and loss function in classification problems
Triple descent and the two kinds of overfitting: where and why do they appear?
Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias
Jamming transition as a paradigm to understand the loss landscape of deep neural networks
Cite
×
