-
|
A series of weights of Searching for Better ViT Baselines (For the GPU Poor) have been released. Do you have specific explanations about these ViT weights, including more technical details on training or advantage for using these weights? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
No paper or writeup at this point, been working on lots of other thiings and had these runs going on and off over a period. Still have a few more running... all of the hparams are on the HF hub now in yaml files. All together in this gist https://gist.github.com/rwightman/fb37c339efd2334177ff99a8083ebbc4 |
Beta Was this translation helpful? Give feedback.
-
|
Would be super cool to have maybe not a paper but just your thoughts about the most important params and why you think they make this vit variants better |
Beta Was this translation helpful? Give feedback.
No paper or writeup at this point, been working on lots of other thiings and had these runs going on and off over a period. Still have a few more running... all of the hparams are on the HF hub now in yaml files. All together in this gist https://gist.github.com/rwightman/fb37c339efd2334177ff99a8083ebbc4