diff options
| author | Jordan Gong <jordan.gong@protonmail.com> | 2022-08-18 14:29:30 +0800 |
|---|---|---|
| committer | Jordan Gong <jordan.gong@protonmail.com> | 2022-08-18 14:29:30 +0800 |
| commit | 1877161db5056c0a86cfc680df94dbb7f98a438f (patch) | |
| tree | 7e56583cb720663d1d74ebbfdffe60ad29bb17de | |
| parent | d01affeafed02701f128a06899fb658441475792 (diff) | |
Update SimCLR ViT config
| -rw-r--r-- | simclr/config-vit.example.yaml | 14 |
1 files changed, 7 insertions, 7 deletions
diff --git a/simclr/config-vit.example.yaml b/simclr/config-vit.example.yaml index 6246a19..fde0257 100644 --- a/simclr/config-vit.example.yaml +++ b/simclr/config-vit.example.yaml @@ -26,13 +26,13 @@ distort_strength: 0.5 batch_size: 128 num_workers: 2 -optim: lars -lr: 1 -momentum: 0.9 -#betas: -# - 0.9 -# - 0.999 -weight_decay: 1.0e-06 +optim: adam +lr: 0.001 +#momentum: 0.9 +betas: + - 0.9 + - 0.999 +weight_decay: 5.0e-05 sched: warmup-anneal warmup_iters: 1953
\ No newline at end of file |