blob: 29dc6139daa90028e72929bf24faef2738162b41 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
|
### Current progress:
- General
- [x] Random color distortion (from SimCLR)
- [x] Random Gaussian blur (from SimCLR)
- [x] Random multi-crop (from SwAV)
- [ ] InfoNCE loss
- [ ] Momentum encoder
- [ ] Selective Kernel (SK) convolution layer (used in SimCLR v2)
- [x] LARS optimizer
- [x] Consine annealing with linear warmup scheduler
- [x] Linear scheduler (for torch<=1.9)
- [x] CSV logger
- [x] TensorBoard logger
- [x] Checkpoint saving and restoring
- [x] Command line parameter parser
- [x] YAML parameter parser
- [x] PyTorch workflow encapsulation
- [ ] Dedicated evaluation script
- [ ] Detailed readme file
- [ ] Data Parallel
- [ ] Distributed Data Parallel
- [ ] Global batch normalization
- [ ] Shuffling batch normalization
- Supervised baseline
- [x] ResNet
- [ ] ViT
- [x] CIFAR-10
- [x] CIFAR-100
- [x] ImageNet-1k
- Self-supervised baseline
- [ ] SimCLR (contrastive, ResNet)
- [ ] MoCo v2 (contrastive, ResNet)
- [ ] MoCo v3 (contrastive, ViT)
- [ ] BYOL (non-contrastive, ResNet)
- [ ] DINO (self-distillation, ViT)
To be continued ...
|
