diff options
| author | Jordan Gong <jordan.gong@protonmail.com> | 2022-03-17 22:11:55 +0800 |
|---|---|---|
| committer | Jordan Gong <jordan.gong@protonmail.com> | 2022-03-17 22:11:55 +0800 |
| commit | 7b7b9b1c44c7e4cae8ff0b9546f6e0cf01b231f6 (patch) | |
| tree | 57423174230969f6489a2f1aff79ad67c0f19ef6 /readme.md | |
| parent | f5e648744cb3e34690351b0e40a028011c90380c (diff) | |
Add readme
Diffstat (limited to 'readme.md')
| -rw-r--r-- | readme.md | 40 |
1 files changed, 40 insertions, 0 deletions
diff --git a/readme.md b/readme.md new file mode 100644 index 0000000..252abfd --- /dev/null +++ b/readme.md @@ -0,0 +1,40 @@ +### Current progress: + +- General + - [x] Random color distortion (from SimCLR) + - [x] Random Gaussian blur (from SimCLR) + - [ ] Random multi-crop (from SwAV) + - [ ] InfoNCE loss + - [ ] Momentum encoder + - [ ] Selective Kernel (SK) convolution layer (used in SimCLR v2) + - [x] LARS optimizer + - [x] Consine annealing with linear warmup scheduler + - [x] Linear scheduler (for torch<=1.9) + - [x] CSV logger + - [x] TensorBoard logger + - [x] Checkpoint saving and restoring + - [x] Command line parameter parser + - [x] YAML parameter parser + - [ ] PyTorch workflow encapsulation + - [ ] Dedicated evaluation script + - [ ] Detailed readme file + - [ ] Data Parallel + - [ ] Distributed Data Parallel + - [ ] Global batch normalization + - [ ] Shuffling batch normalization + +- Supervised baseline + - [x] ResNet + - [ ] ViT + - [x] CIFAR-10 + - [ ] CIFAR-100 + - [x] ImageNet-1k + +- Self-supervised baseline + - [ ] SimCLR (contrastive, ResNet) + - [ ] MoCo v2 (contrastive, ResNet) + - [ ] MoCo v3 (contrastive, ViT) + - [ ] BYOL (non-contrastive, ResNet) + - [ ] DINO (self-distillation, ViT) + +To be continued ... |