From 7b7b9b1c44c7e4cae8ff0b9546f6e0cf01b231f6 Mon Sep 17 00:00:00 2001 From: Jordan Gong Date: Thu, 17 Mar 2022 22:11:55 +0800 Subject: Add readme --- readme.md | 40 ++++++++++++++++++++++++++++++++++++++++ 1 file changed, 40 insertions(+) create mode 100644 readme.md diff --git a/readme.md b/readme.md new file mode 100644 index 0000000..252abfd --- /dev/null +++ b/readme.md @@ -0,0 +1,40 @@ +### Current progress: + +- General + - [x] Random color distortion (from SimCLR) + - [x] Random Gaussian blur (from SimCLR) + - [ ] Random multi-crop (from SwAV) + - [ ] InfoNCE loss + - [ ] Momentum encoder + - [ ] Selective Kernel (SK) convolution layer (used in SimCLR v2) + - [x] LARS optimizer + - [x] Consine annealing with linear warmup scheduler + - [x] Linear scheduler (for torch<=1.9) + - [x] CSV logger + - [x] TensorBoard logger + - [x] Checkpoint saving and restoring + - [x] Command line parameter parser + - [x] YAML parameter parser + - [ ] PyTorch workflow encapsulation + - [ ] Dedicated evaluation script + - [ ] Detailed readme file + - [ ] Data Parallel + - [ ] Distributed Data Parallel + - [ ] Global batch normalization + - [ ] Shuffling batch normalization + +- Supervised baseline + - [x] ResNet + - [ ] ViT + - [x] CIFAR-10 + - [ ] CIFAR-100 + - [x] ImageNet-1k + +- Self-supervised baseline + - [ ] SimCLR (contrastive, ResNet) + - [ ] MoCo v2 (contrastive, ResNet) + - [ ] MoCo v3 (contrastive, ViT) + - [ ] BYOL (non-contrastive, ResNet) + - [ ] DINO (self-distillation, ViT) + +To be continued ... -- cgit v1.2.3