Age | Commit message (Collapse) | Author | |
---|---|---|---|
2022-08-27 | Make InfoNCE loss distributableHEADmaster | Jordan Gong | |
2022-08-26 | Rewrite SimCLR-based PosRecon model with some tweaks | Jordan Gong | |
- No inheritance, encapsulation and immutability, making code more readable - Remove mask token and encode visible patches only, inspired from MAE and MSN - Switch from batch-level randomization (shuffling and masking) to sample-level, and remove shuffle ratio for simplicity - Compute loss during forward | |||
2022-08-21 | Some modifications for PosRecon trainer | Jordan Gong | |
2022-08-19 | Add ViT with position shuffling/unshuffling and masking methods | Jordan Gong | |
2022-08-19 | Add ViT with position shuffling/unshuffling methods | Jordan Gong | |