contrastive-learning.git/posrecon, branch master

Make InfoNCE loss distributable

2022-08-27T05:11:16+00:00

Rewrite SimCLR-based PosRecon model with some tweaks

2022-08-26T09:30:37+00:00

- No inheritance, encapsulation and immutability, making code more readable
- Remove mask token and encode visible patches only, inspired from MAE and MSN
- Switch from batch-level randomization (shuffling and masking) to sample-level, and remove shuffle ratio for simplicity
- Compute loss during forward

Add a dirty version of PosRecon trainer

2022-08-25T02:07:23+00:00

Some modifications for PosRecon trainer

2022-08-21T09:28:07+00:00

Add ViT with position shuffling/unshuffling and masking methods

2022-08-19T08:53:24+00:00

Add dependencies

2022-08-19T06:02:04+00:00

- Pytorch Lighting (pytorch-lighting)
- Pytorch image models (timm)

Add ViT with position shuffling/unshuffling methods

2022-08-19T06:00:21+00:00