<feed xmlns='http://www.w3.org/2005/Atom'>
<title>contrastive-learning.git, branch master</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/'/>
<entry>
<title>Make InfoNCE loss distributable</title>
<updated>2022-08-27T05:11:16+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-27T05:11:16+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=33a95dca1dee3a1a768cf557d4e2a878416a3a96'/>
<id>33a95dca1dee3a1a768cf557d4e2a878416a3a96</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Rewrite SimCLR-based PosRecon model with some tweaks</title>
<updated>2022-08-26T09:30:37+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-26T09:30:37+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=ea370e306eec3a5191bd838f7f650658e0fbb115'/>
<id>ea370e306eec3a5191bd838f7f650658e0fbb115</id>
<content type='text'>
- No inheritance, encapsulation and immutability, making code more readable
- Remove mask token and encode visible patches only, inspired from MAE and MSN
- Switch from batch-level randomization (shuffling and masking) to sample-level, and remove shuffle ratio for simplicity
- Compute loss during forward
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
- No inheritance, encapsulation and immutability, making code more readable
- Remove mask token and encode visible patches only, inspired from MAE and MSN
- Switch from batch-level randomization (shuffling and masking) to sample-level, and remove shuffle ratio for simplicity
- Compute loss during forward
</pre>
</div>
</content>
</entry>
<entry>
<title>Add a dirty version of PosRecon trainer</title>
<updated>2022-08-25T02:07:23+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-25T02:07:23+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=287c2522c83b37718ddd4ad3772e687298a0bb8a'/>
<id>287c2522c83b37718ddd4ad3772e687298a0bb8a</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Fix optimizer checkpoint loading problem</title>
<updated>2022-08-25T01:50:54+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-25T01:50:54+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=e120a99556deb51edbe66ab1ab46009704f9d898'/>
<id>e120a99556deb51edbe66ab1ab46009704f9d898</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Some modifications for PosRecon trainer</title>
<updated>2022-08-21T09:28:07+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-21T09:28:07+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=49822d3234cb67e4996ad13fdbc3c44e1a0bbf29'/>
<id>49822d3234cb67e4996ad13fdbc3c44e1a0bbf29</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Refactor SimCLR base class</title>
<updated>2022-08-20T07:35:56+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-20T07:35:56+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=4c242c1383afb8072ce6d2904f51cdb005eced4c'/>
<id>4c242c1383afb8072ce6d2904f51cdb005eced4c</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Add label smoothing option</title>
<updated>2022-08-20T02:45:04+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-20T02:45:04+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=5ccb892ae59cbe183ef91c1648751ff0085cc0da'/>
<id>5ccb892ae59cbe183ef91c1648751ff0085cc0da</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Fix scheduler stepping bugs</title>
<updated>2022-08-20T02:04:41+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-20T02:04:41+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=7661a84e4ff8c846fd8649b61afbea2cd4c6431e'/>
<id>7661a84e4ff8c846fd8649b61afbea2cd4c6431e</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Merge remote-tracking branch 'origin/master'</title>
<updated>2022-08-20T01:35:31+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-20T01:35:31+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=70d8351974d95978409068944de7112b55832d2b'/>
<id>70d8351974d95978409068944de7112b55832d2b</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Add encoder option to SimCLR evaluation script</title>
<updated>2022-08-20T01:35:09+00:00</updated>
<author>
<name>Jordan Gong</name>
<email>jordan.gong@protonmail.com</email>
</author>
<published>2022-08-20T01:12:01+00:00</published>
<link rel='alternate' type='text/html' href='https://git.jordangong.com/contrastive-learning.git/commit/?id=726e59f030e278ba7ab52d5c48c78a9ceeb7dd8d'/>
<id>726e59f030e278ba7ab52d5c48c78a9ceeb7dd8d</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
