8 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
flamelaw	755df94b2a	set TI AdamW default weight decay to 0	2022-11-27 00:35:44 +09:00
flamelaw	1bd57cc979	last_layer_dropout default to False	2022-11-23 20:21:52 +09:00
flamelaw	d2c97fc3fe	fix dropout, implement train/eval mode	2022-11-23 20:00:00 +09:00
flamelaw	89d8ecff09	small fixes	2022-11-23 02:49:01 +09:00
flamelaw	5b57f61ba4	fix pin_memory with different latent sampling method	2022-11-21 10:15:46 +09:00
flamelaw	2d22d72cda	fix random sampling with pin_memory	2022-11-20 16:14:27 +09:00
flamelaw	a4a5735d0a	remove unnecessary comment	2022-11-20 12:38:18 +09:00
flamelaw	bd68e35de3	Gradient accumulation, autocast fix, new latent sampling method, etc	2022-11-20 12:35:26 +09:00