Announcement
Mathalyse Research launches
Mathalyse Research is an independent lab working on optimisers, architectures and the theory of learning. This site collects its released work and announcements. Collaborators and students can write through the contact page.
Release
ThermoLion preprint released
The ThermoLion preprint is available on arXiv. It argues that training deep vision networks calls for adjusting the precision of the update dynamically, between the magnitude-based updates of AdamW and the sign-based updates of Lion.
Read on arXiv