QuietSTAR has been posted here before but it did not get the hype it deserves. I read the whole paper, will recommend you do too. Here are the best bits from my reading. After reading, you will scream for a Open Source QuietSTAR model pretrained from scratch.
