Keep on to blur preview images; turn off to show them clearly
*overfit to recent data finally, how would you create these boundaries where you decide to minimise KLD? if temporally decided, it's suboptimal if decided based on abstract ideas, it runs into the same challenges as BLT or LCM.
RL and efficient distributed pretraining • eXperiments lab • memes and training lores
the cost angle is definitely one of the factors. another is that it all gets handled at scale and we shouldn't overfit the data in pretraining that can be noisy and possibly lower quality.
*overfit to recent data finally, how would you create these boundaries where you decide to minimise KLD? if temporally decided, it's suboptimal if decided based on abstract ideas, it runs into the same challenges as BLT or LCM.
https://t.co/k8dEZBW68s
Wonderer. Amor fati. Scaling trust.
Wow, first good reason to go to the moon.
AI @amazon. All views personal!
"I think that since our species lives on information, information is the ultimate trade good because it is a nonrivaled good. You can share it with someone else without being deprived of it yourself. It can be multiplied, and that makes it the ideal medium of reciprocity, conferring a large benefit to someone else at a small cost to oneself." Beautiful words @sapinker! And thank you, @tylercowen for hosting him and sharing the transcript.
https://t.co/k8dEZBW68s
Me too: in 2016 in 2017 in 2018 Keep showing up.
🧑💻 https://t.co/Y30jsaHwz9 $20K/m ⚡️ https://t.co/vatLDmi9UG $17K/m 📈 https://t.co/3EDxln5mdi $16K/m ⭐️ https://t.co/MZc8tG9xWi $8K/m 🧬 https://t.co/SfrVXVtmdA $.5K/m 🍜 https://t.co/r07EpGSYJ2 $0K/m 🧾 https://t.co/7olaOzV8Xd $0/m +18 https://t.co/4zCWHGJp1S