Keep on to blur preview images; turn off to show them clearly
A simple example to illustrate the problem with the VAE is to consider a signal composed of three boolean random variables A, B, C with A and B indep of proba 1/2 and C = A xor B. The three variables together have an entropy of two bits. 1/2
Ideally the latent Z would provide those two bits and the decoder would be fully deterministic. Modulating properly the amount of information Z / the encoder captures is complicated, and if we overshoot and the encoder provides three bits, we lose the joint structure. 2/2
RT @arvidkahl: Voice input has been a massive part of enjoying coding more. And writing.
Building https://t.co/od97B0HVrk and https://t.co/666FnyVVE0 in Public. Raising all the boats with kindness. 🎙️ https://t.co/6w69DZmi8H · ✍️ https://t.co/lpnor5rsTW
Grok is VERY strongly convinced that Fremont Tesla process is superior to Shanghai one. American ingenuity, reducing waste! No wonder they have 7 times higher productivity even while producing 2 times fewer cars per worker… That's how *it* works kids. Grok knows wyboy mafs…
We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization. @deepseek_ai stan #1, 2023–Deep Time «C’est la guerre.» ®1
Grok is VERY strongly convinced that Fremont Tesla process is superior to Shanghai one. American ingenuity, reducing waste! No wonder they have 7 times higher productivity even while producing 2 times fewer cars per worker… That's how *it* works kids. Grok knows wyboy mafs…
We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization. @deepseek_ai stan #1, 2023–Deep Time «C’est la guerre.» ®1
RT @xiaojingcanxue: 财经报道了梁建章七期播客的内容，分别采访了3-6个娃的普通人。谈他们是怎么养娃的。 一个4娃家庭，80平米挤8口人，女方的婆婆和亲妈一起过来帮衬带娃，衣服靠亲友救济…… 一个5娃家庭，家里欠着20张信用卡，飞机不让大人带5个小孩坐。7…
Software engineer, 🎙️《捕蛇者说》播客主播 @pythonhunter__ https://t.co/LGIKFkoQbn - Mac 上最好的划词 AI 搜索 & 翻译 可通过 Telegram/Gmail 找我，ID 同名
So FT v2 *does something* with a simpler architecture and ~0.05% of compute overhead instead of 3.5%.
Research Scientist @meta (FAIR), Prof. @Unige_en, co-founder @nc_shape. I like reality.