Keep on to blur preview images; turn off to show them clearly
RT @bscholl: A new product, a new customer, a new financing! Introducing Superpower: a 42MW natural gas turbine optimized for AI datacente…
🇺🇸 a16z speedrun
nice that it's open weight, but comparing dense vs moe models and only looking at total params is pretty unfair, if you look at active params instead of total params it's a different story: - GLM 4.6 (32B): 74% fewer - Minimax M2 (10B): 92% fewer - K2 thinking (32B): 74% fewer - V3.2 (37B): 70% fewer size (both total or active!) is not the right metric here, we should have the same graph with speed on vllm / sglang
Training llm's (now: @huggingface) anon feedback: https://t.co/JmMh7Sfvxd
nice that it's open weight, but comparing dense vs moe models and only looking at total params is pretty unfair, if you look at active params instead of total params it's a different story: - GLM 4.6 (32B): 74% fewer - Minimax M2 (10B): 92% fewer - K2 thinking (32B): 74% fewer - V3.2 (37B): 70% fewer size (both total or active!) is not the right metric here, we should have the same graph with speed on vllm / sglang
Training llm's (now: @huggingface) anon feedback: https://t.co/JmMh7Sfvxd
nice that it's open weight, but comparing dense vs moe models and only looking at total params is pretty unfair, if you look at active params instead of total params it's a different story: - GLM 4.6 (32B): 74% fewer - Minimax M2 (10B): 92% fewer - K2 thinking (32B): 74% fewer - V3.2 (37B): 70% fewer size (both total or active!) is not the right metric here, we should have the same graph with speed on vllm / sglang
Training llm's (now: @huggingface) anon feedback: https://t.co/JmMh7Sfvxd
“The modern world is not evil; in some ways the modern world is far too good. It is full of wild and wasted virtues. When a religious scheme is shattered, it is not merely the vices that are let loose. The virtues are let loose also; and the virtues wander more wildly, and the virtues do more terrible damage. The modern world is full of the old Christian virtues gone mad. They have gone mad because they have been isolated from each other and are wandering.”
Co-Founder, American Dynamism. General Partner @a16z. Catholic. Mother. American. 🇺🇸 🚀💪
Emergent properties and built-in distribution make AI more like biology than systems design. The TAM of the App Store in 2009 was limited to the six million iPhones in the world. Today, if you build for OpenAI’s Apps SDK, you can instantly reach up to 850 million people. Combining that rapid diffusion with the emergent properties of LLMs means there are too many opportunities for a central decision-maker. Instead, individuals can max out their creativity and discover product capabilities.
AI Apps investing @ A16Z; A1111; Boards of Krea, Deel, Clutch, Titan, Arc Boats, Untitled, Happy Robot + more; If you’re not at the table, you’re on the menu
