At least they‘ve wasted their money for research of what doesn‘t work instead of just building silly products as for the .com bubble.
Humanity will gain insights to the kind of AI approaches that won‘t work much faster than without all the money. It‘s just an allocation of human efforts
Not really. None of what has been going on with transformer models has been anything but hyper scaling. It’s not really making fundamental advances in technology it’s that they decided what they had at the scale they had makes convincing enough demos that the scam could start.
It has been more than just hyperscaling. First of all, the invention of transformers would likely be significantly delayed without the hype around CNNs in the first AI wave in 2014. OpenAI wouldn‘t have been founded and their early contributions (like Soft Actor-Critic RL) could have taken longer to be explored.
While I agree that the transformer architecture itself hasn‘t advanced far since 2018 apart from scaling, its success has significantly contributed to self-learning policies.
RLHF, Direct Policy Optimization, and in particular DeepSeek‘s GRPO are huge milestones for Reinforcement Learning which arguably is the most promising trajectory for actual intelligence. Those are a direct consequence of the money pumped into AI and the appeal it has to many smart and talented people around the world
This is no revelation. THEY KNOW. The play is obvious.
Not one these investors wants to risk missing out on being the next Google or FaceBook or Twitter or Amazon. They know damned well the vast majority will fail. They’re gambling on not being the one left holding the bag.
AI is here to stay, will continue to improve, and there will be a killer app, probably a dozen. My money is on life sciences, particularly medicine.
This makes the dot-com bubble look like a kiddie pool - at least those companies were trying to build actual products, while today’s AI spending is burning through more money than the GDP of most countries just to have the biggest model with no clear path to profitability beyond “trust us bro”.
Anyone remember the dot-com bubble?
At least they‘ve wasted their money for research of what doesn‘t work instead of just building silly products as for the .com bubble.
Humanity will gain insights to the kind of AI approaches that won‘t work much faster than without all the money. It‘s just an allocation of human efforts
Not really. None of what has been going on with transformer models has been anything but hyper scaling. It’s not really making fundamental advances in technology it’s that they decided what they had at the scale they had makes convincing enough demos that the scam could start.
It has been more than just hyperscaling. First of all, the invention of transformers would likely be significantly delayed without the hype around CNNs in the first AI wave in 2014. OpenAI wouldn‘t have been founded and their early contributions (like Soft Actor-Critic RL) could have taken longer to be explored.
While I agree that the transformer architecture itself hasn‘t advanced far since 2018 apart from scaling, its success has significantly contributed to self-learning policies.
RLHF, Direct Policy Optimization, and in particular DeepSeek‘s GRPO are huge milestones for Reinforcement Learning which arguably is the most promising trajectory for actual intelligence. Those are a direct consequence of the money pumped into AI and the appeal it has to many smart and talented people around the world
This is no revelation. THEY KNOW. The play is obvious.
Not one these investors wants to risk missing out on being the next Google or FaceBook or Twitter or Amazon. They know damned well the vast majority will fail. They’re gambling on not being the one left holding the bag.
AI is here to stay, will continue to improve, and there will be a killer app, probably a dozen. My money is on life sciences, particularly medicine.
This makes the dot-com bubble look like a kiddie pool - at least those companies were trying to build actual products, while today’s AI spending is burning through more money than the GDP of most countries just to have the biggest model with no clear path to profitability beyond “trust us bro”.