
Why Can't AI Make Its Own Discoveries? — With Yann LeCun
About this video
Yann LeCun on the Big Technology Podcast discusses why current AI models cannot make discoveries despite their knowledge. He argues systems need abstract world models and also covers limits of AI research, investor expectations, and open source after DeepSeek.
Why it appears in the archive
Pointed to as LeCun's argument for the limits of LLMs and the need for world models.
AI-generated summary and labels from the source dataset; verify important details against the video. Source & credits.
From the Hacker News discussion
In this podcast episode[0] he does talk about this kind of model and how it "learns about physics" through experience instead of just ingesting theorical material. It's quite eye opening. 0. [VIDEO]
Read original comment ↗This is not an appeal to authority, but this video probably contains the answers to your questions if you are open minded about it [VIDEO]
Read original comment ↗What? The "article" is from anthropic, so I think they would know what they write about. Also, RL is an additional training process that does not negate that GPT / transformers are left-right autoencoders that are effectively next token predictors. [Why Can't AI Make Its Own Discoveries? — With Yann LeCun] ( [VIDEO] )
Read original comment ↗