Richard Feynman: Can Machines Think?

Relevant — decades earlier, Righard Feynman discussing AI like a boss. He discusses exactly the problems being solved in the article with the Haar approach, but from his time. He mentioned Lenat, who was the OG and who the “LeNet” by Yann LeCun was named after probably (it is mentioned in the article). [VIDEO]

Here is feynman on AI: [VIDEO] Feynman turned his focus to computing ( AI, heuristics, quantum computing ) later on his life.

Do submarines swim? [1] Do cars run, like a cheetah does? [2] [1]: [LINK] [2]: [VIDEO] (Richard Feynman: Can Machines Think?)

I first heard about Cyc's creator Douglas Lenat a few months back when I watched an old talk by Richard Feynman. [VIDEO]

Feynman was a well-known proponent of AI and neural networks [1]. He even gave popular lectures on the subject [2]. He also claimed that replicating animal-like visual recognition abilities in machines would be Nobel-worthy; deep learning was certainoy a breakthrough in that. [1] [LINK] [2] [VIDEO]

> It's very difficult to find some way of defining rather precisely something we can do that we can say a computer will never be able to do. There are some things that people make up that say that, "While it's doing it, will it feel good?" or, "While it's doing it, will it understand what it's doing?" or some other abstraction. I rather feel that these are things like, "While it's doing it, will it be able to scratch the lice out of it's hair?" No, it hasn't got any hair nor lice to scratch from it, okay? > You've got to be careful when you say what the human does, if you add to the actual result of his effort some other things that you like, the appreciation of the aesthetic... then it gets harder and harder for the computer to do it because the human beings have a tendency to try to make sure that they can do something that no machine can do. Somehow it doesn't bother them anymore, it must have bothered them in earlier times, that machines are stronger physically than they are... - Feynman [VIDEO]

Sure, but intent is a very fickle thing. Consider zero and single click deployments in IT operations. With single click deployments, you need to have everything automated, but the go sign is still given by a human. With zero click, you'll have a deployment policy instead - the human decision is now out of the critical path completely, and only plays part during the authoring and later editing of said policy. And you can also then generate those policies, and so on. Same can be applied to AI. You can have canned prompts that you keep refining to encode your intent and preferences, then you just use them with a single click. But you can also build a harness that generates prompts and continuously monitors trends and the world as a whole for any kind of arbitrary criteria (potentially of its own random or even shifting choice), and then follows that: a reward policy. And then like with regular IT, you can keep layering onto that. Because of this, I don't think that intent is the point of differentiation necessarily, but the experience and shared understanding of human intent . That people have varying individual, arbitrary preferences, and are going through life of arbitrary and endless differences, and then source from those to then create. Indeed, this is never going to be replicated, exactly because of what I said: this is humans being human, and that giving them a unique, inalienable position by definition. It's like if instead of planes we called aircraft "mechanical birds"

Well, you have to define what you mean by "intelligence". I think it's just not been enough time, we can take the current LLM technology and just put it in a pipeline that includes 24/7 checking work and building up knowledge bases. A lot of the stuff that you think is "new and original ideas" are just like prompting an LLM to "come up with 20 original variations" or "20 original ways to combine" some building blocks it already has been trained on or have been added into its context. If you do this frequently enough, and make sure to run acceptance tests (e.g. unit testing or whatever is in your domain) then you can really get quite far. In fact, you can generate the tests themselves as well. What's missing, essentially, is autonomous incremental improvements, involving acceptance testing and curation, not just generation. Just like a GAN does when it generates novel images. "Exceptional pattern matching does not imply understanding." - You'll have to define what you mean by "understanding". I think we have to revisit the Chinese Room argument by John Searle. After all, if the book used by the person in the room is the result of training on Chinese, then "the whole Chinese room" with the book and operator may be said to "understand" Chinese. It's not just pattern matching but emergent structures in the model, that is a non-von-neumann architecture, when it's being trained. Those structures are able to manipulate symbols in ways that are extremely useful and practical for an e