This is a clip from a conversation with Elon Musk from Nov 2019, his second appearance on the podcast. New full episodes are released once or twice a week and 1-2 new clips or a new non-podcast video is released on all other days. You can watch the full conversation here: https://www.youtube.com/watch?v=smK9dgdTl40
(more links below)

Podcast full episodes playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4

Podcasts clips playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41

Podcast website:
https://lexfridman.com/ai

Podcast on Apple Podcasts (iTunes):
https://apple.co/2lwqZIr

Podcast on Spotify:
https://spoti.fi/2nEwCF8

Podcast RSS:
https://lexfridman.com/category/ai/feed/

Note: I select clips with insights from these much longer conversation with the hope of helping make these ideas more accessible and discoverable. Ultimately, this podcast is a small side hobby for me with the goal of sharing and discussing ideas. I did a poll and 92% of people either liked or loved the posting of daily clips, 2% were indifferent, and 6% hated it, some suggesting that I post them on a separate YouTube channel. I hear the 6% and partially agree, so am torn about the whole thing. I tried creating a separate clips channel but the YouTube algorithm makes it very difficult for that channel to grow. So for a little while, I'll keep posting clips on this channel. I ask for your patience and to see these clips as supporting the dissemination of knowledge contained in nuanced discussion. If you enjoy it, consider subscribing, sharing, and commenting.

Elon Musk is the CEO of Tesla, SpaceX, Neuralink, and a co-founder of several other companies.

Subscribe to this YouTube channel or connect on:
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman
- Medium: https://medium.com/@lexfridman
- Support on Patreon: https://www.patreon.com/lexfridman

What's harder, perception or control for these problems?

So being able to perfectly perceive everything or figuring out a plan once you perceive everything, how to interact with all the agents in the environment.

In your sense, from a learning perspective, Is perception or action harder in that giant, beautiful, multitask learning neural network?

The hottest thing is having accurate representation of the physical objects in vector space.

So taking the visual input, primarily visual input, some sonar and radar, and then creating an accurate vector space representation of the objects around you.

Once you have an accurate vector space representation, the planning and control is relatively easier.

Basically, once you have accurate vector space representation, then you're kind of like a video game.

Like, cars in like Grand Theft Auto or something, like they work pretty well.

They drive down the road, they don't crash, you know, pretty much unless


Speaker 0: What's harder, perception or control for these problems? So being able to perfectly perceive everything or figuring out a plan once you perceive everything, how to interact with all the agents in the environment. In your sense, from a learning perspective, Is perception or action harder in that giant, beautiful, multitask learning neural network?

Speaker 1: The hottest thing is having accurate representation of the physical objects in vector space. So taking the visual input, primarily visual input, some sonar and radar, and then creating an accurate vector space representation of the objects around you. Once you have an accurate vector space representation, the planning and control is relatively easier. It is relatively easy. Basically, once you have accurate vector space representation, then you're kind of like a video game.

Like, cars in like Grand Theft Auto or something, like they work pretty well. They drive down the road, they don't crash, you know, pretty much unless

See all Lex Fridman transcripts on Youtube

Elon Musk: Perception vs Control - What's Harder?