Demonstrating driver activity recognition in the MIT Human-Centered Autonomous Vehicle by playing guitar. Some details: This video was recorded on a test track. The guitar playing and sound is all real, all live. Backing track is written and recorded by me beforehand. The voice channel is the only part from the original song. Control of the vehicle is done in real-time, but visualizations you see are done in post-processing.

CONNECT:
- Subscribe to this YouTube channel
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Twitter: https://twitter.com/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman

The official name for our car is the MIT Human Centered Autonomous Vehicle.

But amongst our team, her name is Betty, as in Black Betty.

Today, we'd like to demonstrate activity recognition.

Two-stream neural network, optical flow and RGB coming from the video of the driver's body.

The output of the network is a prediction of the driver's activity, whether that's texting on the phone, drinking water, or playing guitar.

Alright, Hey Betty, let's go for a drive.

Oh, Black Betty, bam-ba-lam, oh, Black Betty, Bam-ba-lam, Black Betty had a child Bam-ba-lam, the damn thing gone wild Bam-ba-lam, said a word not

of mine Bam-ba-lam, the damn thing gone blind Bam-ba-lam, I

said, oh, Black Betty Bam-ba-lam, whoa, Black Betty Bam-ba-lam

Oh, Black Betty, Bamba Lamb, Oh, Black Betty, Bamba Lamb,

Bambalam she's so rock steady, Bambalam and

she's always ready, Bambalam oh black steady, Bambalam oh black steady...


Speaker 0: The official name for our car is the MIT Human Centered Autonomous Vehicle. But amongst our team, her name is Betty, as in Black Betty. Today, we'd like to demonstrate activity recognition. Two-stream neural network, optical flow and RGB coming from the video of the driver's body. The output of the network is a prediction of the driver's activity, whether that's texting on the phone, drinking water, or playing guitar.

Alright, Hey Betty, let's go for a drive.

Speaker 1: Sure Lex, with music?

Speaker 0: Yes, play your theme song.

Speaker 1: Would you like to play along?

Speaker 0: Yes.

Speaker 1: Ready? Yes.

Speaker 0: ♪ ♪ ♪ ♪ ♪

Speaker 2: Oh, Black Betty, bam-ba-lam, oh, Black Betty, Bam-ba-lam, Black Betty had a child Bam-ba-lam, the damn thing gone wild Bam-ba-lam, said a word not

Speaker 3: of mine Bam-ba-lam, the damn thing gone blind Bam-ba-lam, I

Speaker 2: said, oh, Black Betty Bam-ba-lam, whoa, Black Betty Bam-ba-lam

Speaker 4: Oh, Black Betty, Bamba Lamb, Oh, Black Betty, Bamba Lamb,

Speaker 2: Bambalam she's so rock steady, Bambalam and

Speaker 5: she's always ready, Bambalam oh black steady, Bambalam oh black steady... Thank you for watching!

See all Lex Fridman transcripts on Youtube

Playing Guitar in a Self-Driving Car