He's the creator of Keras, which is an open source deep learning library that is designed to enable fast, user-friendly experimentation with deep neural networks.

It serves as an interface to several deep learning libraries, most popular of which is TensorFlow, and it was integrated into the TensorFlow main code base a while ago.

Meaning, if you want to create, train, and use neural networks, probably the easiest and most popular option is to use Keras inside TensorFlow.

Aside from creating an exceptionally useful and popular library, Francois is also a world-class AI researcher and software engineer at Google.

And he's definitely an outspoken, if not controversial, personality in the AI world, especially in the realm of ideas around the future of artificial intelligence.

This is the Artificial Intelligence Podcast.

If you enjoy it, subscribe on YouTube, give it 5 stars on iTunes, support it on Patreon, or simply connect with me on Twitter at Lex Friedman, spelled F-R-I-D-M-A-N.

And now, here's my conversation with Francois

You're known for not sugarcoating your opinions and speaking your mind about ideas and AI, especially on Twitter.

So what's 1 of the more controversial ideas you've expressed online and gotten some heat for?

Yeah, no, I think if you have, if you go through the trouble of maintaining a Twitter account, you might as well speak your mind, you know, otherwise it's, what's even the point of having a Twitter account?

It's like having a nice car and just leave it in the garage.

So that's 1 thing for which I got a lot of pushback.

Perhaps, you know, that time I wrote something about the idea of intelligence explosion and I was questioning the idea and the reasoning behind this idea.

So yeah, so intelligence explosion, I'm sure your family knows the idea, But it's the idea that if you were to build general AI problem solving algorithms, well, the problem of building such an AI, that itself is a problem that could be solved by your AI.

And maybe it could be solved better than what humans can do.

So your AI could start tweaking its own algorithm, could start being a better version of itself.

And so on iteratively, in a recursive fashion.

And so you would end up with an AI with exponentially increasing intelligence.

And I was basically questioning this idea, first of all, because the notion of intelligence explosion uses an implicit definition of intelligence that doesn't sound quite right to me.

It considers intelligence as a property of a brain that you can consider in isolation, like the height of a building, for instance.

But that's not really what intelligence is.

Intelligence emerges from the interaction between a brain, a body, like embodied intelligence, and an environment.

And if you're missing 1 of these pieces, then you cannot really define intelligence anymore.

So just tweaking a brain to make it smarter and smarter doesn't actually make any sense to me.

So, first of all, you're crushing the dreams of many people, right?

So there's a, let's look at like Sam Harris, actually a lot of physicists, Max Tegmark, people who think the universe is an information processing system, our brain is kind of an information processing system.

It doesn't make sense that there should be some, it seems naive to think that our own brain is somehow the limit of the capabilities and this information, I'm playing devil's advocate here, this information processing system.

And then if you just scale it, if you're able to build something that's on par with the brain, you just, the process that builds it just continues and it'll improve exponentially.

So that's the logic that's used actually by almost everybody that is worried about super human intelligence.

So you're trying to make, so most people who are skeptical of that are kind of like, this doesn't, their thought process, this doesn't feel right.

So I'm more like, it doesn't, the whole thing is shrouded in mystery where you, you can't really say anything concrete, but you could say this doesn't feel right.

This doesn't feel like that's how the brain works.

And you're trying to with your blog post and now making it a little more explicit.

So 1 idea is that the brain doesn't exist alone, it exists within the environment.

So you can't exponentially, you would have to somehow exponentially improve the environment and the brain together, almost, yeah, in order to create something that's much smarter in some kind of, of course, we don't have a definition of intelligence.

I don't think if you look at very smart people today, even humans not even talking about AI's, I don't think their brain and the performance of their brain is the bottleneck to the expressed intelligence, to their achievements.

You cannot just tweak 1 part of the system, like of this brain, body environment system and expect that capabilities like what emerges out of this system to just, you know, explode exponentially.

Because anytime you improve 1 part of a system with many interdependencies like this, there's a new bottleneck that arises.

And I don't think even today, for very smart people, their brain is not the bottleneck to the sort of problems they can solve.

In fact, many various smart people today, you know, they're not actually solving any big scientific problems.

They're like Einstein, but you know, the patent clerk days, like Einstein became Einstein because this was a meeting of a genius with a big problem at the right time.

But maybe this meeting could have never happened.

And then Einstein would have just been a patent clerk.

And in fact, many people today are probably like genius level smart, but you wouldn't know because they're not really expressing any of that.

So we can think of the world, earth, but also the universe as just as a space of problems.

So all of these problems and tasks are roaming it of various difficulty.

And there's agents, creatures like ourselves and animals and so on that are also roaming it.

And then you get coupled with a problem and then you solve it.

But without that coupling, you can't demonstrate your quote unquote intelligence.

Intelligence is the meeting of great problem solving capabilities with a great problem.

And if you don't have the problem, you don't really express an intelligence.

All you're left with is potential intelligence, like the performance of your brain, or how high your IQ is, which in itself is just a number.

So you mentioned problem solving capacity.

What do you think of as problem solving capacity?

Like what does it mean to be more or less intelligent?

Is it completely coupled to a particular problem or is there something a little bit more universal?

Yeah, I do believe all intelligence is specialized intelligence.

Even human intelligence has some degree of generality.

Well, all intelligence systems have some degree of generality but they're always specialized in 1 category of problems.

So the human intelligence is specialized in the human experience.

And that shows at various levels, that shows in some prior knowledge, that's innate, that we have at birth.

Knowledge about things like agents, goal-driven behavior, visual priors about what makes an object, priors about time, and so on.

For instance, it's very, very easy for us to pick up language.

It's very, very easy for us to learn certain things because we are basically hard-coded to learn them.

And we are specialized in solving certain kinds of problems and we are quite useless when it comes to other kinds of problems.

For instance, we are not really designed to handle very long-term problems.

We have no capability of seeing the very long-term.

We don't have very much working memory, you know?

Do you think long-term planning, are we talking about scale of years, millennia?

What do you mean by long-term, we're not very good?

Well, human intelligence is specialized in the human experience.

Even within 1 lifetime, we have a very hard time envisioning, you know, things on a scale of years.

Like it's very difficult to project yourself at a scale of 5 years, at a scale of 10 years and so on.

We can solve only fairly narrowly scoped problems.

So when it comes to solving bigger problems, larger scale problems, we are not actually doing it on an individual level.

We, we have this thing called civilization, right?

Which is itself a sort of problem solving system, a sort of artificial intelligence system, right?

And it's not running on 1 brain, it's running on a network of brains.

In fact, it's running on much more than a network of brains.

It's running on a lot of infrastructure, like books and computers and the internet and human institutions and so on.

And that is capable of handling problems on a much greater scale than any individual human.

If you look at computer science, for instance, that's an institution that solves problems and it is superhuman, right?

It operates on a greater scale, It can solve a much bigger problem than an individual human could.

And science itself, science as a system, as an institution is a kind of artificially intelligent problem solving algorithm that is superhuman.

It's a, at least computer science is like a theorem prover at a scale of thousands, maybe hundreds of thousands of human beings.

At that scale, what do you think is an intelligent agent?

So There's us humans at the individual level.

There is millions, maybe billions of bacteria in our skin.

You can even go to the particle level as systems that behave, you can say intelligently in some ways.

And then you can look at Earth as a single organism, you can look at our galaxy, and even the universe as a single organism.

How do you think about scale in defining intelligence systems?

And we're here at Google, there is millions of devices doing computation just in a distributed way.

How do you think about intelligence versus scale?

You can always characterize anything as a system.

I think people who talk about things like intelligence explosion tend to focus on 1 agent is basically 1 brain, like 1 brain considered in isolation, like a brain, a jar that's controlling a body in a very like top to bottom kind of fashion.

And that body is pursuing goals into an environment.

You have the brain at the top of the pyramid, then you have the body just plainly receiving orders and then the body is manipulating objects in the environment and so on.

So everything is subordinate to this 1 thing, this epicenter, which is the brain.

But in real life, intelligent agents don't really work like this, right?

There is no strong delimitation between the brain and the body to start with.

You have to look not just at the brain, but at the nervous system.

But then the nervous system and the body are naturally 2 separate entities.

So you have to look at an entire animal as 1 agent, but then you start realizing as you observe an animal over any length of time, that a lot of the intelligence of an animal is actually externalized.

A lot of our intelligence is externalized.

When you write down some notes, that is externalized intelligence.

When you write a computer program, you are externalizing cognition.

It's externalized in computers, the internet, in other humans.

It's externalized in language, and so on.

So it's, there is no like, hard delimitation of what makes an intelligent agent.

Okay, but AlphaGo is better at Go than the best human player.

So do you think there's such a ability, such a concept as intelligence explosion in a specific task?

And then, well, yeah, do you think it's possible to have a category of tasks on which you do have something like an exponential growth of ability to solve that particular problem?

I think if you consider a specific vertical, it's probably possible to some extent.

I also don't think we have to speculate about it because we have real world examples of recursively self-improving intelligent systems, right?

So for instance, science is a problem solving system, a knowledge generation system, like a system that experiences the world in some sense, and then gradually understands it and can act on it.

And it is clearly recursively self-improving because science feeds into technology.

Technology can be used to build better tools, better computers, better instrumentation and so on, which in turn can make science faster, right?

So science is probably the closest thing we have today to a recursively self-improving superhuman AI.

And you can just observe, you know, is scientific progress today exploding, which you know, itself is an interesting question.

And you can use that as a basis to try to understand what will happen with a superhuman AI that has science-like behavior.

What is your intuition why an intelligence explosion is not possible?

Like taking the scientific, all the scientific revolutions, Why can't we slightly accelerate that process?

So you can absolutely accelerate any problem solving process.

So recursive self-improvement is absolutely a real thing.

But what happens with a recursively self-improving system is typically not explosion because no system exists in isolation.

And so tweaking 1 part of the system means that suddenly another part of the system becomes a bottleneck.

And if you look at science, for instance, which is clearly a recursively self improving, clearly a problem solving system, scientific progress is not actually exploding.

If you look at science, what you see is the picture of a system that is consuming an exponentially increasing amount of resources, but it's having a linear output in terms of scientific progress.

And maybe that will seem like a very strong claim.

Many people are actually saying that, you know, scientific progress is exponential, but when they're claiming this, they're actually looking at indicators of resource consumptions, resource consumption by science.

For instance, the number of papers being published, the number of patents being filed and so on, which are just, just completely correlated with how many people are working on, on, on science today.

So it's actually an indicator of resource consumption, but what you should look at is the output is progress in terms of the knowledge that science generates in terms of the scope and significance of the problems that we solve.

And some people have actually been trying to measure that.

Like Michael Nielsen, for instance, he had a very nice paper, I think that was last year about it.

So his approach to measure scientific progress was to look at the timeline of scientific discoveries over the past, you know, 100, 150 years.

And for each major discovery, ask a panel of experts to rate the significance of the discovery.

And if the output of science as an institution were exponential, you would expect the temporal density of significance to go up exponentially, maybe because there's a faster rate of discoveries, maybe because the discoveries are, you know, increasingly more important.

And, what actually happens if you, if you plot this temporal density of significance measured in this way is that you see very much a flat graph.

You see a flat graph across all disciplines, across physics, biology, medicine, and so on.

And it actually makes a lot of sense if you think about it, because think about the progress of physics, 110 years ago, right?

about the progress of technology, you know, 170 years ago, when we started having, you know, replacing horses with cars, when we started having electricity and so on.

And today is also a time of very, very fast change, but it would be an unfair characterization to say that today technology and science are moving way faster than they did 50 years ago, 100 years ago.

And if you do try to rigorously plot the temporal density of the significance, yeah, of significance idea, of significance idea, sorry, you do see very flat curves.

And you can check out the paper that Michael Nielsen had about this idea.

And so the way I interpret it is as you make progress in a, in a given field or in a given subfield of science, it becomes exponentially more difficult to make further progress.

Like the very first person to work on information theory.

If you enter a new field and it's still the very early years, there's a lot of low hanging fruit you can pick.

But the next generation of researchers is going to have to dig much harder actually to make smaller discoveries, probably larger number of smaller discoveries.

And to achieve the same amount of impact, you're going to need a much greater headcount.

And that's exactly the picture you're seeing with science is that the number of scientists and engineers is in fact increasing exponentially.

The amount of computational resources that are available to science is increasing exponentially and so on.

So the resource consumption of science is exponential, but the output in terms of progress, in terms of significance is linear.

And the reason why is because, and even though science is regressively self-improving, meaning that scientific progress turns into technological progress, which in turn helps science.

If you look at computers, for instance, our products of science and computers are tremendously useful in spinning up science.

The internet is a technology that's made possible by very recent scientific advances and itself because it enables, you know, scientists to network, to communicate, to exchange papers and ideas much faster, it is a way to speed up scientific progress.

So even though you're looking at a recursively self-improving system, it is consuming exponentially more resources to produce the same amount of problem solving very much.

And certainly that holds for the deep learning community.

If you look at the temporal, what did you call it?

The temporal density of significant ideas.

If you look at in deep learning, I think I'd have to think about that.

But if you really look at significant ideas in deep learning, they might even be decreasing.

So I do believe the per paper significance is decreasing.

But the amount of papers is still today exponentially increasing.

So I think if you look at an aggregate, my guess is that you would see a linear progress.

If you were to sum the significance of all papers, you would see a roughly linear progress.

And in my opinion, it is not a coincidence that you're seeing linear progress in science despite exponential resource consumption.

I think the resource consumption is dynamically adjusting itself to maintain linear progress because we as a community expect in your progress, meaning that if we start investing less and seeing less progress, it means that suddenly there are some lower hanging fruits that become available and someone's going to step up and pick them, right?

But there's another fundamental part which you're highlighting, which is a hypothesis of science or like the space of ideas.

Any 1 path you travel down, it gets exponentially more difficult to get a new way to develop new ideas.

And your sense is that's gonna hold across our mysterious universe.

Yes, well exponential progress triggers exponential friction.

So that if you tweak 1 part of the system, suddenly some other part becomes a bottleneck, right?

For instance, let's say, let's say we develop some device that measures its own acceleration and then it has some engine and it outputs even more acceleration in proportion of its own acceleration and you drop it somewhere, it's not going to reach infinite speed because it exists in a certain context.

So the air around it is going to generate friction and it's going to block it at some top speed.

And even if you were to consider the broader context and lift the bottleneck there, like the bottleneck of friction, then some other part of the system would start stepping in and creating exponential friction, maybe the speed of light, or, you know, whatever.

And this definitely holds true when you look at the problem solving algorithm that is being run by science as an institution, science as a system.

As you make more and more progress, this Despite having this recursive self-improvement component, you are encountering exponential friction.

Like the more researchers you have working on different ideas, the more overhead you have in terms of communication across researchers.

If you look at, you were mentioning quantum mechanics, right?

Well, if you want to start making significant discoveries today, significant progress in quantum mechanics, there is an amount of knowledge you have to ingest, which is huge.

So there's a very large overhead to even start to contribute.

There's a large amount of overhead to synchronize across researchers and so on.

And of course, the significant practical experiments are going to require exponentially expensive equipment because the easier ones have already been run,

So in your senses, there's no way of escaping this kind of friction with artificial intelligence systems.

Yeah, no, I think science is a very good way to model what would happen with a superhuman recursively self-improving AI.

It's not like a mathematical proof of anything.

I'm just trying to make an argument to question the narrative of intelligence explosion, which is quite a dominant narrative.

And you do get a lot of pushback if you go against it.

Because so for many people, right, AI is not just a subfield of computer science.

It's more like a belief system, like this belief that the world is headed towards an event, the singularity past which, you know, AI will become, will go exponential very much and the world will be transformed and humans will become obsolete.

And if you, if you go against this narrative, because it is not really a scientific argument, but more of a belief system, it is part of the identity of many people.

If you go against this narrative, it's like you're attacking the identity of people who believe in it.

It's almost like saying God doesn't exist or something.

So you do get a lot of pushback if you try to question his ideas.

First of all, I believe most people, they might not be as eloquent or explicit as you're being, but most people in computer science and most people who actually have built anything that you could call AI, quote unquote, would agree with you.

They might not be describing in the same kind of way.

It's more, so the pushback you're getting is from people who get attached to the narrative, from not from a place of science, but from a place of imagination.

Because the usual dreams that people have when you create a superintelligence system past the singularity, that what people imagine is somehow always destructive.

Do you have, if you were put on your psychology hat, what's, why is it so appealing to imagine the ways that all of human civilization will be destroyed?

And very interestingly, it mirrors religious stories, right, religious mythology.

See all Lex Fridman transcripts on Youtube

François Chollet: Keras, Deep Learning, and the Progress of AI | Lex Fridman Podcast #38