## Insane Week in the World of AI: OpenAI Drama and New Advancements

This week was an absolutely insane week in the world of AI. I stopped saying that every single week because I know it's lost its meaning this week, actually insane. And I'm not even just talking about all of the drama that went down at open AI. So much other stuff happened that kind of flew under the radar because all of that drama was happening. But it was one of the most insane weeks we've ever seen in terms of new advancements in the world of AI. So I'm going to break it all down for you right now.

### OpenAI Drama

I obviously can't talk about the past week in AI without mentioning all of the open AI Sam Altman drama. I'm not going to go deep into this in this video because I've literally made 4 videos about it already. But here's a super simplified version:

- November 17th: OpenAI announces a leadership transition. They fire Sam Altman. They demote Greg Brockman off the board. Greg Brockman leaves. A bunch of researchers leave.
- November 21st: Sam Altman is reinstated as the CEO of OpenAI. Greg Brockman's back. The researchers are back. Everybody comes back and pretty much the entire original board is out except for Adam D'Angelo.

### Q Star AI Breakthrough

Now let's talk about the news that came out after the OpenAI drama. OpenAI made an AI breakthrough before Altman's firing. They built a new model called Q star that was able to solve math problems that it hadn't seen before. The speculation is that the reason the board wanted to get rid of Sam was because they didn't want the commercialization of this Q star and they didn't want it to get into the hands of regular consumers because it's potentially too powerful.

### Other Advancements

While all the OpenAI drama was happening, other advancements were made in the world of AI:

- Inflection AI released a new model called Inflection 2, which outperforms popular alternatives from Google and Meta.
- Anthropic introduced Clawed 2.1, which has a larger context window and improved functionality.
- Elon Musk announced that the XAI chatbot Grok is launching to premium plus subscribers next week.
- Runway Research released their Gen 2 motion brush, allowing users to add motion to images.
- Luma AI improved their Genie research preview, allowing users to add negative prompts and control the seed number.
- Google Meet introduced an AI feature that detects when you raise your hand on camera.
- Sarah Silverman's AI copyright case was dismissed by the judge.
- PANDA, a new deep learning model, can accurately detect pancreatic lesions.

### Conclusion

This week was truly remarkable in the world of AI, with the OpenAI drama grabbing headlines and new advancements being made across various AI models and applications. The future of AI continues to evolve at an incredible pace, and we can't wait to see what the next week brings!

Stay tuned for more AI news and updates.

Best regards,
[Your Name]

Insane Week in the World of AI: OpenAI Drama and New Advancements

- The week was filled with drama at OpenAI, including the firing and reinstatement of CEO Sam Altman.
- Rumors suggest that OpenAI made an AI breakthrough with a model called Q star that can solve math problems and potentially decrypt encryption.
- However, there is no concrete evidence or confirmation of this breakthrough yet.
- Inflection AI released a new model, Inflection 2, which outperforms Google's Palm model and OpenAI's Lama 2 model.
- Anthropic introduced Clawed 2.1, which has a larger context window and decreased hallucination rates.

- CLAWD 2.1 testing showed that the position of information within a text affects recall accuracy, with the top and bottom of the document being recalled most accurately.
- Elon Musk announced that the XAI chat bot Grok will launch for premium plus subscribers next week.
- Google's Bard can now analyze YouTube videos and provide specific information without playing the video.
- Microsoft released Orca 2, smaller language models that outperform larger models in terms of performance, training time, and cost.
- Stability AI introduced stable video diffusion, which generates short animated videos using SDXL. It outperformed Pika Labs and Runway Gen 2 in user preference studies.
- Decoherence and Hugging Face offer free access to stable video diffusion.
- Runway Research released their Gen 2 motion brush for AI video generation.

- The video discusses various advancements in the field of AI.
- It mentions the introduction of motion brushes in Runway, a tool that allows users to add motion effects to images.
- The video also highlights the new speech-to-speech feature in 11 labs, which enables users to train the AI on their own voice or customize existing voices.
- Luma AI's Genie research preview, which allows users to generate 3D objects based on text prompts, is also mentioned.
- Google Meet has introduced an AI feature that detects when a person raises their hand during a meeting.
- Microsoft has disallowed the word "Disney" in its AI prompts, and Sarah Silverman's AI copyright case has been dismissed by a judge.
- The video concludes by discussing a deep learning model called PANDA, which accurately detects pancreatic lesions in non-contrast CT scans, potentially revolutionizing pancreatic cancer detection.

- OpenAI experienced drama with the firing and reinstatement of CEO Sam Altman.
- Rumors suggest OpenAI made an AI breakthrough with a model called Q star.
- Inflection AI released Inflection 2, outperforming Google's Palm model and OpenAI's Lama 2.
- Anthropic introduced Clawed 2.1 with a larger context window and decreased hallucination rates.
- Elon Musk announced the launch of XAI chat bot Grok for premium plus subscribers.
- Google's Bard can analyze YouTube videos without playing them.
- Microsoft released smaller language models called Orca 2, outperforming larger models.
- Stability AI introduced stable video diffusion, outperforming competitors in user preference studies.
- Decoherence and Hugging Face offer free access to stable video diffusion.
- Runway Research released Gen 2 motion brush for AI video generation.
- Various advancements in AI are discussed, including motion brushes, speech-to-speech feature, and Luma AI's Genie research preview.
- Google Meet introduced an AI feature to detect raised hands during meetings.
- Microsoft disallowed the word "Disney" in its AI prompts.
- Sarah Silverman's AI copyright case was dismissed by a judge.
- The video concludes by discussing the PANDA deep learning model for pancreatic cancer detection.

Here's all the news that happened this week on top of all of the crazy OpenAI drama. Don't miss this one! It's been an INSANE week!

Discover More From Me:
🛠️ Explore hundreds of AI Tools: https://futuretools.io/
📰 Weekly Newsletter: https://www.futuretools.io/newsletter
😊 Discord Community: https://futuretools.io/discord
🐤 Follow me on Twitter: https://twitter.com/mreflow
🧵 Follow me on Threads: https://www.threads.net/@mr.eflow
🐺 My personal blog: https://mattwolfe.com/

Resources From Today's Video:
OpenAI Leadership Change: https://openai.com/blog/openai-announces-leadership-transition
Altman Rejoins as OpenAI CEO: https://www.theverge.com/2023/11/22/23967223/sam-altman-returns-ceo-open-ai
Open AI Saga Part 1: https://www.youtube.com/watch?v=--c87N0f2BI
Open AI Saga Part 2: https://www.youtube.com/watch?v=pXQyjIzq2L8
Open AI Saga Part 3: https://www.youtube.com/watch?v=UYNKNzrOk_o
Open AI Saga Part 4: https://www.youtube.com/watch?v=24s4jwc4RoM
OpenAI's Pre-Ouster AI Breakthrough: https://www.theinformation.com/articles/openai-made-an-ai-breakthrough-before-altman-firing-stoking-excitement-and-concern
Breakthrough Spurs OpenAI CEO Change: https://www.reuters.com/technology/sam-altmans-ouster-openai-was-precipitated-by-letter-board-about-ai-breakthrough-2023-11-22
AGI Advancements Stir Discussions: https://www.theverge.com/2023/11/22/23973354/a-recent-openai-breakthrough-on-the-path-to-agi-has-caused-a-stir
ChatGPT Voice for All Users: https://twitter.com/gdb/status/1727067288740970877
Inflection AI's New Model Launch: https://www.forbes.com/sites/alexkonrad/2023/11/22/inflection-ai-releases-2nd-model-on-gpt-4-heels
Introducing Claude 2.1: https://www.anthropic.com/index/claude-2-1
Claude 2.1 Performance Analysis: https://twitter.com/GregKamradt/status/1727018183608193393
xAI's Grok Launch Announcement: https://techcrunch.com/2023/11/22/elon-musk-says-xais-chatbot-grok-will-launch-to-x-premium-subscribers-next-week
Grok Chatbot Preview: https://techcrunch.com/2023/11/21/screenshots-show-xais-chatbot-grok-on-xs-web-app
Google Bard's YouTube Update: https://www.theverge.com/2023/11/22/23972636/bard-youtube-extension-update-search-video-content
LLM Introduction Talk: https://www.youtube.com/watch?v=zjkBMFhNj_g
Microsoft's Orca 2 Release: https://venturebeat.com/ai/microsoft-releases-orca-2-a-pair-of-small-language-models-that-outperform-larger-counterparts
Stable Video Diffusion Introduction: https://stability.ai/news/stable-video-diffusion-open-ai-video-model
Stable Video Diffusion Showcase: https://huggingface.co/spaces/multimodalart/stable-video-diffusion
Stable Video Platform: https://app.decoherence.co/stablevideo
RunwayML's New Features: https://research.runwayml.com/more-control-fidelity-and-expressibility
Runway's Motion Brush Launch: https://twitter.com/minchoi/status/1726986639124414878
Speech-to-Speech Update: https://elevenlabs.io/blog/product-update-speech-to-speech-and-changes-to-voices
Genie Research Preview Update: https://twitter.com/LumaLabsAI/status/1727380109898707239
Google Meet Hand Detection: https://techcrunch.com/2023/11/22/google-meet-hand-detection-feature
Microsoft Blocks 'Disney' in AI: https://petapixel.com/2023/11/20/microsoft-ai-image-generator-blocks-disney-after-viral-movie-poster-trend
Silverman's AI Lawsuit Challenges: https://www.hollywoodreporter.com/business/business-news/sarah-silverman-lawsuit-ai-meta-1235669403
Pancreatic Cancer AI Detection Study: https://www.nature.com/articles/s41591-023-02640-w


Outro music generated by Mubert https://mubert.com/render
Sponsorship/Media Inquiries: https://tally.so/r/nrBVlp

#AINews #AITools #GenerativeArt

Time Stamps:
0:00 Intro
0:27 OpenAI Drama (TLDR)
1:56 Q-Star Math Implications
6:31 ChatGPT Voice For All
7:26 New Inflection-2 Model
9:02 Anthropic's Claude 2.1
10:55 Grok Availability (X AI)
12:03 YouTube Update To Bard
14:22 Microsoft Orca 2 Model
15:54 Stable Video Diffusion
19:36 Runway Gen-2 Motion Brush
22:03 ElevenLabs Speech-To-Speech
23:43 Luma Labs Genie Text-To-3D Update
25:03 Google Meet Hand Raise Update
25:28 No More Disney in Microsoft Images
25:43 Lawsuits Getting Slapped Down
27:14 AI Detects Pancreatic Cancer
28:32 Final Thoughts

This week was an absolutely insane week in the world of AI.

I stopped saying that every single week because I know it's lost its meaning this week, actually insane.

And I'm not even just talking about all of the drama that went down at open AI.

So much other stuff happened that kind of flew under the radar because all of that drama was happening.

But it was 1 of the most insane weeks we've ever seen in terms of new advancements in the world of AI.

So I'm going to break it all down for you right now.

I obviously can't talk about the past week in AI without mentioning all of the open AI Sam Altman drama.

I'm not going to go deep into this in this video because I've literally made 4 videos about it already.

You can watch 1 here, 1 here, 1 here, and 1 over here.

But the super TLDR, November 17th, OpenAI announces a leadership transition.

Pretty much everybody at OpenAI threatens to leave if they don't bring Sam Altman back.

All of the investors, including Microsoft, are pissed.

They offer Sam Altman and Greg Brockman a job at Microsoft with everybody at open AI, threatening to leave 2 CEOs, refusing to stay in that position.

Mira Moradi and Emmett Shear and all the investors pushing to bring Sam back 4 days later on November 21st, Sam was reinstated as the CEO of open AI.

Everybody comes back and pretty much the entire original board is out except for Adam D'Angelo.

As of right now, there are just 3 board members, Brett Taylor, Larry Summers, and Adam D'Angelo.

With it being expected that in the coming weeks or months, more members will be added to the board, most likely including some representation from Microsoft OpenAI's biggest investor.

Again, that's a super simplified version, but I've made a bunch of videos about it.

If you really want to deep dive in all of the trauma that happened, because that in itself was pretty crazy for the most part, that's where the story ended.

Now there's been a little bit of news that came out after that first reported on by the information open AI made an AI breakthrough before Altman firing stoking excitement and concern.

Rumor is that the researchers built a new model called Q star that was able to solve math problems that it hadn't seen before And the speculation is that the reason that the board wanted to get rid of Sam was because they didn't want the commercialization of this Q star and they didn't want it to get into the hands of regular consumers because it's potentially too powerful.

The following day Reuters, a very respectable news site claimed the same information ahead of open AI CEO, Sam Altman's 4 days in exile.

Several staff researchers wrote a letter to the board of directors, warning of a powerful artificial intelligence discovery they said could threaten humanity to people familiar with the matter, told Reuters.

Reuters was unable to review a copy of the letter.

The staff who wrote the letter did not respond to requests for comment.

Reuters contacted OpenAI and declined to comment.

There hasn't been a lot of verification yet which is why I haven't done a full breakdown of what is QSTAR.

Though only performing math on the level of a grade school student, acing such tests made researchers very optimistic about Q's future success.

The source said, now you might be wondering if this is only able to perform math on the level of grade school students.

So far, large language models aren't great at math.

They're great at predicting the next word in a piece of text, but not so much math.

However, with something like Q star that can perform math and also learn how to get better and better at math.

This leads to potential massive problems for humanity overall.

The reason being that encryption is such a huge part of everything we do online, our personal data, our usernames, our passwords, our financial data, all of this uses encryption, which the stronger the encryption, the harder it is for computers in hackers to break that encryption and get the information contained within the encrypted data.

However, if these algorithms get better and better and better at math, they will likely also be better and better at decrypting all of this encryption, the way the entire web is built by using encrypted information to keep hackers out and to keep computer programs from accessing all of this data.

Well, something like Q star as it advances could get better and better and better at basically hacking this data and on encrypting this information, which could potentially cause widespread chaos.

And that's just 1 of the implications of this potential Q star that they're talking about here and why some people probably don't want it in the hands of just anybody.

Now this is a gross oversimplification of the potential impact of all of this.

But if this technology isn't safely locked down and it gets better and better at math, the implications are huge and very scary.

Again, I haven't really reported on this in any of my videos because so far it's all been sort of hearsay.

A friend of a friend told their mom that they're doing this, right?

There's really no real verification other than the fact that I do think that both the Reuters and the information are fairly credible and thorough with the research.

As more information comes out and we do get confirmation.

I will definitely be making more content about this.

I just want something a little more concrete than what we've been given so far.

There's also this statement from the verge came out on November 22nd.

That says a recent open AI breakthrough on the path to AGI has caused a stir.

Of course, it's talking about Q star here and how this could be a step toward creating artificial general intelligence.

However, if we read the rest of this little statement here, it says, after the publishing of the Reuters report, which said senior exec Mira Murati told employees that the letter about QSTAR precipitated the board's actions to fire Sam Altman last week.

OpenAI spokesperson Lindsay Held-Bolton refuted the notion in a statement shared with The Verge.

Mira told employees what the media reports were about but she did not comment on the accuracy of the information separately.

A person familiar with the matter told the verge that the board never received a letter about such a breakthrough that the company's research progress didn't play a role in Altman sudden firing.

So at the moment, We've got anonymous sources, no confirmation from open AI.

In fact, we even have a denial from open AI and to be quite honest, we don't have a lot to work off of, but trust me, it's something I'm paying very close attention to.

And we'll likely talk about more as more information comes out around amidst all of the chaos that was happening at open AI when at a time when Greg Brockman didn't even know if he was gonna have a job there anymore he was still announcing new features including the fact that chat GPT with voice was now available to all the free users of chat GPT now if you're a plus user you've had it for a while you can open up your phone talk to chat GPT it responds to you It's sort of a better version of like what you'd get out of Siri.

Now that's available in the free version as well.

And it blows my mind that even among all of the turmoil, somehow open AI continued to ship a new feature.

And Greg Brockman, the ex president, the ex chairman of the board was making the announcements about it, even though at the time he wasn't even technically part of the company anymore.

Again, I've made a ton of content about the open AI drama.

Definitely check out those videos, but for the rest of this video, let's break down all of the news that flew under the radar.

While all the open AI drama was happening on Wednesday, November 22nd, while all of this was happening, Inflection AI released a brand new model that they claim is the second best model behind GPT-4.

The startup behind the chatbot Pi says it's Inflection 2 model outpaces popular alternatives from Google and Meta and is catching up to OpenAI's flagship bass.

Inflection 2 performed better than Google's Palm model as well as beat the open source Lama 2 model.

Overall, Inflection's model is the top performing of its size.

It only trails GPT-4, which is thought to be significantly larger.

It says here, the newly released model will soon be integrated into Pi, the chatbot that Inflection released in May, but first it needs a bit more extra work known as alignment to teach it Pi's tone and answering style, and to help Pi function better while absorbing up-to-date information without additional hallucinations," Suleiman said.

We can see here with the light green bars how it performed on a handful of benchmark tests comparing it to Palm 2 and Inflection 1 and you can see in all of these various benchmarks essentially tests that it gave the chatbot it Outperformed all of these other models interestingly They didn't put GPT 4 on here to see how it benchmarked against those again it's something we don't have access to yet as consumers.

Once again, as we do get access and they do roll it out into their pie, but we will definitely be exploring it some more and playing around with it and seeing what it can do.

But inflection wasn't the only 1 who released a new model this week.

Anthropic introduced Clawed 2.1 among all of the chaos that was going on at OpenAI.

If you've used Clawed before, you know that Clawed is really good at taking long documents and summarizing them into shorter documents.

Well, previously it had a hundred thousand context window meaning that it was able to ingest and respond with roughly 75,000 words.

But Cloud 2.1 here up to that to a 200,000 context window.

So this doubles the amount of input and output combined we can get from Claude.

Now we can use about 150,000 words, which is over 500 pages of material.

This new model also has 2 times decrease in hallucination rates, more functionality to the API and a better developer experience.

But really the main thing we care about is this 200,000 context window.

And the fact that it's going to hallucinate a heck of a lot less, we're going to be able to put in a lot of information, I mean, like full textbooks and ask questions about it and get responses now with Anthropic.

Greg Comrade here on X actually did a breakdown testing CLAWD 2.1 and basically found that where the information is located within the text matters, backs at the very top and very bottom of the document were recalled with nearly 100% accuracy.

Facts positioned at the top of the document were recalled with less performance than the bottom.

Starting at about 90,000 tokens, performance of recall at the bottom of the document started to get increasingly worse.

Even though it is a large context window your facts are not guaranteed to be retrieved and that position within the text matters claiming that facts placed at the very beginning and The second half of the document seemed to be recalled better He gave a lot more details into the findings from his Claude 2.1 tests.

And like always, I'll make sure it's linked up in the description below so that you can review it.

And some other exciting news, Elon Musk said that the XAI chat bot Grok is going to launch to premium plus subscribers next week.

That would make it the week of November 27th, sometime during that week we should be getting access.

You can see that Elon actually put it in a reply to somebody else's tweet.

Tesla owner Silicon Valley, X and Grok combined is going to be mind exploding.

And then Elon Musk wrote, yeah, Grok should be available to all X premium plus subscribers next week.

We also got a little sneak peek this week of what Grok could look like inside of the app.

You can see there's a new little slash icon here, and then a text box that says ask Grok.

So we'll just have to wait till next week and hopefully we can get our hands on it.

I'm really excited to make a breakdown video where I compare GPT-4, Clod 2.1, Inflection 2, Grok, and even Bard and figure out what each 1 is specifically best at.

That's a video that I'm really excited to make, but I'm just waiting to get access to all of these various different tools so that we can do that breakdown.

Speaking of Bard, Google made some updates to Bard this week.

There's been updates for every single large language model pretty much.

In this latest update to BARD, BARD can now watch YouTube videos for you.

BARD's YouTube extension can now handle complex queries about specific video content, like recipe quantities and instruction summaries.

It says, the BOT's YouTube integration is getting a handy upgrade so it can analyze individual videos to surface specific information for you.

Things like key points or recipe ingredients without ever even pressing play.

This article goes on to say it's not perfect.

At the moment the feature only exists as an opt-in labs experience and it does take a little bit of work to get the answer you're looking for.

For example, this person asked for a full recipe from a video, but Bard wasn't able to generate anything, but then asking it for step-by-step instructions on a subsequent prompt got the whole recipe.

Now if I log into my Bard account here, I click on my little extensions button.

You can see there is a YouTube extension that's already flipped on here.

And since this excellent video, honestly, everybody who's interested in learning about large language models needs to watch this video.

But since this video was released this week, I want to plug this in and see how well it does with a hour long video.

So this is a video from Andre Carpathia here.

It's called 1 hour talk intro to large language models, excellent breakdown.

And we'll jump into Bard, create a new chat.

I just pasted the URL to the YouTube video in here.

And it says I have watched the video and here's a summary.

The video is an introduction to large language models.

LLMs are a type of artificial intelligence, blah, blah, blah.

In the video, the speaker discusses the capabilities of LLMs.

Overall, the video provides a good overview of LLMs and their potential application.

So if I do something like give me the bullet points of all the main topics covered in this video, let's see what we get.

I actually got this message that says query unsuccessful, but then some bullets anyway, what are large language models?

What are the challenges of working with LLMs?

So it seems to have found bullets anyway, but I don't know if it pulled that from the video or if it actually pulled it from like the timestamps here that are all available in the description.

So like the original article said, still leaves a little bit to be desired, but we'll explore this more in future videos because this is a feature.

Although does scare me a little bit because what's to stop people from just getting summaries of my videos instead of watching the whole thing.

Hopefully you're watching it because you enjoy me talking about it and you don't want just the bulleted list, but I understand if you want to save time.

Continuing on in the world of large language models, once again, amid all of the chaos this week, Microsoft releases Orca 2, which is a pair of small language models that actually outperform their larger counterparts.

This model comes in 2 sizes, 7 billion and 13 billion parameters, and it either matches or outperforms models like Metas Llama2Chat70B.

That's a 70 billion parameter model that it was trained on and it's actually matching or outperforming with only 7 billion or 13 billion parameters.

Less parameters means a lot faster to train a lot faster to get responses a lot less expensive to use.

And likely you can run a model like this locally on your own computer.

Microsoft has open sourced both new models for further research on the development and evaluation of the smaller model.

Looking at their benchmark results here, we're looking at the light blue and the dark blue, the 2 lines on the left.

And you can see that 7 B 7B and 13B pretty much outperformed all these other models like Llama2Chat13B, Llama2Chat70B, WizardLM13B, and WizardLM70B.

So with these smaller parameter models, it is outperforming the much larger parameter models, which are a lot more expensive and time-consuming to train, but we got more wild announcements this week in the large language model world.

We've got anthropic, we've got barred and we've got Microsoft's Orca too, all making waves in the same week that this open AI drama was happening.

But we also got some really cool stuff in the AI art world including Stability AI announcing stable video diffusion.

Now stable video diffusion appears to be very similar to what we get out of runway gen 2 or Pika labs, or we can get like, you know, 3, 4 second short generations.

And they're roughly the same quality, maybe a slight improvement.

They are using stability AI's SDXL to generate the initial images that then become animated.

It doesn't feel like a huge leap yet above what we're getting out of Pika and Runway Gen 2.

However, they did do some tests against them.

I don't totally understand what these charts are showing us.

It says here that through external evaluation we have found these models surpassed the leading closed models in user preference studies so they must have been doing like polls to the audience of like here's a video and here's a video which 1 do you like better and sort of getting feedback on which ones people like better and with the stable video diffusion 14 frames SVD seemed to tie runway gen 2 and outperform Pika labs.

I guess more people said they liked the videos generated from SVD over Pika and the same amount for runway using the 25 frames model.

Stability outperformed both runway and Pico Labs, but you can actually use this model for free right now.

There's a hugging face space available right now, which uses stable video diffusion, do image to video.

So you can drag and drop an image here and get a video output in here.

But this 1 does not appear to use any sort of text inputs for it.

I drag this little wolf image here that I created in the past over into hugging face and click generate.

I get a message that there's a long queue of requests pending.

I am 10 of 10 and it looks like it's going to take about 300 seconds.

So while I'm waiting for that, let me show you the other option that is currently available, which theoretically should be quite a bit faster.

If you head over to decoherence.co they actually have a stable video free preview over here.

They've got this little race car image here experiment with the research preview of stable video free for everyone.

This 1 has both an image to video and a text to video option and we have a little slider to add less motion or more motion.

A rocket ship blasting off from a launch pad I put the motion to about 3 quarters and let's generate the video.

This looks like it's probably going a little bit faster over here.

So the decoherence version took about 1 minute here and we got a 3 second video.

We've got our rocket ship here and it looks like all the smoke is animating but nothing about the rocket ship itself is actually animating we're just getting this smoke but it was pretty dang quick to do it let's check in on hugging face I am now q5 of 8 let's try the image to video over here I'm gonna plug in this image here of a sort of river or lake with a tree and some clouds.

Let's go ahead and just generate this and see what it does for us.

The clouds are moving a little bit, came out pretty solid.

We've been going for 310 seconds and how my estimated time is up to 360 seconds.

This 1 took a full 8 minutes to generate after waiting in queue and then finally processing and we got a 3 second video that looks like this.

And it just kind of spins and warps and twists it into nothing.

I personally recommend checking it out over at decoherence.co.

You'll bypass a lot of the queue if you want to do it on hugging face.

Staying in the vein of AI video, this week Runway Research finally released their Gen 2 motion brush.

We teased it in last week's video and got a peek of what it'll look like this week.

I found this Twitter thread here from Min Choi of a bunch of different people showing off their generations that they made with this new motion brush with Gen 2.

I will link this up in the description below So you can see some other examples of what other people have done with it.

But personally, I want to get in and play with it myself.

So jumping into runway here, I get this pop up that says motion brushes now available.

Motion brushes now available in image to video, just paint an area or subject in your image, choose a direction and your movement intensity value.

So I just uploaded an image here that I generated with mid journey.

Let's go ahead and click on motion brush.

And you can see I've got like a, another little river here with some clouds and a tree, Go ahead and make our motion brush a little bit bigger.

And let's see if we can get it to just kind of affect the clouds up here.

Let's make a moving to the left and I'll leave the vertical and proximity movement the way they are.

And let's just go ahead and generate see what it gives us.

Well, it took less than a minute to generate it.

1 thing I'm really noticing is how much the light is impacted.

You can see the sun sort of streaking through the clouds here, and then you can actually see the reflection on the water changing as the clouds move and if you look at the tree the tree has no motion to it the ground has no motion to it it just affected the clouds and the reflection in the lighting like this is actually a lot better than I was expecting like I'm pretty blown away by this I actually want to try 1 more.

So I uploaded this image of a girl with like butterflies around her and I want to see if I can get some motion on just the butterflies.

So I'm just gonna go ahead and mask only the butterflies and let's do proximity movement where Maybe they're getting closer and maybe a little bit of vertical movement.

I'm going to leave the horizontal movement alone on this 1.

And let's see what we get out of this, but they're not flapping their wings like butterflies.

They're more kind of falling, but if you look at it, it did a great job.

The girl in the middle is staying consistent.

The ring around her is staying consistent.

None of these flowers or anything are moving.

The only things that are moving are the butterflies that I highlighted, which I think maybe it thought was flowers or something.

It's only animating the stuff that I highlighted and not the stuff I didn't want it to highlight.

We also got some advancements this week in the world of AI voice cloning, 11 labs, probably the best text to speech generator on the market right now announced that this week they now have speech to speech.

So you can train 11 labs on your own voice or custom voices.

You can use 1 of 11 labs existing voices.

And just like before, you can type in text and get it to say out that text in that voice.

But also let's say you want it to give certain inflections on your voice or speak in a certain tone or emphasize certain words.

See all Matt Wolfe transcripts on Youtube

This Week's AI News Changes The World Forever!