Transcript
Use with ChatGPT / Claude Auto-scroll A
The speaker introduces an unusual hacking experiment and shows ChatGPT controlling an Alexa routine and an iPhone to automate a photo frame. This section builds excitement around the idea that AI can now perform complex smart home tasks without coding knowledge.
In case it's not obvious from what you clicked on to get here, I'm about to do some hacking, but I have zero coding experience, like none.But I've found something that ChatGPT can do that other people haven't figured out yet, and I mean that.I've not seen anybody else doing this yet.Um let's go back to yesterday.
I can't believe we've gotten to this point in 2026, but I want you to use the attached photo in an Alexa routine so that if my wife says the baby is asleep, that you automatically load up a photoon the photo frame.You need to use the Alexa app to create the routine.You need to use Home Assistant to start the automation.The photo is attached.Go.Oh.And I don't want to do anything.
Just building its own YAML right now.
So he's creating a script in Home Assistant right now all by itself, and it's saying it's going to upload a web image to a particular device using the SwitchBot Cloud connection.The SwitchBot Cloud connection is going to go and fetch the image from Home Assistant on an external URL which it is creating.And it's just decided which picture frame it's going to put it in.Oh my god.
It is controlling my iPhone.It's controlling my iPhone.I don't believe it works.This means I you doIsn't it?Get back to work.Chat GPT can do anything.Oh my god.It's going to create an automation.I've got I promise I'm not touching it.That's what she said.Okay, create a virus while he is asleep.
Okay.
What?
It's testing it.It's just told it a thing.Holy crap.Just a picture of my beautiful son.
There it it is.There's a picture of my beautiful son.
Alexa.
The baby is asleep.
Okay.
Is it going to walk?
It's doing it.I didn't do anything.I didn't do anything wrong.
That's so good and I can do so much more with it.So much more with it.Chat GPT controlled my iPhone.This it could control my Android using the same tactic and this means that not only can I do things like get it to correct Alexa routines and get it to wipe out old devices and audit all that stuffand get it all fixed up.You can get it to do packet sniffing on your network which is something I am not personally capable of doing.I don't have the education.Chat GPT can packet sniff on the network which means I can hack other stuff.It's rewriting Switchbot's code.We are living in bizarre times.This is weird.Chat GPT is rewriting somebody else's code on my system so that it will work.Like Holy sh If you're not a mega nerd, this AI frame does an awful lot of very very cool things even without hacking it, so stick around cuz I'm going to tell you all about it as part of
this video too.But primarily I wanted to show you the preposterous things you can now do simply by talking to computers and having literally no coding knowledge whatsoever.Let's go over there.
The video shifts to a sponsored overview of the SwitchBot AI Art Frame 2, covering its upgrades, battery life, display improvements, and image-changing features. The speaker demonstrates the different image modes and explains why the device is appealing even before the hacking begins.
Thanks to SwitchBot for sponsoring today's video and for sending me their SwitchBot AI Art Frame 2.This is not the video I intended to make.Behind me right now my um Mac is connected to my iPhone and Chat GPT is connected through my Mac into my iPhone and is now monitoring traffic as it deletes stuff from the SwitchBot AI Art Frame 2 tosee if there is anyway to reverse engineer that and do it in Home Assistant because of something I'll explain at the end of the video.But first of all, let's talk about some of the big changes from the previous AI Art Frame 1 to the AI Art Frame 2 as I unbox it with Yes.Yes, it will be me unboxing it, not a robot.I'm not that lazy.So the big upgrades here are that the smallest version of this thing has way more pixels per inch than it had previously, which is awesome.
The other two are still the same number of pixels per inch, but they were already pretty good.There is now a much much bigger battery life.So originally it was a two years battery life if you change the image on the screen once a week.They're now saying a three years battery life if you change the image on the screen every single day.So that is a gigantic improvement.You can now triple tap at the picture frame to it to change picture.
Which is super super cool.And there is now no white border.This was a big complaint.There is a gigantic white border on the previous one, which I actually quite like.Other people said they didn't like that, and now there is no white border whatsoever.Huge huge changes.Haters will say that was AI.Clearly not AI, is it?
You fool.I've been training this your Jedi arts by Count Dooku.
Stop about, Kenobi.He's got the lungs of a pensioner.He's just hanging out waiting to be shot.Can we go to Maccie D's on the way back?
So this whole tap to change image thing is a lot more interesting than I realized because you've got multiple options.You've got art discovery, which is kind of actual arts from the real world.You've got album image, which is mine, um whatever I upload.And then you've got voice to image, which is AI.Um so let me just first show you it changing my picture.
Dopamine noises.I had no idea I was going to get dopamine noises.Like going to Disneyland.
More beautiful pictures of my handsome son.Anyway, they are images from my album called um normal art.I didn't call it that, so SwitchBot obviously think this is perfectly normal.If I change to Art Discovery, don't give it a bump.
All my picture of some real ass art.What I can't see is any way of figuring out who made that art.That would have been nice I think to maybe have credited the artist.It's not in there, which is a bit of a shame.I'd like to know who made that so that I could get it back again for one thing.I mean, I I'll never see that again perhaps.Now, voice to image is another option.
Give me a picture of Jeff Bezos in a rocket ship floating in space.
Is that really going to work?
Sam?Sam?I know you can hear me, Sam.Talking to you through your screen, Sam.Subscribe, Sam.And everybody else too, of course.Everybody subscribe.In case you didn't see the first AI art frame from SwitchBot, the idea of these things is that you don't have to power them.They are entirely battery powered and they are my favorite ever smart home gadget as a consequence because I can surprise my wife with new pictures of our son or wish her a happy birthday when it's her birthday.Now, they don't have the big bulky white frame and their battery life is like basically was it tripled?I mean, the battery life is insane now.These are just phenomenally good things.They're not cheap.We'll talk about that later on in the video, but first let's get back to the hacking.
The speaker dives into the technical challenge of making the new frame work with Home Assistant, including patching the integration and sniffing network traffic. ChatGPT helps discover how to control the frame locally, delete images, and bypass cloud-only limitations.
And this is where things become completely insane.So
I found that the new picture frame wouldn't be discovered by Home Assistant at all, which was why I was trying to work with the old picture frame and I'm getting really frustrated.I'm like, I want to use the new picture frame.And I thought, why doesn't it work?Why doesn't it work?And ChatGPT says, okay, well, they've not added it yet.I'm like, um, could you add it?It is rewriting Switch Box code.It's rewriting the integration in Home Assistant to accept the new picture frame.We are living in bizarre times.This is weird.ChatGPT is rewriting somebody else's code on my system so that it will work.Like holy shut up, Wesley.It.Yes, I know I keep doing that joke.It's because it's brilliant.I keep thinking I'm done.I think I keep thinking I've got to finish this video now.I've got a deadline to meet.
And then and then I think maybe I could make it run locally.It's doing it.The the my ChatGPT sat on my Mac right now has used Bluetooth to connect to the frame and has started sending commands over the network locally to see if it can do stuff.And it's like just need to analyze the signals, figure out what it does.It's doing it.It's just just switched the picture in the frame using Bluetooth from my Mac.What?That's absolutely outrageous.So it's now figuring out if you can actually upload a picture to it and delete a picture from it.It's doing basic commands at the minute like moving the picture on.We'll find out at the end of the video if it worked, but this is crazy.This is a brand new level of crazy because it's not even connected via a cable to this thing.
It's just doing it over the air.Absolutely mad.Just did that.I didn't do that.It's doing that as part of its testing.It's just so weird.It's so weird because I am literally just like watching stuff happen on my Mac and then something will happen behind me and I have no idea what's going on.Absolutely no idea what's going on.
Is it too cheesy to say we're not in Kansas Dorothy, because we're not in Kansas anymore, Dorothy.
MY NAME IS NOT DOROTHY.UNSUBSCRIBE.
ANGRY Home Assistant Virgin, now with real thrusting action.Only from Mattel.
Always raging and he never smiles.Bespoke configuration .yaml files.
So just to recap then, first of all Chat GPT repaired the Home Assistant integration for Switchbot so that it will accept the new AI art frame before Switchbot had released that.It just it patched the existing integration the way Switchbot are planning to patch it eventually, which is insane.Then it found the AI art frame and started sending it commands, making sure it could control it using the integration, which it could, but that wasn't enough because I wanted to be able to do more things.For example, it wouldn't allow me to delete things off the frame.I need to be able to do that because if I want to send an image that says the baby is asleep, that image is then in its rotation and it's going to keep coming up when it shouldn't.I need it to be gone again.Home Assistant needed to be able to delete files off it.
So the next thing I did was got Home Assistant to start listening to the network when those delete requests were happening on the app so it could reverse engineer that and make Home Assistant do it, which it nowcan.Then I said, I'm not happy with that because it's all happening via the cloud.Make it work locally.It's it's it's in the process of doing that right now.We'll find out at the end of the video whether it's done it because it literally hasn't finished yet, but what in earth is this life?I feel like I'm in a fever dream.It reminds me of that time that I was on the sofa ill and I was somewhere between watching my kid's super annoying cartoon and the Batman movie and then I fell asleep.
Leo the Inquisitive Truck, he has come again to help us.
You're garbage.You kills for money.
Don't talk like one of them.You're not.Even if you'd like to be.
First dent.I
have one rule.
Then that's the rule you'll have to break to know the truth.
Which you has.
The only sensible way to live in this world is without rules, and tonight you're going to break your one rule.
WHERE ARE THEY?YOU HAVE NOTHING.Nothing to threaten me with.
Leo, Leo, Leo the truck.
So ChatGPT has now been working for literally hours.Um and I've just seen the picture frame changed to the picture it wasn't able to send across via Bluetooth locally.Which means that I think it's worked.I think I'm about to find out.I've not looked at the screen.I think I'm about to find out in real time if it has successfully tricked that picture frame into thinking that my mini PC is its app installed on a phone.If it has, this is monumental.
The automation finally succeeds, with the frame updating locally and responding to the baby's sleep routine without manual input. The speaker wraps up with practical caveats, subscription details, and a closing endorsement of the frame and the channel.
I did it.The direct Bluetooth upload succeeded.All 960,000 bytes transferred and a fresh storage read confirms the new images on the frame.What planet is this?Home Assistant just sent that.Home Assistant just Well, ChatGPT did via Home Assistant.It just sent it from my mini PC straight to the frame locally.What planet is this where me who can't code for just tricked that picture frame into thinking that my mini PC was a phone with their app on it.
I didn't I mean I didn't ditto.Yeah, ChatGPT did.What the The image you're looking at right now happened because my wife put the baby waterfall sounds on to help Theo sleep.It happened automatically.She didn't have to say anything.The picture just appeared and that's how I know it's finally solved.Chat GPT has done it.I now have flipping a picture frame that can tell me when Theo is asleep simply because of an automation when my wife said turn the baby waterfall sounds on.So I mean that happens anyway.She does that every single time he goes to bed, which means that now comes on every single time he goes to bed.I know not to go and make a whole load of noise in the house and she didn't have to do anything.She didn't even have to think.And this is mind-blowing, right?
If I go into Home Assistant now on my phone, I can actually upload files to this thing.So if I've got a picture on my phone, I can just upload it to here.I've got a picture on my computer, I can upload it to there.Or I can generate pictures because I also added an AI art generator, which is entirely free.I can describe a picture to this thing and it appears on that frame literally about 20 seconds later.I can choose pictures, I can generate pictures, and I have automations and it is all happening locally.Obviously the AI art generation is happening on a server somewhere, but I could even localize that.I could have that point at my own computer and generate AI art locally and have it sent to that frame entirely locally.The only thing that is now cloud-based is the actual switch box setup of the frame initially.
You have to get the frame set up so Home Assistant has something to point at.Once it has something to point at, entirely local.I and it's taken four days.It was not easy, but it's done.And uh and when I say it's not easy, I mean it was easy for me.
This is a Spectra 6 E Ink display, which is as good as it gets currently as far as I know, but photos on it still look pretty shoddy.You need to be uploading kind of pencil sketches, watercolor paintings, artwork that doesn't look like a photo because the human eye very quickly goes that doesn't look right when it's a picture.On your screen now is what it looked like on the previous versions.It's no different on these ones.It's exactly the same technology when it comes to actually creating the image.The image does not look good for photos.At time of filming, it's still pretty buggy.So, as I already pointed out, the Home Assistant integration just doesn't work at all.I had to actually patch it myself.Um I'm going to link you in the description if I can to exactly what I did so you can do it too if you want to, but they say it will be fixed in December.
Similarly, in my testing from a bug perspective, if I turned on knock on frame, which I thought was a really cool feature, I could no longer send an image to the frame.My I had to switch that off before I could send an image to the frame again, which is a weird bug and obvious bug is obvious, which but get get that fixed.
Hello everyone.I'm Lena, product marketer at SwitchBot.
Sorry, Lena.Then there's the subscription aspect of the Still talking.Stop leaving.The subscription aspect doesn't relate to everything.You can still use your own images and upload them to the frame, which means you can create artwork in ChatGPT, stick it on the frame, Bob's your uncle, doesn't cost you a penny.If you want to do the knock on the frame and then speak to it to generate an image, that is a subscription-based service.I can't remember how much it costs.I shall write it here.Um and it's the same if you want to create an image in the app.Anything that involves AI image generation is a subscription-based thing, but you can generate your own images wherever you want and then upload them.Doesn't cost anything.Just thought it was worth mentioning there is a subscription for their AI image generation in SwitchBot's app.
As usual, there are links in the description as to where you can pick up these absolutely awesome frames.Again, I can't stress enough.These are my favorite ever smart home product.I love having something on my wall that I can just change at will and I don't have to wire into the mains.My wife loves them.I love them.Theo loves them.These are my favorite ever smart home gadget.If you want one, links are in the description.All that remains to do is to thank these incredible people running up your screen right now.They're my patrons from Patreon without whom I couldn't do this for a living and neither could Nisha.If you want to be like those guys or like the person I'm thinking this week, which is Steven 510, you can come and do that at either Patreon or buy me a one-off beer at PayPal and either way
I would genuinely love you forever.These are my Facebooks, my X, my Threads, my Instagrams, and my TikToks.Come and hang out there and we can be best friends.See you next time.