The Vergecast - The all-seeing AI webcam

Episode Date: July 21, 2024

On this episode of The Vergecast, senior producer Will Poor explores the AI-tinged worlds of Dries Depoorter. Depoorter has built all manner of quirky and provocative installations and online experime...nts. There’s a clock that tells you how much of your life you’ve already lived; a phone charger that only works when your eyes are closed; a mobile chat app that you can only use when your phone has less than 5% battery. His most eyebrow-raising work, though, is around AI and surveillance. In his projects Depoorter takes publicly available webcam footage from around the world, and uses it to stalk celebrities, catch jaywalkers in the act, keep politicians honest, and generally make you wonder about your own privacy and anonymity. We talked with Depoorter about how he creates his work, how he thinks about the future of AI, and how he responds to the people who see his art and want to turn it into commerce. It’s a wild conversation, so check it out above. To see all of Dries’ work, head over to his portfolio. Learn more about your ad choices. Visit podcastchoices.com/adchoices

Transcript
Discussion (0)
Starting point is 00:00:00 Support for the show comes from Retool. Too many companies run critical operations on duct taped spreadsheets, Slack workflows, and whatever else they could cobble together. Not because they want to, but because building internal tools means weeks of waiting on someone else's backlog. That's where Retool comes in. Build custom internal tools just by describing what you need. Prompts something like,
Starting point is 00:00:22 Build Me a Revenue Dashboard on our Salesforce data. And Retool actually builds it on your company's data, in your cloud with enterprise security built in. Go to retool.com slash Vergecast. We all need to retool how we build software. Welcome to the Vergecast, the flagship podcast of streaming services that are just the living rooms of strangers to their webcams.
Starting point is 00:00:50 I'm your friend David Pierce, and this is the second episode in our three-part series about AI. Like I mentioned last week, we're trying to find ways to make AI sort of real and in the world. We talk about AI and these like big, huge, sprawling ways. We wanted to see if we could find three stories about how AI is actually being used by actual people in the actual world. And for this one, our second one, Willpour has a story.
Starting point is 00:01:14 Hi, Will. Hello. So if memory serves, at the beginning of this, we tasked you with not just like finding a story about an AI app, but like doing something, doing something different. Like, let's see where AI is being used that isn't just to like write slightly better business emails. Yeah. What did you find? I went as far a field as I could go. I wanted to get away from the hype and skepticism cycle around all the AI tools that we're talking about, get away from all the product announcements that were following. I wanted to make AI kind of unfamiliar to myself again. And a coworker, as I was chatting about this, reminded me of this thing that got shared around the verge a ton a couple of years ago. It was a project that was called The Follower. And it used facial recognition to match social media photos to open webcam footage. So basically, this thing looked at unsecured webcams in like Times Square. And then it looked at public Instagram photos taken at the same time in the same place
Starting point is 00:02:20 and used facial recognition to match up the people that appeared in both feeds. So you got this creepy second angle on social media posts that came from these unsecured webcams. Oh, man. That's one of those things that it's like you put all this information on the internet
Starting point is 00:02:37 and you sort of exist in the world knowing that there are lots of cameras around. But I feel like nobody ever thinks about it. And like, we've talked about this a lot on their show that like having
Starting point is 00:02:45 computers collect information about you is one thing and it feels bad but you don't really think about it. But then when it shows it back to you yes. It becomes, it feels different. Right?
Starting point is 00:02:55 Like it becomes visceral in a way that feels almost like horrifying, even though you're like, well, yeah, I took that picture Put it on the internet. Completely. And for it to be paired with, as you say, these webcam feeds that you know in the abstract
Starting point is 00:03:08 are out there everywhere and following you around, but you just don't have evidence of you out there in them. And that's what this does. So if you scroll through this project, I saw this one photo of a guy in a leather jacket who's casually leaning against this famous bar in Dublin. It's a very standard sort of social media post. then in the camera footage, you get to watch him try out different poses and angles. He A-B-tests jacket or no jacket when he's taking this picture. You see how the social media post came to be.
Starting point is 00:03:44 There's this other shot of these very two cool hip guys strolling through Times Square. It's really epic looking. But then in the webcam footage, you see them just walking through busy Times Square. They almost bump into someone who's wheeling luggage around. It is just like it totally changes your view on social media posts and how they came to be? That thing is like a schick of some social media posts. Like I saw a TikTok the other day that was a person explaining how to sleep in an airport. And she, like, you know, put her bags on and attached everything to her in such a way that it would be hard to get off of her, puts on her eye mask, and puts up her hood and goes to sleep.
Starting point is 00:04:22 And then it was stitched by somebody who like walks over, waves in her face and then just steals her phone. And it's like the like pulling back. the curtain on how this stuff actually works is like part of how this all works on the internet. But the people doing it are still the ones in control. This is just like the world is telling on you in a way that it kind of like, like there are people who would make those behind the scenes video of them doing the 10 different tries, the blooper reel and whatever. But when it's somebody else doing it to you because they saw it happen. Yeah, it's like if that person stitching the TikTok was actually there for the recording of the first TikTok and messing with the person as they were doing it, which is just next level weird and creepy. Seriously. That's what I gravitated towards because it's all of this very publicly available data plus AI equals weird disconcerting stuff.
Starting point is 00:05:12 And I just, I figured whoever made that, whoever made the follower would have a lot of very different, very interesting thoughts on AI. So I called him up and talked to him about it. Just to get started, start with the hardest question first. Just tell me your name and what you do. My name is Driesa Porthir, and I'm an artist working with technology. Dries is 33 years old. He lives in Belgium. And for more than a decade, he's been using technology in ways that are inspiring, silly, and kind of disturbing. His work is this unique mix of technical proficiency and outlandish ideas.
Starting point is 00:05:53 So I have a background in electronics. I studied electronics for six years. really loved it. I was really enjoying experimenting with electronics, but I missed a sort of creativity. So after I was graduated, I went to an art school. There was like a really weird switch. I was studying media art, and I really loved it. It was something totally different. After that, I went to an advertising company, and I worked for two years as a concept provider.
Starting point is 00:06:36 That's someone that's come up with ideas for the agency. So that's the fuel mixture for this guy. Electronics plus art plus weird concepts. When I scrolled through Dries' portfolio, the first concepts that caught my eye weren't actually AI-powered. Lots of his ideas are these simple, clever conceits brought to life. They're little bottle universes that play by one or two really simple rules. Like, he built this interactive exhibit called Recharge. It's a phone charger that only works when your eyes are closed.
Starting point is 00:07:09 In the gallery, you lie back in a lawn chair and plug your phone into an outlet. But there's a camera pointed at your head and a computer running face tracking software. So the exhibit only sends electricity to the outlet if your eyes are closed. He also made a website that you can take over and post any. anything you want, but only if you have more followers on X than the last person to do that. The latest person to post is a guy named Kev Adams, who just wrote subscribe to Kev Adams. One other project that I still can't get out of my head is a little gadgety-looking LED clock in a classy wooden frame that Dries actually makes and sells.
Starting point is 00:07:49 So I have a project called Short Life. It's a clock. It's a clock that shows a percentage. And that's a personal percentage because it shows how much of your life that is already completed based on your life expectancy in your country. I have like different people that order it. Like sometimes I have fathers that bought it for the newborn or this year I sold a clock for someone that has more than 120%. So that that person was 108 years old. Oh my gosh. And I will only sell one million. Just one million.
Starting point is 00:08:33 It's a limited edition. Only one million. Order now before it's too late. If it's not clear from all these projects, Dries loves the elegance of a good, simple idea brought to life through lots of tinkering. The first idea is most of the time really complex. But then I try to make them really small.
Starting point is 00:08:55 For me, it's important that I can, explain the ID in one sentence. I also have this Notes app in my phone and a note, a lot of random IDs. Most of the time, they're really bad IDs. And what I do is I always go back to their list. And what I do is combining two bad ideas together. That makes like a better ID. Do you have an example of two bad ideas that made one good idea?
Starting point is 00:09:26 I think a good example here was an app that I developed named Die With Me. And Die With Me is an app which you can only use when you have less than 5% battery on your phone. If you have less than 5% battery on your phone, you can start chatting to other people having a battery below 5%. How I came up with this idea, I was in a city where I was not able to find my way back to my home. hotel because my phone died. And for me, that was really inspiring. And I was like, okay, I'm like really, really dependent on my phone. I'm even not able to find my way back.
Starting point is 00:10:12 And then I had this idea like, okay, I will make an app that you can only use when you have a low battery. And I noted that later that night in my phone and I think it was on my phone for like more than a year because I was not able to find like a good idea with it because I had like only this concept of okay let's build an app which you can only use when you have less than 5% battery but I was like really okay it needs to be like a dating app or sort of a game but that was really not perfect for me it didn't click or something and then I had like a vague idea of like a chat app And then I just one day I was reading through all the ideas, and then it clicked, like, okay, die with me.
Starting point is 00:11:03 It's like a chat app. That's the best concept. Of all the ideas that Dries mixes and matches in his work, there are two that just seem to keep coming up over and over again. AI and surveillance. He says he got started down this path after making a discovery on one of the sketchier corners of the internet. During my work at the advertising agency, I was really into exploring open cameras. When I talk about open cameras, I'm talking about cameras that are connected to the internet with a standard password or no password at all. How did you discover them and what was so exciting about that resource?
Starting point is 00:11:48 I discovered them through a website called Show Them. It's sort of a surge engine, but it doesn't index website, but it index machines on the internet. So with this tool, you are able to find open cameras. You find cameras in living rooms and places where people, I think, don't want to have that publicly open. I checked out this website, Shodin, and it is exactly how Dries described. it. After just a couple of clicks, I found myself browsing webcams that definitely aren't supposed to be public. Some were innocuous, like close-up bird feeder cams. But I also watched people playing with dogs inside a doggie daycare business. There was another camera in a living room that I could
Starting point is 00:12:41 control, like pan it around. I got really weirded out and closed all the tabs. Shodan is a site that you could do deeply sketchy things with. And this is a pretty... personal nightmare of mine, that I don't know enough about how my own gadgets work or have enough of a handle on the tech around me generally, that I'm somehow broadcasting myself out into the world without realizing it. Like, I'm a sticky note on my webcam person. I'm superstitious about all of it. Okay, but wait, hold on. Well, hang on. Let's talk about how superstitious this actually is, right? Because there is a thing happening with all of these AI companies, that there is this incredible race to get tons of data.
Starting point is 00:13:23 A vast amount of that data that is just like a thing that someone made that is finished on the internet, right? Yeah. We kind of know what to do with an article or even like a YouTube video. But the idea of all of these webcams around just collecting data all the time.
Starting point is 00:13:39 Like if you think about live video as just a live stream of data, it feels very different to me. Yeah. Like you're saying, like you're finding these things where I think lots of people are setting up webcams and don't know. Like we've all heard the horror. stories over the years about people who are hacking into other people's like baby monitors and all kinds of stuff. And so part of me is I'm not really a tinfoil hat kind of person, but the idea of
Starting point is 00:14:00 these are unbelievable fountains of data, plus there are more and more compelling reasons for people to want to get access to and store forever all of that data feels kind of terrifying, especially then if you can figure out how to ask kind of the right questions of all of that stuff. Like maybe that's the challenge there is we're going to end up with just a hundred years of time square. And then the question is like, well, what do we, what do we do with any of this? But it's all there. You just have to know what to do with it, right? Yeah, that's, well, first of all, thank you for co-signing my paranoia. I mean, it's funny, I'm not, I'm not a sticky note of the web cam, yeah, yeah.
Starting point is 00:14:37 Like, it's, I never really have been. My sense is like, I'm not quite in the, I have nothing to hide camp, but I'm in the, like, as long as I'm reasonably responsible, it's probably going to be fine camp. But like, I've been to Times Square. There's probably video footage of you. Yeah, absolutely. Yeah. And I, that is where it's like, okay, it's, it's no longer just like a thing that I'm in relative control of and should avoid making mistakes. It's just like being a person in the world, you become training data. Yeah. And I mean, that just fans. I don't, I think you're right that the vulnerability of my MacBook camera probably has not changed dramatically with the advent of all of these AI companies hoovering up data, but it just fans the flames so much more.
Starting point is 00:15:23 Totally. And so, like, these are, when I look through all of Dries's projects, this is all what comes up for me. And so that's like, that's my reaction to it. And I'm so interested in his work because I think he has all of the same questions that we're asking, but instead of putting sticky notes on his webcams, he made a lot of really fascinating stuff around it. I was really inspired by this and it started a lot of my projects around surveillance. We need to take a quick break, but when we come back, Dries starts mashing together AI and sketchy webcam feeds, and things get real weird fast. Support for this show comes from Shopify.
Starting point is 00:16:10 Starting something new isn't just hard. It can be really scary too. So much work goes into this thing that you're not entirely sure will even work. But he's a lot of it. here's a better thought. What if it did all work? What if your instincts were actually right all along? Shopify wants to help you get there. They're the commerce platform behind millions of businesses worldwide and nearly 10% of all e-commerce in the U.S. from established brands like Allbirds and Hines to companies just getting started. Their design tools make it simple to create the exact online presence you're envisioning with hundreds of ready-to-use templates available. And with built-in marketing tools, you can launch full email and social campaigns in just a few clicks. So you can connect with
Starting point is 00:16:53 customers wherever they are. It's time to turn those what-ifs into with Shopify today. You can sign up for your $1 per month trial today at Shopify.com slash vergecast. You can go to shopify.com slash vergecast. That's shopify.com slash vergecast. Welcome back. We're talking with artist and engineer Dries De Porter. At this point in the story, Dries has discovered a treasure trove of unsecured webcam footage from around the world. And being a tinkerer, he starts to wonder what tools he could build to do fun things with all this raw material.
Starting point is 00:17:37 So I found an open camera, and it was filming a lot of traffic. And I discovered that in the live image, I was seeing a person walking through red light and then it inspired me to like, oh, hey, I can automate this. Like, it's really easy to use computer vision to check if the traffic light is green or red, and then check if someone is crossing the road. And I made a lot of projects around like jaywalking. Did you know how to program? Did you know anything about computer vision systems when you had that idea?
Starting point is 00:18:15 Yeah, I was exploring a lot. But I always explored with open source tools. So if I need in a project and face recognition, I don't start writing it from zero. I use something that is out there that I'm able to use. And I combine all those tools that are out there. So most of the time, I don't need to write everything from zero. Do you have ideas first and then you go and find the tools that will help you? or do you learn about a new tool and have an idea?
Starting point is 00:18:51 Which comes first? Yeah, most of the time it's me exploring new technologies. I'm just playing around, even checking out documentation of software, documentation of a new API that is really interesting. Checking out the documentation of JetTPT, the API that sparks a lot of ideas for me. In this case, he taught himself how to use some computer vision algorithms from an open source library called OpenCV, which, by the way, is a dizzyingly huge and powerful set of tools. ChatGPT might get more attention these days, but open source libraries like OpenCV are putting
Starting point is 00:19:36 things like facial recognition into a lot more hands, for better or worse. Anyway, Dries gave himself a crash course in Python and then used OpenCV to, to hack together this funny little machine. I selected an area where the traffic light is, and then it sort of crowns up all the pixels, and it searches for the main color in that area. If that main color is red, or if it's more red than green,
Starting point is 00:20:10 then the software things, it's like, okay, this is a green or red light, and then it changes. checks in a specific zone if someone is crossing over with a person detection. But he still needed something to do with his auto jaywalk detector. He needed the second idea to combine with this one. So he added a few more steps and debuted jaywalking. It's an interactive installation where you can report jaywalkers from all over the world
Starting point is 00:20:42 with the help of open cameras that are pointed to crossroads. Visitors to the installation stand in a dark room in front of a bright screen playing a stream from an unsecured traffic camera. The screen also displays a big graphic showing whether the stoplight in view is red or green. So participants stand and they watch live as unsuspecting people cross the street. But all the while, there's one other thing in front of them, a big round button on a pedestal. The kind of button that looks so satisfying to hit. what happens if it identifies a Jay Walker, what happens next? You get the question, would you like to report the Jay Walker?
Starting point is 00:21:24 And then the visitor of the interactive installation can report the Jay Walker by pressing the emergency button. And then it will send an email to the closest police station with a screenshot of the Jay Walker and that email address only exists for 10 minutes. Gotcha. Okay. The system is automatically detecting Jay Walker's, and you're forcing a decision by the viewer of the installation. Yes.
Starting point is 00:21:54 What they want to do with that. Have you done any machine vision on the installations to know how many people press the button of all the viewers? In the beginning, it was not saving this data. Then later, I mean, like the last couple of years, I saved this data, and it was a lot exhibited in Belgium. the Netherlands. And what I saw that is that more people in the Netherlands presses than in Belgium. AI plus surveillance turned out to be a pretty deep well for Dries. He made an exhibit that tracks celebrities using unsecured camera footage, another that constantly searches webcams for an anonymous man that his sister met once by chance. Both of those are physical installations
Starting point is 00:22:40 that are built to run indefinitely in galleries. They're these little purpose. built boxes of electronics with screens that are forever showing live webcam footage. They're constantly on the lookout for whatever their algorithms have been trained to track. They look harmless and contained on their own until you think about what they're actually doing. My favorite Dries project, though, is the entirely virtual Flemish Scrollers. So the Flemish Scrollers is a project that checks the live stream of my government. They have meetings. live stream this on YouTube.
Starting point is 00:23:18 Anamid software that is constantly checking the live stream to find if a politician is on their phone. If they're for a certain amount of minutes on their phone, it will tweet them and tag them with the help
Starting point is 00:23:33 of face recognition. And the tweets look like, hey, they're distracted. Please stay focused. Then you have like a short video of that person. The idea of using these creepy tools for accountability is just so surprising and hilarious to me. I want this in America. I want Congress fully surveilled by AI while they're debating tech policy. It's just too good.
Starting point is 00:23:58 So that's my personal favorite. But the piece I wanted to talk the most about was the follower, the one that matches social media posts with camera footage. Dries says that one day he and his friends were hanging out on a terrace in a touristy area in Portugal. And they were watching people on the street take selfies. And they thought, well, we know where and when those photos are being taken. Can we go find them on social media? They poked around for a while and came up empty, but it gave Dries an idea. And then actually I did the same, but automated the whole thing.
Starting point is 00:24:34 So I found cameras, again, open cameras where people are taking a lot of photos. and I saved videos for, I think, two or three weeks, something like that. And then at the same time, I saved all the images from that location on Instagram. So all the photos that were tagged with the location around the camera was saved. And then the hardest part, of course, was finding the people in the videos at the right moment. The system did its best to match faces between the camera footage and the Instagram photos. Dries says he went through and weeded out false positives, and then he cut the best examples together into a video, and he posted it online. And what was the response to it?
Starting point is 00:25:24 I mean, a lot of people were checking out today I launched it. People were really surprised. It was a hit, and I get why. It is this one-to punch of a reminder that anonymity is not what you think it is, especially if you're on social media, but increasingly if you're just alive in the world. The whole thing started a conversation that Dries wasn't totally prepared for. There was also like a lot of false information.
Starting point is 00:25:54 Like there was a video saying like, okay, it's an open source tool that works perfectly and you just need to upload an Instagram photo and it will check all the cameras in the world. Yeah. That was really nothing. I mean, that's not the tool I produced. Right. It's only working with like specific cameras.
Starting point is 00:26:19 Although if part of your goal is to make people think about what's possible, the version in their head that's bigger and more powerful is also possible technically. So in some senses, do you feel like you're making people think about the bigger, scarier tool, even if the one that you made is smaller? Yeah, and I think what is also important to remember is that I'm only one person producing this. I have limited resources. My skill set is just a basic one. I mean, like, it's not a team that built. It's just like a bit of playing around, I guess.
Starting point is 00:27:02 I mean, do you want people to think, well, all right, if this was just one person who built this, imagine what a whole team of people can do. Are those questions that you think about? Yeah, I think that was something that I saw a lot in the reaction. Like, okay, it's just only one person. Imagine what a government can do. Okay, wait, well, I have just a really quick thought on this, which is there's this thing that Dries is doing where he's making all this sound really like theoretical
Starting point is 00:27:30 and sort of, I just did a project. What if other people do this project? But like this stuff is happening. This is so like ingrained in the product of all of this stuff. I mean, we spent all this time talking about Clearview AI, which was just a search engine of people's faces. Like that's, that is what he's talking about here. Like it's the same kind of thing and used for, I would say, largely terrifying purposes.
Starting point is 00:27:53 We think about like Nelai on the show always talks all the time about how his favorite use case for AR. is to have it identify people when he's walking past them. So it can be like, oh, who is this person that I met before? Like, that's the same thing, right? It's a less nefarious version of exactly the same thing, just reminding you of who a person is. These are all two sides of the same coin,
Starting point is 00:28:14 but this is the kind of stuff that, like, isn't just happening on Dresa's computer to make us wonder about who we are in the world. This is like, this is the product in so many ways. And he is right that I think. think he's at the, like, edge of it in certain ways, but also is like, dude is just building an app that other people are going to want to use. Is he thinking about the, the, how this all feels to him? Like, he is accidentally becoming, like, a pretty impressive tech developer. Somebody is going to, like, want to download his apps on the app store here at some point. How
Starting point is 00:28:49 does he feel about all that? Yeah. So this is what is so fascinating and kind of frustrating to talk to him He's doing all of this incredibly relevant stuff with a lot of parallels to things that we talk about daily. But when you talk to him, he likes to talk exclusively about how other people respond to this stuff or what other people read into it. And this is where I feel like I completely failed as an interviewer, because after an hour of talking to this guy, I couldn't get him to say why he is so interested in surveillance or what he finds so powerful. scary, interesting about these tools, what he wants to say about AI. That's just not where he's at as an artist. I think it's me exploring. I think the most important thing is I don't want to put like a big message on the projects itself. Like you need to to find I know which kind of questions it raises, but yeah, I don't answer them. Dries is so circumspect about his own
Starting point is 00:29:55 intentions, that he doesn't always seem to know how to handle the response to his work. Take, for example, that project that shows Belgian politicians on their phones. There was a person from France, the person had a company, and that person wanted to buy the software to use on their employees. Oh, my gosh. And I was so surprised about this email, like, I mean, I'm just sure. what is possible, but then there was a long email, I think it was not a joke. At first, I thought, like, this is a joke, but he had, like, a lot of cameras in the offices,
Starting point is 00:30:36 and they like, can I buy your software because I want to use this in my company? That was pretty crazy. Yeah. What did you tell him? I, to be honest, I didn't reply on this email because I didn't know what to react. I have to imagine that. was not the idea that you wanted to give people necessarily, or do you not think in those terms? Well, I think if, I don't, yeah, I don't know. But I think if a person really wanted to do this, then he already done it. But, yeah, it was a crazy male. We got to take another break.
Starting point is 00:31:22 When we come back, Dries takes on the newest front of the first. tiers in AI with the help of a Kylie Jenner voice clone. Support for the show comes from LinkedIn. If you're a small business owner, you know that every hire counts, but time and resources are limited. Finding, connecting with, and screening the right candidates takes up valuable time you could be giving to your customers. That's where LinkedIn Hiring Pro comes in.
Starting point is 00:31:52 It's built to be your hiring partner, helping you find the right candidates faster. That way you can hire with you. confidence without turning it into another full-time job. Hiring Pro streamlines the entire process from drafting your job to shortlisting candidates and conducting AI-powered interviews for initial screenings. Its updated conversational interface lets you describe what you need in plain language. Nearly 60% of hirers find a candidate to interview within a week. With Hiring Pro, you spend less time searching and more time connecting with the right talent. And instead of getting buried in resumes, you get a focus shortlist that actually moves your hiring forward.
Starting point is 00:32:34 Join the 2.7 million small businesses using LinkedIn to hire. Get started by posting your job for free at LinkedIn.com slash track. Terms and conditions apply. Welcome back. As I talked to Dries about his AI projects over the years, it occurred to me that we've been talking primarily about machine vision, which is very powerful and potentially frightening and definitely worth making art about, but it's also not where the AI industry is jangling all of its keys right now. Chat GPT, voice cloning, all the other kinds of generative stuff, that's the dead center of the AI conversation right now. You can't turn around without hearing some
Starting point is 00:33:20 AI voice clone of Taylor Swift or Drake singing songs, or one of those slightly uncanny valley voices from 11 labs, all of this struck me as lots more fodder for someone like Dries. It feels like a good time to be you. It's just in the sense that there are many, many tools being refined all the time, new AI-related tools coming out, people talking about them, people interested in them, people scared of them. What tools are you interested in? what are you playing around with right now?
Starting point is 00:33:58 I'm playing around with voice cloning a lot. I think that's really interesting. For the last couple of months, I'm exploring a lot of open source models that I can run locally. Sometimes they are better than commercial tools. You're way more able to configure them in your style or something.
Starting point is 00:34:22 You have more parameters. that's something I'm exploring. Most of his work with generative AI is still in the tinkering stage, though he posted one very funny demo to his site. I did a project named the selfie coach. I don't want to call it a project. I don't see it as a final project.
Starting point is 00:34:44 It's more like an experiment. And it's a tool that I developed where you can take selfies. but it will give you advice in what to change in the photo. So it takes a photo and then you're smiling, and then you get advice from Kylie Jenner with her voice. All right, babe, let's get another angle. Okay, ready, three, two, one pose.
Starting point is 00:35:13 Dries posted a video of himself testing this out. He poses in front of his webcam, wearing big headphones and looking out of his window. The camera snaps a shot. There's a short pause. And then robot Kylie Jenner does her thing. Okay, love the candid vibe, but let's add some drama. Turn towards the light, lose the headphones, and think mysterious thoughts to spice it up. Because lighting is everything, babe.
Starting point is 00:35:35 It uses chat chit and a voice cloning service. So first, it takes a photo, and then the prompt is you are a selfie coach, and you are also Kylie Jenner. and say what I need to change in the photo in a really funny way. And then I have text and then it sends it to this voice cloning service. I trained it on, I think, half an hour of voice. So you give the system like half an hour of that person talking. and then it's able to produce any sentence in audio with that person's voice. It's quite spectacular.
Starting point is 00:36:29 Add a pop of color by holding some bright fashion accessories. It'll draw more eyes, babe. It's just me exploring a bit how those tools work. And it's quite fun. Also, the intonation is really good. And also, the way she talks, it's in there. For example, she is using a lot dabe. So sometimes chatypT reacts with like dave.
Starting point is 00:36:53 Let's snap another one. You're going to kill it. Next up, Dries says he's working on some kind of generative dating app. Knowing him, Lord only knows what that'll turn into. But beyond that, he's pretty coy. Do you think that the fundamentals here, the voice cloning tools, will lead to some bigger project? I don't have any good ideas at this moment with voice cloning. It's me again exploring a bit and this is something I put online. So you're waiting, you've got lots of bad ideas and you're waiting
Starting point is 00:37:29 to combine them into some good ideas with voice cloning. Yes, exactly. Dries's work is undeniably relevant right now and it's showing. There are lots more AI-themed exhibitions popping up. He's asked to give a lot talks these days. His ideas are just generally around more. And I get it. I watch as each new AI service blows up the internet, and I fret about what it's going to do to my work, my identity. And more than anything, I want someone who's not Sam Altman to tell me what to think about all these hairy questions. I probably shouldn't admit that as a tech reporter, but it's so true. Sadly for me, Dries is emphatically not here to clear anything up. As you do more talks and do more exhibitions,
Starting point is 00:38:21 are lots of people coming to you and saying, what do you think? How should I feel about all this? Yeah, sometimes after a talk, there's a small Q&A, and that's one of the most asked questions. Because after a talk, I leave this open. Here are my projects.
Starting point is 00:38:40 I explain them all. I do live experiments. on stage, I make sure it's like entertaining and fun. But then they're like, hey, the Dries, what's your message? And I'm like, okay, there's really no message at all. I don't have any clue why I'm interested in this. I honestly can't tell if I buy that or not. It's possible that Dries is focused on finding unique raw material like webcam footage
Starting point is 00:39:08 and dreaming up clever ways to look at it. All the inevitable questions around Pryce is focused on. privacy and anonymity, he might have just stumbled into those. But I think there's a clue to be found in who he's choosing to watch. Celebrities, politicians, social media users, the pettiest possible scoff laws. That's just too interesting and provocative a spread of people. At least that's where my brain goes. The AI tools he's playing with, they're powerful but agnostic on their own.
Starting point is 00:39:42 They need a subject or a target. And training them to keep politicians honest versus prosecute J-Walkers versus tail-famous people, each example changes my emotional response to the whole concept of AI, not just the one example of it, which makes the body of his work greater than the sum of its parts. But again, that's just me. You're not going to get anything like that from Dries. I hope he forgives me for the same.
Starting point is 00:40:12 this metaphor, but he's like a crow that leaves a weird shiny trinket at your doorstep. Is it a gift? A challenge? A threat? He just drops these funny and slightly upsetting tech mysteries at our feet. And the only note he ever leaves is, look what you can do. The rest is up to us. All right, that is it for the Vergecast today.
Starting point is 00:40:46 Thanks to Will and Dries for putting this whole story together. and thank you, as always, for listening. There's lots more on all of the AI stuff we've been talking about at theverse.com. Turns out, kind of a newsy week in the AI universe, like seemingly every week. So we'll put some links in the show notes, but as always, go read the website.
Starting point is 00:41:04 We'll have some links to Dries's work, too, if you want to go check it out. As always, if you have thoughts, questions, or feelings, or AI art projects you'd like us to check out or surveillance footage of me in Times Square you'd like me to see. You can always email us, vergecast at theverse.com,
Starting point is 00:41:18 call the hotline 866, Verge11. We love hearing from you. This show is produced by Andrew Marino, Liam James, and Will Poor. And this episode is edited by Zander Adams. We'll be back on Tuesday and Friday with our regularly scheduled programming. Lots of fun stuff coming out this week.
Starting point is 00:41:32 We'll see you then. Rock and roll.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.