Latent Space: The AI Engineer Podcast - Emergency Pod: ChatGPT's App Store Moment (w/ OpenAI's Logan Kilpatrick, LindyAI's Florent Crivello and Nader Dabit)

Episode Date: March 24, 2023

This blogpost has been updated since original release to add more links and references.The ChatGPT Plugins announcement today could be viewed as the launch of ChatGPT’s “App Store”, a moment as significant as when Apple opened its App Store for the iPhone in 2008 or when Facebook let developers loose on its Open Graph in 2010. With a dozen lines of simple JSON and a mostly-english prompt to help ChatGPT understand what the plugin does, developers will be able to add extensions to ChatGPT to get information and trigger actions in the real world. OpenAI itself launched with some killer first party plugins for: * Browsing the web, * writing AND executing Python code (in an effortlessly multimodal way), * retrieving embedded documents from external datastores,* as well as 11 launch partner plugins from Expedia to Milo to Zapier.My recap thread was well received:But the thing that broke my brain was that ChatGPT’s Python Interpreter plugin can run nontrivial code - users can upload video files and ask ChatGPT to edit it, meaning it now has gone beyond mere chat to offer a substantial compute platform with storage, memory and file upload/download. I immediately started my first AI Twitter Space to process this historical moment with Alessio and friends of the pod live. OpenAI’s Logan (see Episode 1 from *last month*…) suggested that you might be able to link ChatGPT up with Zapier triggers to do arbitrary tasks! and then Flo Crivello, who just launched his AI Assistant startup Lindy, joined us to discuss the builder perspective.Tune in on this EMERGENCY EPISODE of Latent Space to hear developers ask and debate all the issues spilling out from the ChatGPT Plugins launch - and let us know in the comments if you want more/have further questions!SPECIAL NOTE: I was caught up in the hype and was far more negative on Replit than I initially intended as I tried to figure out this new ChatGPT programming paradigm. I regret this. Replit is extremely innovative and well positioned to help you develop and host ChatGPT plugins, and of course Amjad is already on top of it:Mea culpa.Timestamps* [00:00:38] First Reactions to ChatGPT Plugins* [00:07:53] Q&A: Keeping up with AI* [00:10:39] Q&A: ChatGPT Intepreter changes Programming* [00:12:27] Q&A: ChatGPT for Education* [00:15:21] Q&A: GPT4 Sketch to Website Demo* [00:16:32] Q&A: AI Competition and Human Jobs* [00:18:44] ChatGPT Plugins as App Store* [00:34:40] Google vs ChatGPT* [00:36:04] Nader Dabit on Selling His GPT App* [00:43:16] Q&A: ChatGPT Waitlist and Voice* [00:45:26] LangChain with Human in the Loop* [00:46:58] Google vs Microsoft vs Apple* [00:51:43] ChatGPT Plugin Ideas* [00:53:49] Not an app store?* [00:55:24] LangChain and the Future of AI* [01:00:48] Q&A: ChatGPT Bots and Cronjobs* [01:04:43] Logan Joins Us!* [01:07:14] Q&A: Plugins Rollout* [01:08:26] Q&A: Plugins Discovery* [01:10:00] Q&A: OpenAI vs BingChat* [01:11:03] Q&A: App Store Monetization* [01:14:45] Q&A: ChatGPT Plugins API* [01:17:17] Q&A: Python Interpreter* [01:19:58] The History of App Stores and Marketplaces* [01:22:40] LindyAI's Flo Crivello Joins Us* [01:29:42] AI Safety* [01:31:07] Multimodal GPT4* [01:32:10] Designing AI-safe APIs* [01:34:39] Flo's Closing CommentsTranscript[00:00:00] Hello and welcome to the Latent Space Emergency episode. This is our first ever where chatty PT just dropped a plugin ecosystem today, or at least they demoed their plugins. It's still on the wait list, but it is the app store moment for ai. And we did an emergency two hour space with Logan from OpenAI and Flo Coveo from Lin AI and a bunch of our friends.[00:00:28] And if you ever wanted to listen to what it's like to hear developers process in real time when a new launch happens, this is it. Enjoy,[00:00:38] First Reactions to ChatGPT Plugins[00:00:38] I assume everyone has read the blog post. For me the, the big s**t was do you see Greg Brockman's tweet about FFMPEG? I did not. I should check it out. It is amazing. Okay, so. So ChatGPT can generate Python code. We knew this, this is not new, and they can now run the code that it generates.[00:00:58] This is not new. I mean this is like, this is good. It's not like surprising. It's, it's fine. It can run FFMPEG code. You can upload a file, ask it to edit the video file, and it can process the video file and then it can give you the link to download the video file. So it's a general purpose compute platform.[00:01:22] Wow. Did they show how to do this? Agents? I just, I just, I just pinned it. I just, it did I, did I turn into this space? I dunno how to use it. Yeah, it's, it's showing up there. Okay. It can run like is. Is, is, is my And by, by the way hi to people. I, I don't know how to run spaces. I, I not something I normally do.[00:01:42] But You wanna say something? Please request. But yeah, reactions have a look at this video because it run, it generates and runs video editing code. You can upload any arbitrary file. It seems to have good enough compute and memory and file storage. This is not chat anymore, man. I don't know what the hell this is.[00:02:01] What, what is this?[00:02:02] Well, progress has been all faster than I expected. . That's all I can, I, I, I don't know how to respond. . Yeah. It's pretty wild. I wonder, I wonder, I'm wondering how, how this will affect, like opening up the app store different from, let's say Apple App Store when it opened up. Because there are a lot of, of big companies just building stuff already and how like a small developer will be able to, to build something that's not already there.[00:02:31] I dunno. It will be interesting. So one thing that's really nice, have you seen the installation process for the plugins? It's right at the bottom of the blog post and you have to play the video to kind of see it, but literally anybody can write your own plugin. It's a small little json file. It's, it's literally like 10 lines of code.[00:02:49] It's 10 nights of, you described what your plugin does in English, you given an open API spec. That's it. That, that's, that's the plugin. It's amazing. You can distribute your plugin. This is, this is, this is easier than extensions manifest v3, which nobody knows how to use. This is English.[00:03:15] You write English . So, so, yeah. I mean I think, I think I think there'll be a lot of people trying to develop for this if they can get access, which you know, everybody's on a wait list. I, I've, I've signed up to 200 wait lists this week. . I wonder if, if it'll be different if you, if you sign up as a, as a developer or as the chat user.[00:03:35] Hopefully it doesn't matter, right? Use different emails and sign up to both. Let's, let's just see, in fact, use t to generate like, plausible sounding reasons for why you want to build whatever. Cause they don.[00:03:47] But yeah, I mean, how do you compete? I, I don't know, man. You know, it, it's really OpenAI is definitely a partnership strategy to do what they do here which means they're essentially picking favorites. So if you're a competitor of Expedia Kayak Open Table Wolf from Zapier, you're a s**t out of luck, kind of, you know?[00:04:06] Cause these are presumptive winners of their spaces. Right. And it'll happen in too many industries, probably. Right. I was thinking about maybe summarization or, or I don't know, YouTube video summarization, but there seems to be some application of that already on the examples that you shared. Yeah, yeah, yeah.[00:04:26] They have shared that, but I think there's always room to improve the experience. It's just, you know It's interesting which platform, like sort of platform strategy, right? Like if you write an OpenAI chat plugin, you instantly gain access to a hundred million users, right? All of them can instantly use your thing.[00:04:47] Whereas if you are a standalone app or company, good luck trying to able to use OpenAI through you. There's just no point. So you much rather just be on OpenAI platform and promote there. The the fortunate thing is they don't have some kind of like popularity ranking yet. Actually, someone should go open, someone should do register, like OpenAI plugins list.com or something where like everyone can like submit their own opening app plugins and like upload them, review them cuz this like, this is not a complete app store without reviews and a rating system and a reputation system and probably monetization opening app probably doesn't care about that.[00:05:26] But I mean, I can go start that right now. F**k. I can go start it right now.[00:05:34] Yeah, it'll, it'll take a while, right? Like this is the, like the basic version of the, of the app evolving. But this is a pretty basic version. Yeah. The basic version can browse the web, it can write, write an execute code. It can retrieve you know, we can retrieve data from documents, right? So all the documents search just died.[00:06:02] There's like five of these in Y Combinator right now. Oh.[00:06:08] Examples. Pretty crazy how, how they use the FFMPEG library or, I dunno if I'm saying that correctly, but right in there. You don't need to, to write code to,[00:06:27] it's crazy. Dunno. Yeah. Any reactions? Please, please, you know, open space. Anyone can request a speaker. Oh, Ash, come on in. Ash. I have to add you a speaker. Yeah, we're, we're just reacting here. I just, I, I needed a place to talk and I'm in Japan and I don't have anyone else to talk to, so I need, I, I I just want to share this moment.[00:06:46] I think it's a special moment in history. This is the biggest new app source since ever. Yeah. Hey, Shawn. I think plugin is already taken. . Oh man. Someone, someone bought it already. Yep. , of course. Right? Of course. , what are your reactions? What how are you feeling? What's what are you seeing out there?[00:07:07] Just crowdsource all the tweeting. Yeah, man, it's, it's been wild. I mean, I get out of there to like five minutes and then anything drops, you know, , I think productivity today will be like zero. If I, if I still, like, I quit my job you know, a few weeks ago but I would not be working today. There, there's no point.[00:07:26] There's nothing else. There's nothing else that's important, like, nothing's going on. Like this is the only story. Yep. . I wonder if you have any, any frameworks or anyone that's listening any frameworks on, on how you're handling all of this new, new stuff. Like every single day if something new comes up and, or you can like get the, the wait list invitations to, to use the new products.[00:07:52] Q&A: Keeping up with AI[00:07:52] Like, for example, today I just got the, the one from GIK cli and I was just playing around with that. And then suddenly I started to see all of the, these Twitter threads with announcements. It's getting crazy just to follow up with, with the stuff. And every day something new comes up and started. I was starting to feel a lot of formal, you know, like, h how do you keep up with all of these?[00:08:12] Or how do you focus? Does anyone have any, any good frameworks for that? Well, feel free to respond. Also, we, we have some more room if anyone wants to share your feelings. This is a, this is a safe space to share your feelings because. We all dunno how to react right now. I don't know. I just, I, I, I have a few notifications on for OpenAI employees and people that I do that I think do good recaps.[00:08:37] So in other words, find the people who are high signal and who do a lot of gathering of other people's stuff for, and then just subscribe to those people and trust that that is 90% of it and forget the 10%[00:08:57] Alright. And Sean probably, I have, I have another question. So I can't really figure out like what's left for us to do, you know, without AI tools. Like what, what is we learn next? You know, there's no learning some coding stuff, because you can only do that. You know, we can't do arts, we can't do poetry.[00:09:17] Farming[00:09:17] bakery, probably making things with your hands. Enjoying the sun.[00:09:23] Do you guys think this should be regulated? Like you don't go more than like the speed is going? I don't know. I dunno. There's, there's no point. Like if, like, if you regulate OpenAI, then someone else will come along. The secret is out now that you can't do this, and at most you'll slow things down by 10 years.[00:09:44] You called the secret. This is the end. . Yeah. Yeah. I, I don't know. Secret is out. China's trying to do it right, so I don't know if people have seen, but like China was, was fairly strict on crypto, which is probably good for them. And now they're, they're also trying to clamp down on AI stuff, which is funny because oa like they're, you know, the m i t of of China Ihu, I was actually doing like producing like really good bilingual models.[00:10:10] But yeah, they, they seem to be locking this down, so we'll see. We'll see. Right? Like you know, in, in, in sort of the, the free world there, there's open innovation that may be unsafe. OpenAI, try to be safe. You know, there, there's a big part of the blog post that was talk, talking about red team meeting and all that.[00:10:24] I'm sure every one of us skipped it. I skipped it. And then and then we just care about capabilities and now that, you know, every time people have their minds opened, like, I did not know Ron. EG in chat.[00:10:38] Q&A: ChatGPT Intepreter changes Programming[00:10:38] Now that I know my conception of what a REPL is, or literate programming or what a notebook is, is completely blown outta the water, right?[00:10:44] Like there's no like this, this is a new form factor for me. So not now that I know that I won't be innovating on that or trying to, to shape this into something that I can use because I want to use this, and this is, this is clearly better. Does, does this ha have to do with, with the, like AI as backend?[00:11:00] Yeah. Ideas that have been, yeah. You know, GP as backend. So, so apparently I had a few friends reach out to those guys and they're not doing that because it's not mature enough. Like it works for a simple demo. So, so for, for those who don't know ScaleAI did a hackathon I think two months ago just before I did mine.[00:11:18] And the winner on the hackathon was, was something called GPT is all you need for backend. And they actually what in register? DBC is backend.com. But as far as I can tell, they're not gonna start a company based on that because if you even push a little bit, it falls apart, right? So GPT3 wasn't good enough for that.[00:11:36] Maybe GPT4 is maybe GPT5, but then it'll still be super slow and super expensive. Like you don't want to run, you know, a large language model on every API request. So I don't know. I think it'll be good for scaffolding. I think it'll be good for re type use cases. Like, Hey, I need to edit this video on an ad hoc basis.[00:11:53] I don't, I don't want to learn FFMPEG. I don't need to now, because I can just talk to ChatGPT. That makes sense. But if you want a reliable, scalable backend you probably don't want to use it on a large language model, but that's okay because language model can probably help you write it rather than run it.[00:12:13] Hey, Lessio. Hey guys. Oh yeah. Hey guys. What's up? Hey, yeah, we're, we're just, there's no structure. Just drop your reactions. Let's go. Awesome. Awesome, awesome guys.[00:12:26] Q&A: ChatGPT for Education[00:12:26] What do you think what if Shawn, what do you think if you could use you know AI and the education field, like, you know, like personal attribution system for students?[00:12:35] What's the thought automation education or attribution edu edu education. Yeah. That is the holy grail. This is called the Blooms two Sigma problem. Like the, the, the, one of the big issues of education is we have to teach to the slowest person in the class. And, and, you know, I'm a beneficiary of, of a gifted education system where they take out you know, nominally high IQ people and put them in a separate class.[00:12:56] And, and yeah, we did, we did do better. What if we can personalize every student's experience there's, there's some educational theory. This is called Bloom's two Sigma problem. Where the results will be better. I think that we are closer, but like, I still hope that we're pretty far , which sounds like a negative, like why do I want to deny education to students?[00:13:18] Because if we are there, then we will have achieved theory of mind for ai. The AI has a very good model, is able to develop a representation of who you are, is able to develop theories that the test who you are in, in a short amount of time. And I, it's a very dangerous path to, to go down. So I want, I want us to go slowly rather than fast on, on the education front.[00:13:41] Does that make sense? Yeah, definitely. It makes a lot sense and yeah, definitely. I think personally the education for each student and making it turn the best way would be great. And what do you think how about like, first of all, I'm, I'm having very curious, curious question, you know, like we are having, this week was full of launches, so how you guys are keeping up with if we're not, this is, I created the space though cuz I cannot handle it.[00:14:05] Today, today was my breaking point. I was like I don't know what's happening anymore. Yeah, like every single day I'm just in constant anxiety that like everything I assumed about the world is gonna be thrown up. Like I don't know how to handle it. This is a therapy session, so feel free to express.[00:14:21] Definitely. It's, it's been a very overwhelming feeling for everyone of us like that. I think, you know, like past two weeks and like the industry was definitely a lot, lot of ones we are definitely open for, you know, to discuss more about it. Thanks a lot for this space. Sean. Yeah. Appreciate. Yeah. Va one more thing.[00:14:39] So I think that the most constrained version of education use cases is language teaching. So there are a few language teachers out there speak I think is one of them that is an OpenAI partner. And they're also part of the chat GPT plugin release. , but there are also other language tutor platforms.[00:14:57] You can certainly have your news. There was one that was released maybe like four or five months ago that you can try to see what the experience is like. And you can, you can tell when the teacher has no idea who you are and it breaks the illusion that you're speaking to another human. So I, I just, you can experience that today and, and decipher yourself if we're ready for that.[00:15:14] I hope that we're not ready and it seems like we're not ready. Yeah, definitely, definitely. Thanks a lot for sharing. And guys, what do you think?[00:15:19] Q&A: GPT4 Sketch to Website Demo[00:15:19] Like I, in the launch of four we have show that we could, you know, generate apps and web apps just from you know, like a single simple sketch, you know different tent.[00:15:30] Just start from sketch. So what do you think like how, how it would be impacting the industry? It's all because it's not just like that, that sketch was very, was a very shitty sketch. Right. It was just like drawn on a piece of paper. But if you combine that with the multimodal, like it was that they had another part of that demo where they had a screenshot of the discord the opening eye discord and you're mm-hmm.[00:15:57] and they put it in and it, it like read the entire screen to you and if you can read the entire screen, you can code the entire . Screen. So it's over like[00:16:12] It's definitely, I think interaction, interaction designers, you know, like people who like, think design function still have some time. Yeah. I, I just, I just, I just tried the same thing, you know on bar today and it was like much more better than GPT3 so definitely it's you know, things are really changing.[00:16:30] Q&A: AI Competition and Human Jobs[00:16:30] Great forward. I'm, I'm really worried what we wanna do, you know? Do you think the competition will like stable everything? Like what competition? Anthropic. Well, like Google, Google won't race, I don't think. Google Race, like Google the fight. The one that, the one that launched the W links list of blog posts.[00:16:50] That, that Google.[00:16:55] Well, no, not, not the list. Not the list. Competitions will come. . I have a question. I mean I mean my fear is many of the jobs that are going away, whether it is developer and designers, because I mean, I think GPT four is very capable. So how to deal with it. I mean, it's going to replace, I mean, many of the jobs, that's for sure.[00:17:16] Yeah. It's okay. We'll find new jobs or we'll, we'll not need jobs anymore. We should, we should also, Start universal basic income. That's, that, that is something I, I do believe, yeah, I think the, the main change is going from the web of like, syntax to like the web of Symantec. So if your job is valuable because, you know, a unique syntax or like, you know, how to transform things from like words to syntax, I think that will be a lot less useful going forward.[00:17:45] But the Symantec piece is still important. So a lot of product work, it's not just writing CSS and HTML and like the backend for it. It's a lot more than that. So I just thinking about how do you change your skills to do that. But yeah, even the sketch, you know, you gotta like, you gotta draw the sketch and to draw the sketch, you gotta know where the button should go.[00:18:06] You know, you have, you know, incorrect with it. Yeah. I'm just processing this as I, I just read the whole thing as well. And Yeah, I mean, it's been a wild wild couple of weeks and it's gotten me thinking that maybe all our role was over the past couple years was we were just middlemen to talk to computers, right?[00:18:27] So we're sitting in between, it's over man PMs or business folks or whoever wanna build a product. And then as a software developer, you're just a middle manish talking to the machine and it seems like. N LP is the way forward and, oh, yeah. Yeah. It's, it's been it's been, it's been a while.[00:18:42] ChatGPT Plugins as App Store[00:18:42] Couple of weeks. It's, I feel like we all just have to move either move upstream or, or find other jobs. You just gotta move upstream, either toward product directly. Cuz right now the plugin is yeah, is, is just you know, it's still a very sanitized UI that is controlled by OpenAI. But imagine them opening up the ui portion as well.[00:19:03] So you no longer need to have a siloed product that needs to integrate. ChatGPT instead you can bring your product directly into into ChatGPT, I don't think exactly. I think that would be probably the next next logical move after this, and I'm sure they're already thinking about that.[00:19:22] So that's a great, I don't know if this is, it's wild. What are you guys think? Yeah. Yeah. Like, so before you came up, right, I was, I was talking about this like ChatGPT has at least a hundred million users. Why would you bring people to your platform rather than write a plugin for ChatGPT and use their platform?[00:19:39] It's an open question now. Zapier just launched their integration. OpenAI and OpenAI just launched their integration of Zapier. Which one is gonna be more interesting? Probably OpenAI.[00:19:50] Totally a hundred percent . this is the app store of wow, our century of our decade. Like, I don't know, maybe century. I, I think the thing with ster though, if you think about it, like how many native apps do you download every week, every month versus like how many web things you use. So I think it's all about whether or not long-term opening eyes incentivize to keep broadening the things you can do within the plugin space.[00:20:17] And I think the lab, you know, as this technology gets more widespread, they're gonna have a lot more pressure from regulators, safety, blah, blah, blah. So I'm really curious to see you know, all, all the, all the government stuff that they'll, they'll have a congressional on this in six months and by then it will be completely irrelevant.[00:20:34] It's like that beside that time, they, they, they called it the GameStop guy after he made like 20 million on GameStop. And he just, you know, he was like, yeah, you know, followed the rules, made a bunch of money for those who don't know, unless you're our co-host. On the, we were supposed to drop an episode today, which I was supposed to work on, and then Chatty Phi dropped this thing, and now I, I can't think about anything else.[00:20:59] So this, this is my excuse for not, for for not working on the podcast today. . I know it's funny, we have like three, four recorded ones and spend last week, like GP four came out and we're like, okay, everybody's talking about this is irrelevant. What else? Anything else? Like, but I'm really excited about the, I, I feel like the first, the first use case for this, and I think he tweeted it about it too, is like, before if you had to do like data reformatting and stuff like that, it was really hard to do programmatically.[00:21:32] You know, like you didn't have an natural language interface and now you have it. And before if you had to integrate things together, like you could explain it very easily, but you couldn't like, put the APIs together and now they kind of remove all that part. So I'm excited to see what this looks like.[00:21:48] For commercial use cases, you know, you could see like, is there gonna be like a collaborative ChatGPT where like you're gonna have two, three people in the same conversation working on things. I think there's a lot of ui things that will improve. And so as we have lining from OpenAI for a second, almost pulled them up, but I'm sure you cannot talk about it[00:22:07] But yeah, it'll be interesting to see. Yes, sir. We're extremely excited. Extremely excited. I, I don't, if you, I don't know what else I'm, I'm like, so as far as I can tell there's the, there's hacker and Twitter. I haven't looked at Reddit yet, but I'm sure there's a bunch of reactions on Reddit.[00:22:23] I'm sure there's the OpenAI discord that we can also check out. I got locked out of the discord at some point, but yeah, anyone, anyone else like see news, demos, tweets the whole point of this is that it's live, so please feel free to share on comments or anything like that. But yeah. Yeah, the, the craziest thing I saw was the Mitchell from Hash.[00:22:44] We tweeted about Yes. How the integrations actually work and you just write a open APIs back and then just use natural language to describe what it's supposed to do. And then their model does everything. I wonder if they're using the off-the-shelf model or they have like a fine tune model to actually run integrations.[00:23:02] I wonder, I don't think they'll ever say it. Knowing them, probably they would just use the base one cuz they want, like, I think opening eyes kind of wants a God model, right? There's no point. It's not intellectually interesting to do small models, but like, like it's trivial. Yeah. Yeah. It's, this is a minor optimization problem as far as the, the long arc of history and the, the point is to build a gi safe agi and I, I do think this is kind of safe, right?[00:23:33] Like, . One of the criticisms that people were saying on hacks was that this is very closed. Like it's, it is an app store. At any point opening, I can randomly decide to close this like they did for Codex, and then they change their minds. Whereas if you use something like Alan Chain, it is more open and something that at the same time, like clearly this is a better integration path than long-chain.[00:23:56] Like, I much rather write this kind of plugin than a long-chain plugin. So they, they've managed to, I mean, they know how to ship man, like they're an AI research lab, but they also know how to ship product. Mm-hmm. . Yeah. I, I'm curious to see what the pricing models gonna look like. Also, I mean, if I'm writing the plugin, this is great because I don't even have to take care of the compute, you know, like, I just plug it in, then they actually run everything for me.[00:24:26] Yeah, but how, how it'll be monetized. I mean if the is giving their plugin know Expedia, I mean, people will not go to their website. Yeah. I don't, I mean, yeah. I have no idea that they, I don't think they said also don't super care . Yeah. It's because in the, in the app store, it's transaction driven.[00:24:46] But on Channel G, you're just paying a flat fee every month. So like, you can't really do revenue share on a flat fee. And I don't think that we use like, the Spotify model, but it's like a why not the amount of times? No, wait, wait, wait, wait, wait. Why not , you have Spotify. I just, Spotify model works. Cause swyx has power, right?[00:25:05] Opening has power. Same thing. They have all the audience. Yeah. But every, every every song is like the same value. Like if you listen to song actor to song y. , like, you're gonna make the same money. Like if I'm calling the API to, for like the meme generator or if I'm calling the API for the, you know, business summary thing, they're probably gonna cost the firm things, you know, so it's kind of hard to model up for OpenAI to say, Hey, okay, we're charging, we're going from 20 to 35 bucks a month.[00:25:36] But then like, how do you actually do royalties on a per model basis? Like how do people decide what royalties to negotiate? This probably needs to be a flat fee, but I dunno. Or put your credit card it OpenAI and then every time you wanna use a plugin, you pay for it separately. Uvp, usage based pricing all the way, and then you just get at the end of every month.[00:25:58] Exactly the, the only question mark is like, how much does OpenAI value the training they on and like how much they wanna subsidize the usage. Canada they have, they have promised to not use any of our usage data for training. So, oh, but the, I think like the plugins, it's a, it's a different thing.[00:26:16] It's like, like how you could, you could easily see how are like requests usually structure for like these things, you know, like, are people searching? So how are people searching for flights and stuff like that. I don't know. I haven't read the terms for like the actual plugin, you know, so. Well if anyone has please come up to speak cuz we're all processing this live.[00:26:37] This is the therapy session. Yeah, go ahead. One thing I see is basically you have to change the plugin I mean, to ask anything or even if you did browsing, right? I mean I see. I mean, they are becoming directly competitor to Microsoft also, I think, because now a user can actually just see, I mean, instead of being chat or Google, I mean they, they just.[00:27:04] Basically select the browsing plugin and basically get all the updated data. And other thing I see is basically you have to change the plugins. Like if you want to use the Expedia data, I don't know how it'll fit with the browsing plugin or you can select multiple plugins. But yeah, it is interesting.[00:27:23] I mean, if we get access, yeah, there is no actual browsing plugin. The browsing is a new model. So just like you can select GT three, GT 3 45, GT four, there's a new model now that says browsing alpha. So you, you can use CHATT in browsing mode and then you can use it in plugins mode, which which is a different model again.[00:27:45] So the, the plug browsing don't cross over.[00:27:51] Oh, that's interesting. And how do you see, I mean, in this whole descending, they are becoming competitive to Microsoft or how they're playing it out. I mean, Bing is just by the way, like, yeah, this, this killed the bing wait list. Cuz you don't need to wait for Bing. You can just use the browser mode open of Chatt.[00:28:11] How does it compete? It competes for sure. I don't think Microsoft cares. I don't think OpenAI cares. This is one of those things where like, you know, they are the two, two friends, you know, and they're clearly winning, so who cares? I don't like, I don't imagine it takes any of their mental bandwidth at all.[00:28:29] Yeah. The main thing is Google is Yeah, the main, like how is Google competing? Well let's see. Right. Bard is out there. I haven't got us yet, but could be interesting. Again, like it doesn't seem like they have the shipping capacity or velocity of Open I Microsoft and. That is probably going to bite them eventually because there's already been a big brain drain.[00:28:53] Something like four researchers, four, the top Google Brain researchers left Google Brain for OpenAI in January. And you know, those are the ones that I know about. And I, I imagine there's, there's quite a bit of brain, brain drain and firing going on at Google, so who knows.[00:29:08] All right, well, any other topics, concerns? Hyperventilation, if you just wanna scream I can turn down the volume and you can just, ah, for like five minutes. , that was literally, I was like, I, I need to like scream and just, ah, because what is going on?[00:29:29] I said that I'm filling out the form right now for the Oh, yeah. Okay. So wait list. So use use chat t to fill out that form. Right. And then, and then use a fake, use a different email and fill out the form a different way. This maximizes . I'm going to ask GT for what plugin do I want to build or, right, right.[00:29:51] Exactly. Yeah. Yeah. I, we can brainstorm. My plugins can live. Yeah. I think that will be a fun exercise. Like the, the main thing that breaks my brain is just this, this whole ability to run code, right? Like this is a new notebook, a new ripple. Mm-hmm. It, it looks like it has storage and it has memory.[00:30:08] Probably it has GPUs. That, I mean, can we run Lama inside GP?[00:30:19] I don't know if that's a, a model within a model. I think for me, most of the things come to like, you know, if I have my own personal assistant, what I want the assistant to do. I think like travel is like the first thing that comes to mind. Like, if I could use pt Yeah. Expedia, plug in with my calendar.[00:30:39] Yeah, yeah, yeah, yeah. But it needs to like know where I, where I'm supposed to be going to, you know, like if I just add a calendar that's like I'm going to, you know, room this week. Yeah. And then like can automatically both send my calendar and say, okay, these are like, or like the times that you like to travel, I know that you don't like ops and yada yada, yada.[00:31:00] That's one thing that I've always, we had this thesis at my peers firm about personalized consumer. There's so many website like, . I go to a lot of basketball games and every time I open Ticketmaster or whatever, it always shows me that she's a seat. And like, I'm not gonna see, that's not what I, that's not the tickets I wanna buy, you know?[00:31:18] But doesn't matter how many tickets I buy, never remembers that. So I think a way to say, to see, take all the information in and suggest, Hey, I saw that there's actually a price drop for the specific seats that you want, not for like any seats. You know, I think that would be a, a very good use case. So I've been a personal entertainment assistant for like, travel like going to shows, going to games.[00:31:41] That would be cool. That's what I'll submit on the wait list. Then we'll see if anybody cares. Right. Did you see get Lindy? Yeah. Yeah. At the, maybe you wanna recap, get Lindy for people. I'm gonna pin it up on the. . Yeah. So basically and this is like the kind of like a assistant lend the ai, right?[00:32:03] Yeah. Lend the ai it's on the board right now. Yeah. For those who can see it through the space. Yeah. Yeah. Actually at the AI Thinkers meet up the, the other day, you can basically like create all kind of like personal workflows and you, it kind of looks like integrations like zier, but it's actually just natural language.[00:32:24] So you can pop this thing up on your desktop and say, trying to hire 10 software engineers. So go on LinkedIn and plan 10 software engineers. The next step, draft a, an email that says, I'm the CEO of this company and I'm trying to hire for my team. If you wanna talk. Then the next step is like, send emails to all these people and it's gonna use people data labs or something else that they use on the backend to get the emails.[00:32:50] Then it actually sends the emails and. This is just gonna run in the background as if it was like you actually doing it. It's pretty neat that you don't have to write the actual integrations. Like it just uses natural language so you're not bound by what they build. Like theoretically anything you wanna integrate with, you can just explain to it how it works and it's gonna figure out how to do it.[00:33:12] So there's a wait list now. Flow didn't give us any papers just because we were at the meetup, so I'm also waiting to get access to it, but it looks really, really good. Yeah, so generative AI's top use case is generating wait lists, right? Like we we're, we are, so we have never had such an easy way to generate a lot of wait lists.[00:33:30] A lot of signup for witness. Oh my God. So much interest. So much product market fit. But also you know, one thing that you, you raising this point? I think, I think, I think by the way, I also pin this up. Mindy can support complex roles like no meetings on Fridays, all one-on-ones on Monday. , I like my meetings back to back within five minutes.[00:33:47] Five minutes in between. So it's just arbitrary rules that you could not program in a normal assistant type environment without a large language model. Which is kind of exactly what you want when you're booking your travel, right? Like, hey, I only like aisle seats unless it's it's a flight that is less than one hour that I don't care, right?[00:34:02] Mm-hmm. . So stuff like that I think is, is super interesting. And but also like not a common use case. Like how many times do you travel a year? Like, you know, five, right? Like more than that, but yes, I think for, yeah, a lot of times it's not a, it's not like a super widespread thing, especially if you don't do it or work.[00:34:21] If it's infrequent, you want high value and then if it's, if it's frequents, you can do low value, right? Like that, that's the sort of binary tradeoff, like the Uber is sort of frequent and low value. Airbnb is high value in frequent there's something of that nature. . So like, you want, you want sort of inspections of that sort.[00:34:37] Google vs ChatGPT[00:34:37] But the other thing that you brought to my attention was, and, and has room for Google to do something is do you notice that OpenAI plugins, none of them are Google because they're not friends. So Open BT will probably never have first party access to Google Calendar, probably never your Gmail and probably whatever, you know, Google copies, OpenAI again.[00:35:04] They will do, Hey, we have all your docs.[00:35:10] Yeah, I, I, I'm interested in that because I don't know if you remember, but like in the first iPhone, like YouTube came, like pre-installed on the homepage and then I forgot when, but one of the early ioss, they removed it. So now obviously Google's not a friend. Who's gonna be a friend in the future, who's not gonna be like, do we all have to hail our AI overlords?[00:35:33] Yeah. To get access to the, the only plugin system. Yeah. The only winners are brown CEOs. Think you're fine. Alright. But yeah, yeah. I just invited nada. C my old boss. Hi. You can't lurk. I, I want, I want to hear from you. And but, but also, you know, yeah, I, I think the Google point is actually novel.[00:35:50] I'll probably write something about that. Yeah. I mean, I'll have to write something about this today. So please feed me things to write.[00:36:01] Nader Dabit on Selling His GPT App[00:36:01] Oh, there we go. Hey, what's up man? What are you think. I know it's like, not entirely your space, but like you're, you're all about the future, right? I mean I did build and sell an AI company about a month ago, . I did the wait, what travel app was built on GP T three Tweeted about You sold it? Yeah.[00:36:21] It was getting like a hundred thousand visitors a day, like 60 to 80,000 unique a day. And then I, whoa. Yeah, I sold it like within about 24 hours. I tweeted out that it was for sale. I had like 30 or 40 people in my inbox. Whoa, whoa, whoa, whoa. Okay. I need, so like, but you're right. This isn't my, my man like domain of expertise.[00:36:41] It's fine. You make, you may just a thousand dollars on the side. It's, it's cool. Wait, wait. So I saw you tweet your original thing, which was, Hey you know, GP three can plan your travel. I don't know what happened since then. Can you, can you fill the rest of. Yeah. Yeah. So I mean I was basically, you know, I travel a lot for work.[00:36:55] I, I do travel like once a month and, you know, but I'm also very resource constrained on my time. So I usually like to spend like one day sightseeing. So what I typically do is I go a trip advisor and then I kind of like, you know, Google around and like look at all these things and it usually takes me about an hour to figure out like what I wanna do on my day or two off to go, like sighting.[00:37:14] And then I realized GPT3, you know, you can just literally ask and, and say, okay, within X number of. Like, I'm gonna be in this city, I want to have an iter itinerary. You know, you can give all these different parameters and it gives back a really good response. This was before GPT, even three and a half or four was out.[00:37:30] So I just built like a nice UI on top. Then, like I mapped over the results and, and was linking to, you know, the the Google searches for these different items and, and kind of made it into a nice user interface and, you know, just built it out and tweeted it out. And it, it just got a lot of traction and attention.[00:37:48] Like I said, I had around a hundred thousand visitors a day, like right off the bat, 60,000 uniques like per day. So it was getting a shitload of of traction and. I don't have a lot of free time to kind of like, maintain or build something like that out. So it was costing me money, but I wasn't monetizing it.[00:38:06] So the way that I was thinking to monetize it would be to use affiliate links and stuff like that. So I could either, you know, spend time figuring out a way to monetize it or just try to make, flip it and just make some money. So I decided to sell it and that was kind of it. I just sent a tweet out and kind of said, this is for sale, who wants it?[00:38:25] And I had I had so much inbound from that that I had to delete the tweet within about two hours cuz I was just unable to keep up with all the people that were coming in. And I filled it out a couple of offers and I, I found the person with the most money that could close within the shortest amount of time and just took it.[00:38:44] Well done. Well done. Nice. Awesome. I need a, I need a, I need an applause button right here. . Okay. So with that context your thoughts on today, what you seeing? There's Expedia there, but. Comment on travel or not travel, whatever you want. . Yeah, I'm still reading up on the, the chat plugins actually.[00:39:01] And I was hoping to kind of chime into this to learn a little more about how they work. I'm here on the the page. I've had API access from fairly early on. I signed up and I've been you using it a lot. I'm trying to find some different ways to integrate AI and machine learning into the blockchain space.[00:39:20] There's a lot of stuff around civil resistance that I think are gonna be, you know, pretty interesting use cases for us. It's obviously not like a, a a type of use case that is gonna be useful to, to the general public maybe, but yeah, I'm still, actually still trying to understand how these plugins work.[00:39:35] So what have you seen the developer documentation, which developer documentation at the bottom? Yes. That's where I'm, I'm check, I'm reading through as of now, I see the examples, which are pretty cool. Yeah. Yeah. So my, my quote the, the quote I put on Hacker News was, this is OpenAI leveraging chat, GPT to write OpenAI op open API to extend OpenAI chat.[00:39:58] GPT. I'm confused, but it sounds sick, but yeah, I mean, so open api, you know, not to be confused is OpenAI is randomly the perfect spec for OpenAI to navigate because it, you know, is somewhat plain English. And then you just supply a description for model. You described a off method. So they actually provided a link to a repo where you can see some examples.[00:40:20] The examples are not very, not very flesh out. But you can do, like, bear off, I assume you can do whatever, whatever kind of off you like then you just provide like logo url, legal info url. It's not, it's not, it's not that much. This is 10 times better than Chrome manifest.[00:40:37] Like manifest v3. Yeah, I mean, I'm reading through some of these examples and a lot of them are in Python. I wish they would've more JavaScript stuff, but I would say 10 times would be kind of an understatement if I'm understanding how some of this stuff is gonna work. English is all you need, man.[00:40:53] English is all you need.[00:40:57] Well, so, so, and then I think in buried in the video is sort of the Ethan experience, right? Which is where you specify. So if you're, if you're first party congrats, you know, you're, you're inside of the the chatt ui, but if you're third party, you can just host your Js o file anywhere. It's literally a JSON file on an API spec, right?[00:41:15] You hosted Jason file anywhere. And then you just like plug it into their their, their text field here and then they, they validate a little bit and it's installed. So there is a third party app store on day one. Yeah, that open table plugin example is pretty sick. Yeah. So like yeah, I I What would you want as a developer that's missing?[00:41:41] I think that we're like in the golden age of of being a developer and I don't know if it's gonna go downhill quickly or if it's gonna go like, get better quickly or this is like the, the end of all of it. like, is OpenAI just gonna be where like we do everything like nothing else is like gonna exist.[00:42:00] I think that Okay. You know what I, I know that's not the answer for sure. I'm just kind of joking, but I think it will, this is obviously shut down a lot of companies. This is the app store moment, right? For like, just like, I mean, you and I remember the iPhone app store moment. Some people dropped everything to write apps and they made it big and some, a lot of people did not.[00:42:20] But the people who were earlier rather than later probably benefited from understanding the platform. Like imagine, imagine you, like, you know, you, you are a big React native person for a long while. Like imagine if you had the chance to drop everything and be one of the first developers on a new app store.[00:42:35] Like that's pretty huge. Yeah, a hundred percent. But I'm wondering like the, the type of mode that you'll be able to build with some of this stuff, because it seems like that OpenAI AI will just continue adding more and more features directly into the platform. But I think like for very like, Proprietary type of stuff.[00:42:54] It might make more sense, but like if you, if you want to build like an app for the general public it just seems like they'll end up integrating something like directly within their platform for a lot of different ideas like, such as this travel app that I sold. I have a feeling like they'll have a way better version of that built directly into their platform sometime soon.[00:43:13] Q&A: ChatGPT Waitlist and Voice[00:43:13] Hey, hey guys. Can I ask just to get a quick update does anyone here have access to it yet? Like is it, is it open? Cause I signed up for the wait list, but I haven't seen anything yet. Yeah, no, it's just, it's just wait list where just like 90% of the stuff that people launch, you know, she has a few, she has a few videos and demos, but yeah, it's just a wait list.[00:43:31] Who knows? I mean, thanks. Opening OpenAI Pretty has been pretty good about getting people off wait list, right? Like a lot of people got off the GT four API wait list, like the day after they launched. Mm-hmm. . This one, I feel like they're quite fully baked, like it's. I wouldn't be surprised if they started dropping tomorrow.[00:43:50] So we'll see. But like you can start developing your, your third party plugins today, because there's examples. The docs are like two paragraphs, but that's all I need really . So, so I've been, I've been working and, and I've been following a lot of projects where people are, the one thing I don't see with ChatGPT is like, why are they have, we have Whisper, we have the APIs for ChatGPT.[00:44:13] It's like, why are we not at the point where we're talking to this thing and it's talking back to us? Like, I don't know how we haven't, nobody's wrapped their head around that yet, but it's like, it seems to me like, don't you wanna be like, Hey computer build me an app that does X and it says okay and builds it for you and talks back to you.[00:44:29] Like, I just, it's like, I don't know. That'll be the first probably plugin that I try to work on, but it's just driving me a little nuts. That's all interesting. I like the voice interfaces because sometimes it gets really long, like some of the prompts get really long. They're like, I don't wanna talk that long.[00:44:46] Yeah, yeah. Yeah. I was so, so I was doing, I was messing with the system prompt, basically get it to be like, Hey look, I'm gonna be talking to you. So keep it condensed. I think like the ideal interface would be like, for like, talking to, it would be like putting that at like the system level, but also, you know, being able to type as well as speak to it is just something that I'm, I'm trying to work on.[00:45:08] And I think with Plug, you know, if we could do that with plugins, I'd be huge. Cuz I know there's already a, like a Chrome extension that allows you to talk to it. Or, or I guess you could do it natively as well, but, you know, native stuff on like iPhone and Android is not too good.[00:45:24] LangChain with Human in the Loop[00:45:24] Hey, you, you mentioned that. Hi, by the way. You mentioned the hey way of, of talking to or having way the AI talking to you as a user. So just today there was a new release to of LangChain. I know it's kind of, not really the plugin, but this is the closest thing probably. And they edit a Ask Human tool.[00:45:46] So now the model can ask you a question if it's not sure. About something[00:45:55] to share. Share what? Go ahead. So, so the ask you if it's during its chain of thought, when it's not sure. To an example. Right, right. Oh, I would love that. Yeah. Probably not gonna do that. It's too confident. Yeah, I, I've seen a little bit about. LangChain, but I haven't used it yet. Has anyone here it?[00:46:15] Oh, it's all about it.[00:46:19] I did, I did. I built the LangChain on UI too. It's pretty nice. I mean, especially when it first came out, the, the trolling, it was like so rudimentary. But it's nice to be able to change things together. I think the agent part is pretty interesting. I haven't used it myself because I didn't need it.[00:46:34] But yeah, there's a, a very big community. See, see, light chain was very smart, right? Like they picked out the open source angle first, and then the others like dust or did the closed source angle. Now they have indirect competition with ChatGPT, but Langchain still has that. It's open source, extensible, like you own your agent.[00:46:55] Google vs Microsoft vs Apple[00:46:55] Them doing business deals with OpenAI in, in closed doors, right? Like, so pretty smart, like strategic position. All things considered.[00:47:05] It's a little, isn't it? It's like a little funny to me. That, you know, it's like goo because Google just came out with Bard, right. And I don't know if you guys have messed with Bard at all, but it's at least to me another wait list. Oh, okay. Yeah. I mean, to me it was a little underwhelming. I mean, I'm, I don't know if you've seen like the same, yeah, if you've seen like the screenshots going around, like it seems like, you know, someone tweeted it was like in, in guys in a boardroom or whoever's in a boardroom just being like, s**t.[00:47:30] Like, we need to you know, we lost our first mover advantage here. But it's just kind of funny to me that like, I guess now Microsoft's gonna have like an app store, right? Like just after everything, you know, Microsoft dominated in the nineties and stuff, and then it was Apple, apple, apple. But it's just kind of funny to me that it's gonna be, I guess Microsoft now, right?[00:47:49] Bard feels like Bing does to Google. Totally. Yeah. A hundred percent. I agree with you a hundred percent. All the turntables, right?[00:47:57] Yeah. So for, for those of you who might have missed the earlier discussion the one thing that OpenAI or Microsoft will not do is integrate with your Google calendar. So, the one saving grace that Google probably has it, it probably owns your workspace, right? Like most of us have Google accounts, Gmail accounts.[00:48:14] When we work, we log into Gmail and Google, again, use Google Docs spreadsheets. So if Bard is smart, they will take advantage of that. And then slowly watch as everyone moves to Microsoft Office.[00:48:31] I think Apple should do a partnership with the OpenAI and basically Microsoft. Cause Google has huge advantage of Android. So basically having OpenAI on the, I, I mean, it would I mean having the partnership with OpenAI would make, I mean, very useful on I devices if they, I mean, Siri is really bad and if they integrate with I, I mean they've win the world I think.[00:49:00] So it would be huge, beneficial to Apple and basically the Microsoft also if they integrate together because Microsoft doesn't have any of the devices and most people, I, most ordinary people use the devices iPhone or phone and . So it would be huge advantage. And for the 10, basically Apple I, I'm very curious to see what Apple ships next.[00:49:24] You know, everyone's shipping AI stuff and then Apple was like, Hey, look at our AR glasses. . Yeah, but I mean, ar ar with, with the, with the 3D models that are, that are coming out cuz isn't it mid journeys working on like a three, like their lab, I know is, is building a 3d generative model. And I think that sort of stuff with, with AR is very, oh, is that, is that public?[00:49:45] How did, how did you know that? I don't know if it's public. I, I saw a tweet about it I don't know, like a week ago. It is a semi, semi open secret in San Francisco, but I, I don't know if it's public. Yeah, I think I, I saw them, it was some context of they were talking about text to video and they were like, well we're, we're doing our like 3D modeling first.[00:50:02] So, I mean, my assumption is, and I, I don't work in the space yet, unless anyone's hiring please, I'm looking for work. But it seems to me like Apple. Seems to have their head on straight and like it might be that if they're gonna release these ar like mixed reality ar vr glasses, like, you know, the mo the thing that makes the most sense to me is like getting with generative AI graffiti modeling.[00:50:24] It's like, you know, it would be cool to go to like a coffee house or a bar. And then, you know, when you see like the graffiti in the bathroom when people write sometimes funny stuff, sometimes, like the worst stuff you've ever read in your life and you're like, what is going on when this person's going to the bathroom where they have this much hate?[00:50:38] But it's like, it would be cool to have a component of that, you know, like in the metaverse, so to speak, right? Like, so you put on your AR glasses and it's like, oh cool, I can see like a bulletin board here that exists in the fizzled. But it's also in the, you know, it's like augmented, right? That's just, to me it seems to be like the logical next step.[00:50:57] Interesting. Well, we'll, we'll see that when that happens. I recently got a Quest Pro quest to my, and yeah, my parents love it. And any tech, any type that my parents like, I think has a real crossover appeal. You know, the thing that you, your conversation had gimme an idea for winners of every app store in the early days, like Facebook has an app store, apple had an app store, you know, the winners of an app, store games like what we need Yep.[00:51:24] Is a multi-player. Like everyone logging into chat, BT and then playing a multiplayer game line. Mpc. MPCs are gonna text you on your. , that would be kind of cool.[00:51:40] ChatGPT Plugin Ideas[00:51:40] Actually. I was thinking, I don't, I don't know if it's gonna be game games at first though. Like, it seems like games always push the envelope with tech.[00:51:47] Well, it's like pornography and games, right? But like, I don't know, I was talking to like, you, you mentioned your parents and like you know, I was talking to my mom about this stuff and I was like, you know, I'm seeing stuff that are just demos of just like, Hey, take a picture of your fridge and it'll tell you like, here's what you can make.[00:52:01] Or you know, even like talking to it and just being like, Hey, here's what I ate today. You know, what's my, how many calories I ate today? Or, you know, what's my diet plan? Just things like that. And that's why I brought up the talking to it just with na using natural language and then having it, being able to talk back to you.[00:52:17] I'm surpri I'm like really surprised that they haven't implemented that yet. Cuz it seems to me like that's a use case that a lot of people would use it for, you know? Or if you could just like, you know, call it on a phone if you built like a Twilio back in, into it or something. Like I just don't, it, it boggles my mind why they haven't.[00:52:35] Put that feature in yet? . Yeah. Yeah. I really don't think it's gonna be too long before you're, you're sitting there at work and you get a text or call on your phone from an nbc, Hey, our village is burning down. You need to come over here and help . Do, do you guys think there's gonna be different silos?[00:52:55] Like you know, with Bard coming out and you know, people implementing GP T three and four now, I guess, into all their apps, but do you think they'll be like, chat GP p chat, GP, PT will have their store and then Google will have their store? Do you think it'll be like, there's gonna be a clear Victor here and then, you know, it'll be like, okay, Google's apps or, you know, Google Docs or whatever is like part of chat GP t's plugins, right.[00:53:20] Yeah, it is gonna be like crypto. Everybody's just gonna be fighting for the top. You're gonna have the couple of dominant people, but then you're gonna have all the, the small guys who go up and down and Yeah, I I, I feel like it's gonna be pretty similar to, to how crypto was. So we're gonna have some slur juices is what you're telling me.[00:53:41] Yeah, boy. Nice, nice. I dig it.[00:53:46] Not an app store?[00:53:46] So may maybe we aren't, tell me what you guys think about this, cuz maybe we aren't thinking about this right? Because maybe this is not an app store. Cuz typically in an app store you'll go ahead and choose which plugins you want installed, like on a phone or whatever have you.[00:54:02] But the path forward seems like all the plugins are like omnipresent. I, I don't know why Google isn't shitting their, shitting their pants right now. Cuz basically you check like openly I could just force all. The big companies to write plugins and then just be a single search box for everything. So imagine if you wanna like fly somewhere or you wanna book a hotel you, we have the Expedia and booking.com.[00:54:29] Both of those plugins summoned up and it shows you both the results. And then you can click through on whichever ones you want. And then, yeah, you charge 'em based on click throughs. Like I, I think like we're, maybe we're just getting tripped over by the fact that you have to choose a plugin right now and only interact with that single plugin.[00:54:49] But I think I think the smart move forward would probably be just to have all of them omnipresent and then have this like n l p higher layer up there to summon the right plugin when need be. What, what do you guys think about that? Yeah, so, so that's like the LangChain thing. That's what I haven't used LangChain yet, but it sounds like that's, from what I was reading with LangChain, it sounds like that's kind of is how I thought that worked.[00:55:12] But I don't know, can someone here like enlighten me? I, I don't know if it, how, how LangChain works.[00:55:21] LangChain and the Future of AI[00:55:21] Yeah. I don't know how LangChain works either, but I think it's gonna be a two-way street. Everybody's gonna be making plug-ins with chat GP p t and everybody's gonna be making chat GP plug-ins for other services as well. I think there's gonna be a whole bunch of people about to make a bunch of Jira plugins and stuff like that, so I think it's kind of gonna be a, a two-way street.[00:55:45] I dunno, is anyone else, like, this is super exciting to me. I haven't been this excited about like, the internet since like, probably like the, like the web 1.0 days. Like I, I, I hate, I'm so . Yeah. Like, I hate web two. Like, this is cool. I'm glad that like spaces exist, but I hate Web 2.0, like Web 3.0. I'm about, and like, I, I consider this part of Web 3.0.[00:56:04] But it's exciting, right? Like, this is cool. Like I, I'm really, you know, I'm stoked about, about the progress that's being, like, the joke is like, you know, every day in, in AI is like, it's like way longer, right? It's like we're telescoping very quickly. Yeah, I mean, one of the things, telescope and updating.[00:56:23] Yeah. You know, I, I would say I noticed towards, maybe like three years ago when I was working at aws, it just seemed like for, for about five or or so years, everything was very stagnant and there just wasn't a lot of exciting things that were happening. Everyone was like, if you remember, all the Devrel advocates were like all creating like tutorials around creating your own CMS and your blog, and you saw like that exact same tutorial given by like hundreds of people over the course of a few years because there just wasn't any cool s**t that was happening.[00:56:52] And then I think when crypto and, and blockchain stuff like that kind of caught my attention. Caught my attention, and I'm still excited by that, that stuff. And then this seems to be just almost like when, if you were like around when the iPhone was coming out and actually realized how important it was, I think everyone now is, is seeing this and they're all like realizing how important it is.[00:57:13] And it's cool to be like part of this moment as a software engineer. Yeah, I'm, yeah, go ahead. Oh, sorry. I was gonna say, like, I'm, I'm excited for you, I'm sure you guys saw the alpaca stuff, right? And I know that they're doing D D M C A stuff, but essentially someone's gonna train one of these models and it's gonna, you know, you're gonna be able to run this stuff offline.[00:57:35] And just like the way to, if, if you have access to like I forget which one of the EAC accelerate people was talking about it, but it was like wharf in the flask. It's like you've gotten the machine offline. So if you don't need internet access to access, like, the entirety of human knowledge, whatever's in the data set up until 2021 or whatever, and you don't need internet access, like that's gonna revolutionize everything.[00:57:57] Like, that's insane to think about[00:57:59] Yeah. Oh, well we won't speculating You can run in Inside Chat runs Python. Oh, really? Is that, is that happening? I mean, it has a file system and it has file storage and CPU at memory. Yeah.[00:58:20] is turtles all the way down. Turtles all the way down, man.[00:58:23] The, I, I think the plugin system, if people can get to run their own models like the LAMA ones and the same structure for plugins, you can see like going back to the Metaverse thing like a and snow crash where people built their own like demons. You know, it's like I got the demonn that like kicks people out of the club, the, the black sun.[00:58:43] But you can see in real life it's like I have a bunch of plugins that only I have, you know, and I use them to make myself more productive, use them to make myself, you know, look like I'm working when I'm not working and I'm like responding to my emails and stuff like that. But I think like, The OpenAI releasing this today makes it so much easier to start it because you don't have to worry about any of the infrastructure.[00:59:07] You just build the plugin and then they run everything and you get the best model possible. But I think none line, you know, I would love to walk around with my own, you know, raspberry pie or whatever of my wrist, kind of like I'm fall out and say, Hey, I wanna do this, I wanna do that. I don't know, I don't think we're that far away, so I'm excited to, to keep building.[00:59:28] Shoot, the, the technology exists where you could make that now, but it'd be a little awkward to have a raspberry pie on your wrist at the moment. . Well, well, well, that's kind of what I'm saying with the, with the al alpaca thing, right? It's like if you don't need internet access to, to use the model, I mean, we're, we're still pretty far off floor.[00:59:48] I don't know if Moore's Law even applies anymore. You know, we're not that far off from being able to run this stuff on, you know, consumer hardware that's cheap and that's gonna be huge for, for, you know, the majority of the world, right? Like, that's gonna be very big. Like e e even bigger than this. Like, it's great that we can do it with the internet, but as soon as we don't need the internet to access it, like it's, it's over, but we're back.[01:00:12] Whatever, whichever one you believe. It's just, this is crazy to think about that. Yeah, you could, you could if that happens, you can go and hook it up to a coding compiler and have it sped out human readable errors, but at that point it's probably just gonna be brighten on the cup for us anyways.[01:00:30] So we have a Hey guys. Hey. Hey, Alex. Go ahead. I, one more question, but yeah. Oh, go ahead. No, no, no. I have a right in question from someone who's trying to join but was unable to Stefani. , who I met, by the way, at the LangChain Hackathon, LangChain meetup in San Francisco. She has a lot of cool insights.[01:00:45] Q&A: ChatGPT Bots and Cronjobs[01:00:45] Follow it. Yeah, go ahead, Alex. I'll, I'll cue the question up. Oh yeah, for sure. Uh, One thing that really got my mind out this stuff and, you know, high vision mode is the fact that you can kind of externalize memories now. So the main use case I was thinking about is you could basically set up crime jobs, for lack of a better word.[01:01:04] So suppose you're, I don't know, building a trading bot, right? And you can say, Hey, Chad, GPT, look at the price of wheat every day at midnight. And you can just cue that up in the background and then have that send the response back to back to the LLM at a certain time. , and, you know, that's just like one use case.[01:01:21] But here comes like the play where like there's time sensitive things that break the one by one synchronous nature of ChatGPT and adds a little more, you can say from one level more humanness to it rather than like direct response and reply with latency. So there's that level, but also you can like schedule tasks and I think that's gonna be the killer plugin, whoever creates like the, the cal.com or the you know, theron integrations for just like, Hey, look at this point in time, and they give me the response.[01:01:48] I don't know if anybody's been thinking about that. Yeah, I, I was thinking about that a lot. Like how you said the expand, it's like an expandable, it's like a portable brain. Like, it's like, Hey, here's my secondary brain and it does, it's like my secretary, or it's like my assistant, right? Like somebody had a prompt where it was, you know, you're a form of, you know, one person's wisdom, one person's, you know, thinking about.[01:02:11] things x X way. Someone's thinking about it y way and like being able to have that just on demand with the like expandable component where you're able to basically Yeah. Delegate tasks to it and be like, Hey, you know keep what's, what's like the way to think about it? Like, not like a crime job, well, sort of like Aron job, but like like, you know, like news alerts, like Google news alerts, like things like that.[01:02:33] Just being able to be like, Hey, like keep, keep an eye on this thread for me while I do other things. And then if something comes up, you know, whether, you know, you just do some NLP or whatever, search for keywords you know, alert me or do whatever. And being able to do that without having to go through, you know, setting a reminder or doing all that painful, like, pain in the ass calendar stuff.[01:02:52] Cuz I think there's so many, there's so much software for that because people just hate doing it so much. Like, that's gonna be so big. Yeah, no, I was thinking that's probably a better way to put it, right? Like asynchronous alerts or I guess you could do timed alerts also. Because the one thing I was thinking about is the Instacart api, which is what they're demoing.[01:03:10] I don't know if anybody uses Instacart, but it's pretty slow on the lookups. So that's like, you know, that's a blocking process in the current integration of chat GPT. But if they could figure out a way to make it like asynchronous and then actually interact when it's done getting the, the fetch, and then you can do stuff in between that, that's gonna really change the interface.[01:03:27] And that's like, that's really the step closer to having like a real personal assistant in your pocket, man being able to just give chat d p t all of your Ps that you cook that week, and then just have it, order all the stuff from Instacart, from you. I can't wait for that man. Oh my God, that's great.[01:03:49] Oh, okay. Okay. You know, you can ship a boat Logan, like a cook, a cookbook with like actual recipe, but yeah. Yeah. Let's introduce Logan. So does this, like physical companies that integrate with software are gonna be coming like more of a moat as opposed to just software specific companies? Every software is a software company.[01:04:10] I know[01:04:13] Yeah. But if you're just a software company, OpenAI or, or, or some, one of these companies can just build that feature in now a lot easier than they could maybe in the past. Yes. For instance, you know I don't know, like we were talking about travel and, and stuff like that. But, but let's say you have a physical, you know, product that that, that maybe you can just separate yourself from other products by building, you know a better quality user experience.[01:04:40] Logan Joins Us![01:04:40] And so we got Logan here was our first podcast guest and the first Devrel person at OpenAI actually. . So Logan, welcome. Obviously, a lot of people here are excited to talk about this. One thing I noticed from the plugins is that a lot of them are more mundane things. You know, you got travel, you got grocery.[01:04:58] Can you tell us a bit more about how you picked those and like maybe give us a sneak peek of other use cases that you all are excited about? Yeah, I, I think first of all, I think going back to the conversation about the ability to like queue up tasks for you in the background, I'm, my understanding is that Zapier actually already does this by default.[01:05:20] And I'll, I'll go play around with it after this and see, but my, I, I think Zapier has the ability to schedule things and I think this is the part. Yeah, people are sleeping on this the most is that basically Zapier is already connected.[01:05:36] Zapier's already connected to 5,000 different plugins, and now you can just integrate directly with all of those through Zapier, which is incredible. So you don't even need to wait for like the plugin or whatever to come. Zapier will already do that for you. Which is, which is super cool. And it already has the ability, I'm 90% sure to like schedule certain actions to happen which is awesome.[01:05:57] So I, I think going back to the point of like how these folks were, were specifically chosen, I think the reality was when it was initially scoped out for doing this work, there was just, we needed people who were willing to sort of deal with the idea of of sort of, we were still building this entire platform and infrastructure from the ground up.[01:06:15] And I think those. Those folks who were featured today during the blog post, did a lot of work of iterating on these things with us as we figured out a lot of the challenges. So huge shout out to all those, the engineering teams of those companies for, for working with us so closely to make it happen.[01:06:32] I just gotta say too shameless, shameless plug here. It's my birthday today and this is a super cool birthday gift. So thanks for, for doing this and the blog post. It's really awesome. happy birthday. Yeah. Thank you. Thank you. I think we all just got a, a huge gift like look like. Yeah, Logan, you don't have to speak on opening as we have here.[01:06:50] Like, we're all just like, you know, large model and Enjoyers here. I think. And this is a, this is a app store moment for like all of us. Like it's, I I'm just processing this and, and just trying to. Do therapy in public[01:07:06] There's a lot of wait list fo here, so we're all excited. Oh, yes.[01:07:11] Q&A: Plugins Rollout[01:07:11] What do we have to do to get the wait list? Yes, . I, I think the reality is yeah, it, it's, they're rolling people out really slowly and I think the intent is part of this is to understand, and I think it was one of the big highlights of the blog post about what are the new sort of accesses for, for harm here.[01:07:30] And I think we know some of those things, but there's a lot of known unknowns, so it'll be intentionally small for the time being. But hopefully we'll, we'll expand that access in.[01:07:44] bottom line, get on, get on the wait list and, and keep your, keep your fingers crossed. Come up, like come up with a cool use case. I think there's something, there's part of the wait list is like submitting what you would be interested in working on and actually in, they actually will, we will actually read that to make sure that, you know, we're bringing people in who are gonna build cool things, not stuff that's uninteresting or potentially harmful.[01:08:06] Okay. Are you using Tri GB two to analyze the wait list? ? Yeah, that was my question. It'll probably be humans to analyze the wait list would be my guess, but maybe, maybe not. I'm not sure. Very old. What's the difference? Old, like, yeah, yeah, we have a question from write in who couldn't join for technical issues.[01:08:23] Q&A: Plugins Discovery[01:08:23] Stefania, who is a researcher at Microsoft right now. and her question is about search. How what is the future of search for plugins? How do we discover new plug-ins? Do we need a schema for plug-ins with complex queries or, or complex behaviors? And does it limit the context window as well?[01:08:41] Like, do we install like a hundred different plug-ins and like, does that, does that hurt help? I don't know. . Yeah, it does. So there's a limited, and I, it's all in the developer documentation right now if you wanna read through it. But there's a bunch of limits on like your open API spec and the descriptions you use.[01:08:58] But we actually take all that information. We take a sample request, we take a sample response, we take the description of it, and it's actually all inside of the, the context window to begin with. So it is limited right now. And I think that's where some of those larger models like GPT four with 32 K contacts in the future, when that's the available will be super helpful and you'll be able to bring a lot of plug-ins in.[01:09:20] But at the current moment, the more plug-ins you add, the less, the less context to you you actually have in the conversation. Yeah, yeah, that makes sense. Makes sense. I mean with like 50 pages worth of context, that that's a lot. And you know, I was very impressed at the latency as well that that at least the demo was able to pull off, which is awesome.[01:09:39] Yeah. Any, any other like, reactions, thoughts, questions to plugin? I have a couple new people joining. Hey ar Yeah, I had a couple of them. If I can chime in. First of all, just blown away. I mean, it's a fairly interesting approach to deal with, like live data with this data that you guys train on. Couple of quick questions for you.[01:09:57] Q&A: OpenAI vs BingChat[01:09:57] How do you see this? Maybe it's too early to ask, but how do you see this starting out to something like a Bing Chat? The, the reason why I ask this is, I mean currently Bing is more of the UI that you're dealing with and chat GP t's being launched on the side. But do you see it more being like a platform or do you see it more consumer facing?[01:10:20] I mean, I dunno if this question was to me or not. Yeah, you don't, you don't have to answer that. You know, obviously Logan cannot comment on Microsoft.[01:10:31] I do think though, that the, the interesting differentiator is that the, the work, and I think this was in their public blog post, is that a lot of the stuff that Bing is doing is optimized for search specifically. So it's, it's just a fundamentally different experience. I still think that like if you're, if you want like that search first experience, I think something like B makes a ton of sense.[01:10:54] Yeah, it's just, it, it feels like a different experience to me, so, thanks.[01:11:00] Q&A: App Store Monetization[01:11:00] So I think it's been mentioned a few times that this is like the new app store or ai. What, I guess I'd, I'd like to hear thoughts of other people as well, but like, what's the, so the app store is monetized, right? So that's a big incentive for people to put their apps on there.[01:11:14] So how does in, in this case, you put a manifest and it hits, hits the API for your app maybe. So what side of the monetization strategy here? I mean, this is not a question for OpenAI, it's just like a general sort of direction for things. Yeah. I don't know if they care. , this is like trivial to OpenAIr.[01:11:34] Yeah, we were talking, you're paying for the api, right? So you're you mean like on top of, of paying for API access, like you're using your credentials, you supply your credentials when you, when you sign up to plug in. Right. So I guess you do building off platform.[01:11:50] Yeah, I guess so. So not from an OpenAI point of view. So Open of course, makes money on wins anyway. What I mean is like for an app developer to go on there. So I guess you have an app outside of OpenAIr, which is useful. And this is kind of distribution for your app. Is that, is that kind of the, the sale for the app?[01:12:07] I mean, we're three hours into it, so it's hard to say , definitely. But I think that's, I'm just waiting for someone to write a mega threat on how to make money with the app store here. Seven ways. I'm sure. I'm sure there's gonna be people on YouTube making videos with themselves streaming, and that's how they all saying, I just figure figured how, how to make millions.[01:12:27] But yeah, one model we were talking about was maybe you can do kind like Spotify or like a, you have Achen GD subscription and then people each plug in gets royalty. Or a lot of things. So like Instacart, like the Chan GD thing is more like a UI alternative rather than like an app itself.[01:12:46] So it makes a lot of sense. Do I have things like that? But yeah, it would be. . Yeah, I guess what I mean I think Dylan or somebody else said earlier that this might not be the, the app store might be like something different. I think App Store is like the closest we, we have to think about. Like that's the closest analogy, but it might be just something completely new.[01:13:06] And that's very interesting. I think that's that's a pretty, pretty exciting place to be. Well, well, I don't know how much overlap with like the web three stuff, but it seems to me, I know there's like a couple projects out there that are, I think there's one called Bit Tenser, where it's like people are you know, basically selling their you know, their, their GPU usage, right?[01:13:24] Like, you know, there's tons of gamers out there that just have, their cards are just sitting idly by, and I don't know, it seems to me like a monetization model for OpenAIr might be to, you know, they own the model, right? So it's like, I don't know if they can like, lease out the model if you could like write a smart contract that like, uses their model somehow, or, I dunno, maybe plugins could be like written into a smart contract where it's like if you, if you're using this plugin, like, I don't know how that would work specifically, but thinking ahead, like, I don't know, do you think it's gonna just be centralized this, this whole time or like, surely there's gonna be a way for this to, to spread.[01:13:58] And you know, obviously like there's a. What's the, what's the word? It's, it's kind of like you're trying to hold all this water back with like this one stone, and it's like eventually it's gonna break. So like, there's gonna be some decentralization in this at some point. So I don't know if that makes sense.[01:14:12] I'm just trying to think about like, how, how there's a monetization you know, pathway for, for this. For, for the, for these plugins.[01:14:24] Yeah. We're not gonna get the answer today.[01:14:34] Let's, it's Farmville. We're gonna, we're Farmville on ChatGPT. Let's do it. Yeah.[01:14:42] Q&A: ChatGPT Plugins API[01:14:42] . Yeah. I was interested in like if there's already an API for this or if there's like an planned, so like when chat was just a weapon interface and then we got the API later, or is this like a web only?[01:15:02] There is a API available today, but you have to have access to actually create plugins. So you won't have the interface to install a plugin or do anything like that. You can basically build all the stuff on the backend right now if you want to, and then when you get access you'll be able to actually install the plugin through the ChatGPT UI test it out and all that stuff.[01:15:23] But as of the present moment, no one beyond a very small group of people are able to actually install those developer unverified plugins. Yeah, I was I don't know if if that's what you meant, but I was thinking about like, do we have a programmatic way of calling the ChatGPT API with these plug-ins enabled and get like adjacent response back opposed to like using the weapon interface with the plug-ins enabled?[01:15:47] Yeah, so that, that doesn't exist yet today either. I think it's, it's unclear when and if that will come, but it's definitely something that folks are, are thinking about. I think there's just a little bit more a bunch more security and other challenges like that when you give the plugin access through the api, but it's, it's definitely something the team has talked and thought about internally.[01:16:09] Alright. Thanks for your insight, Leo, follow up question. Did, did you have a specific use case in mind for that that specific need that that can help to motivate things sometimes? No, not right now. It's just a general question exploring. Yeah. Well, okay. You know, you can sort of hack it together with the stuff that Diane Gross was doing in the early days of chat.[01:16:27] Bt. But then also, like, I, I feel like we could make like a mock validator for plugins such that we are ready to go when it's live. I don't think it'll be too hard. Yeah. Any clones, 20 clones out there for like chat ui, so you can sort to kind of hack it in. Maybe it's like not, not the highest fidelity, but the, the schema is out there, so there's nothing really stopping us apart from, you know, waking up tomorrow and, and seeing that Chad opening, I have done it already.[01:16:54] So , I, I think the only, the only, you could definitely do some of that today. I think some part of the challenge will be that it's a different model that's powering some of these things, which isn't available. Yeah. Yeah. I think that would be, but I still think even with probably base Sahara and just injecting some of this in there you could probably get most of the way there.[01:17:14] Q&A: Python Interpreter[01:17:14] Yeah. By the way, that, that was a misconception that I had to correct a bit early on in the space before you came on. You dropped three models today. Like there was a browsing model and then there's a separate plugins model. And the plugins model doesn't talk to the browsing model. And then there's a, you know, there's.[01:17:28] Python running, which is still going my mind by the way. . Yeah. The Python running also goes back to the piece around, if you wanna basically have things like set things up to dispatch, you can essentially have it write the code and just like plug into any third party library and like set up crime jobs and all that stuff for you.[01:17:47] So going back to sort of having chat b t do your bidding, you could, you could do all that with the code interpreter, which is super cool. And I think Greg tweeted like 20 minutes ago or an hour ago, something like that. An example of it, yes. Like doing video compression and like editing and stuff like that, which was super cool.[01:18:05] That that is the one. Like are we gonna have that or is that Greg's special box? Like No, I think that he's just running straight up interpreter is my understanding. I don't think there's anything special going on there because like that is insane, that like you have storage, you have compute you are a compute platform now.[01:18:22] Like CHATT is not a chat app. It's crazy. Like this is what made me start this space because I was like, wait, like this is not chat. This is a new thing. I don't know what this is. So yeah, I have to drop, but this was, this was awesome. Thanks for hosting this, and thanks for, thanks for having me on again.[01:18:41] Appreciate you. Happy birthday, Dylan. Hopefully this was a, a worthwhile present. , it was great. Thanks for coming on. Yeah, yeah, yeah, yeah. All right. Bye, Logan. Okay. A couple more questions. If anyone has them. These things tend to drag on a little bit, so I always like to end on a well-defined note. Anyone else have reactions, questions, see anything out there that might be interesting?[01:19:01] I did see you know, the, the, the chat partners are starting to tweet out some stuff, so Ane Patel tweeted up about the Milo plugin that they developed with OpenAI, so we can see a little bit of that. Oh, particularly, I haven't particularly like dived in. . But yeah, you know, I, I'm collecting all, all sorts of information and, and reactions.[01:19:18] I'm gonna write out something today because I think this is one of the biggest days again, in tech since, I dunno, Tuesday since last week.[01:19:30] it's hard, but I mean, does anyone agree that things were like, really boring for a while? And this is like the first exciting thing that I've seen. The, the reacts people are still talking about use effects. Like, f**k that. Like ? Yes, exactly. Like we were stuck and reacting like CMS land for like 10 years, just.[01:19:52] Thank God. Thank God. Hey Peter. Hey. Thanks for having me on.[01:19:55] The History of App Stores and Marketplaces[01:19:55] I just wanted to say something real quick to the person that was asking earlier about monetization models and, and plug-ins and touch and I just, I thought one, one thing that occurred listening was that you know, a lot of these, I've done a lot of these plug-in marketplaces over my career and I think there's obviously an opportunity to like, offer different levels of validation and sort of test compatibility kit pass.[01:20:16] And you know, there's also an ongoing component of it cuz there's, you know, potentially data streaming through and, you know, You know, concerns around, you know, the quality of that data does it, you know, circumvent or inter interfere with OpenAI safety systems. So, you know, one obvious way that they could, you know, potentially monetize, you know, any marketplace really, you know, app store, whatever, JetBrains, you know intelligent idea marketplace, right?[01:20:38] Is to have that concept of different levels of validation and, and compliance, you know, to a certain specification. And, you know, you get a little logo or something like that and, you know, so anyway, just a quick thought as I was listening. Fascinating. And thanks for having me on. Hey Peter, since I want you, you to, since you had felt like you have a bunch of experience could you list like the, the, the marketplaces that you've been a part of?[01:20:59] And like, maybe like one thing they did well, one thing they recorded. Sure. I, I'd love to get a top down view. Sure. Yeah. I, I, I don't know that I've seen all of them, but I mean, you know, obviously I'm an iPhone and Android user, so I've, I've seen the marketplace like the rest of us. But JetBrains marketplace I think was particularly good.[01:21:13] Postman has a really good API marketplace rapid. I didn't know that. Rapid ap. Yeah. You know, I think, I think a lot of platform companies have gotten the message and, and they think about marketplaces, obviously the, the hyperscalers, right? You know, you've got the, you know, the, the cloud marketplaces from Amazon.[01:21:28] From Amazon and Google and, and Azure and such. But you know, it's some of the, sometimes it's these smaller ones that are also surprisingly good, like the intelligent idea, you know you know, you go to their website and it's like, you can buy an ad banner if you're in marketing, but, you know. Yeah. Anyway, so this concept of like validated plugins, right?[01:21:44] Especi. when there's this aspect of the data that's flowing through them I think presents an interesting opportunity not only for, for developers to, to make non-st plugins, pardon my frank for you know, for for OpenAI to, to, you know, say, Hey, we looked at this and not just with chat, GPT, no offense[01:22:01] you know, we, we we're giving it a th seal of approval. Right. You know, and that'll, that'll carry weight and carry meeting and people will pay for that is my guess. Yeah. Yeah, yeah. Yeah. Awesome. Well, if I think there's an appetite for like, understanding how to do well in the marketplace right now, if you write a post about that, I think you'll be very well received.[01:22:18] Sweet. Cool. I'll try to find you on Twitter. I, I just kind of dropped in. This was sort of an instinct and then I saw like, NARS here and all these other people here, so it was just kinda like, wow, this is awesome. I know, I know, I know, I know. Well, we're all just like reacting and we need a, we need a space to, to yell because this was huge.[01:22:34] So thanks Peter. No problem. And yeah, let's, let's connect offline.[01:22:37] LindyAI's Flo Crivello Joins Us[01:22:37] Flow is here. I'm trying to invite you, Flo. Because we were talking about Lindy earlier. We're talking about what this, what judge plugins means for Lindy. I don't think it'll, it will, I, I think actually like it will help highlight the differences.[01:22:49] But Oh, you're speaker. Okay. Congrats on your launch, by the way. Very, very, very well done. Thanks. Yeah. One hell of a day. . Hi everyone. Hell of a day. Did you know this was coming by the way? We didn't know it was coming today, but yes, we knew, we knew about this and we knew it would come in the, in the viewing of future.[01:23:05] Yeah. So I'll, I'll intro, I'll reintroduce cuz like the space is like, like four x since the time I talked about. But, you know, AI, virtual assistant is able to arbitrarily respond emails and step meetings and use natural language to do all of that. I think the, the user interface also was very, very well.[01:23:22] Which you know, I, I can't, I can't imagine how long you took to, to do that, but like that is the polish that you need for personal use stuff, right? Like it, this is the, this is the table six. Thank you. I'll, I'll pass your compliments to the designers who hate me now,[01:23:38] it did take a long time to reach this point. I mean, my take is that I think like the button is being passed from the folks like the, the, the, the lab coat researchers working on the models, they're passing the button over to like the, the product teams, basically. And I think we're gonna see a new wave of aed, not just about, Hey, we have a model that is X billion parameters, but we're gonna see a new wave of startups that own a business of building great products around these models.[01:24:07] And with a very simple interface, which is well, sorry, sorry. Yeah. Well, I'll tell you about plugins, but you're talking about over the foundation model APIs. . That's, that's correct. Yeah. Yeah. So I mean, are, are you worried about competition from like, you know, chatt, like, let's, let's talk, let's talk this out, right?[01:24:22] Like what do you see sort of the products gaps that, that PTs have versus whistle? Yeah. My understanding is that chat PT is really like chatt plugin by understanding, so up on the announcement, it's like, it's really more of like a developer product. So OpenAI is remaining true to the DNA of like, you know, we're building models and we're building stuff for, for developers to build product on.[01:24:42] So the impact on companies like Lin is that it's lowering the barrier to entry, which I think you're not targeting developers. Yeah, well, it's not just, it's like, it's become easier to buildy, like a whole lot of stuff that we've built, like over AI just released for free and we're like, well, f**k, like, I guess we build that.[01:25:01] So it's, it's lowering the barrier to entry, but you know, you, you're still left with your expertise. . Yeah, that's true. That's true. Yeah. And also also commenting before you came on that open, I probably will never have Google Calendar on their list of preferred, you know, plugins. They'll never have Gmail on.[01:25:20] And, and your, your integration is already super tight like this, this plugs in exactly to where, what people use today instead of having difficulty Microsoft and Google. Yeah. I wouldn't say never. I think the, but certainly their incentives are not secure aligned. And so I think there is going to be merit in being Switzerland here.[01:25:37] Right? It's like, look, our incentives are aligned with you as the user. Like we're not embed with, with Microsoft or Google or whatever. We're not protecting an existing ecosystem. We're just like, send AI assistant and we are gonna play as well as we can with all of your product. Yeah. Yeah. Does anyone have like I'll open up, you know, obviously we have the founder of Lindy here.[01:25:55] Like, does anyone have questions about Lindy? Did you see the launch? Did you have a follow up? Like this is a very nice place to. Ask it. Unless you wanna , you wanna start? I just wanna get, I'm gonna pay you just wanna get access. yesterday. It would be cool for you to maybe talk a little about how the integrations work.[01:26:16] And I know you're using natural language for it. I think like when tools like it, they think, oh, is my tool gonna be supportive? So yeah, maybe you wanna talk about it. Yeah, definitely. So the, and so I actually tweeted about that separately. Like, the way we build integration is we literally just give the documentation of the API to Lindy and then she out how to use the APIs on her own.[01:26:36] And so it's trivial for us to build a new integration. Like it actually takes 15 minutes to build a new integration. And so the answer to will my product, like, will my thing be supported will be yes. Like in 15 minutes. Like, it'll be like, Hey, you asked us do something. And literally it's like, we couldn't do it yesterday and today we can.[01:26:52] And it's gonna be as simple as that. So, yeah. . Yeah. I, I think to me the most interesting thing is that a lot of companies, I mean, even if you think about Airbyte and Fivetran, like when it comes to connectors, there was like the whole closed source versus open source. Like the open source usually at an advantage because the community can help you build more connectors.[01:27:12] But now using natural language, like the barrier is so much lower and just, it's just super exciting to, to, to use everything right away instead of waiting like four months because I'm the only person using that one tool. So excited to, to . Yeah, 100%. Well, even considering a world in which the user creates their own integration by themselves in like 10 minutes, it's like, hey, like give us, really the only thing we need is like, we need a, a documentation and then we need like an API token.[01:27:39] Like that's the only part that right now requires like an engineer's involvement. But you know, perhaps some power users would be fine generating some developer API token and building their own integration in like 10 minutes. I mean, I, the, the sort of app store model between Google and, and Apple and it's like the bar for quality that they held, you know what I mean?[01:27:57] That, that, I don't know. It's, it's, I don't know. It makes me think of that whole race again and it's like, do you lower the bar for quality and, and go the Android route or do you keep the qual, do you keep the bar high? And especially if, if there's, you know, issues with circumventing or interfering with safety systems and, and data quality and you know, things that are inappropriate, like, I dunno, I wonder, it makes me think, well the thing is that there is a ceiling to quality here when it comes to this integration.[01:28:23] Like, how good can you make a Gmail integration? There's like, there's like 20 endpoint or something, and then the question is like, can you call this endpoint and can you support their parameters? And it's not even the user who would actually like write the endpoint and the parameters. They would literally just like point us to the right API documentation.[01:28:39] Good point. . Yeah, I do think it's a little scary when I give my, you know, if I give like my, my Gmail integration and then you have Brad access, like actually just open source, the GBD four, like email drafter. And I didn't put any auto send or anything like that because I was so scared of it. But I wrote all the code, so it's I trust it.[01:29:02] But it'll be interesting to see how people are gonna trust these systems. Yeah. So we've built some, like hard guardrails in place where certain actions especially any endpoint that is a post endpoint we, we, we flag these actions as like, we call them like a right action. So it's like read action versus right actions.[01:29:18] And if it's a right action, we require user of information in a way that I mean this is like technical details, but like, it, it is physically impossible for the model to actually take a right action without user of inform. So the user, it asks for his information and like the user through the confirmation actually issues a token that is required for the model to be able to call that, that thing.[01:29:39] AI Safety[01:29:39] How worried about you about AI safety is, is this like coming from a place of UX or AI safety? , I'm, I'm super worried about very long term AI safety, right? Yeah. I am, I am, I am moderately worried about like medium term AI safety, like the whole like misinformation thing and like, yeah, like I'm sure there are ways in which Lindy may go wrong, but like, that's not the top of my concerns, and especially because I've built this kind of system.[01:30:04] Like I see the ways in which you can build guardrails and like, this is just like an engineering challenge. Like it's, it's very solvable now. The very long term AI safety thing, like Yeah, I mean there's like an existential race and this is, this is a whole different beast. Yeah. Part, part of me, like trying to do B2B stuff, you know, in the, in the face of AI safety issues, it feels like, you know, you're just kind of rearranging textures on the Titanic.[01:30:25] Or like, you, you know, you're the four piece string quartet playing music to entertain people while the strip is thinking like . Yeah, yeah. It is discouraging a little bit because you, you don't really have a take on the problem, do you? Right. You're like, all right, I guess this is coming. And I, like, I, I, I'm my head and I'm like, I don't really see what I can do about it.[01:30:46] Sam Altman seems to think he can turn it off. Like he has his blue bag, which presume presumably has the off the off button. That that's why he, that's why he always has it with him. Dunno. Yeah. I dunno. Yeah, yeah, yeah. So, . Yeah.[01:31:04] Multimodal GPT4[01:31:04] Well, can I get your reactions just generally on like potential of like maybe multimodal GT four, like just anything that your, your, you know, US builder are looking to really take advantage of as it, as it comes down the line?[01:31:14] Yeah, I think multimodality and you know, audio and, and image especially, I think is like the next big zero to one thing, but otherwise, I think like, just language gets so far, man. So I was just having this conversation. To me it's the same thing as like the cpu, right? Where it's like Fairchild Semiconductor and like Intel, like they gave us the CPU and I think again, like the lab coat researchers passed the button to the hackers and Z garage, like the Steve Jobs and, and, and Steve Snak who now owns the business of building the pc.[01:31:42] And so that doesn't mean that like innovation in the CPU is over, like the CPU still has like four decades of ahead of it. But yeah, like we've got the cpu and now I think that the product and engineering and hacker teams have to, to take it from there. I mean, Intel did pretty well. Totally. Yeah.[01:31:59] I'm not, I'm not saying like OpenAI is going anywhere, for sure. Yeah. Cool, cool, cool. Uh, Any other yeah, does anyone else have questions? No, I see you unmuted.[01:32:07] Designing AI-safe APIs[01:32:07] Yeah. Just upon the on the like safety, AI safety side, I mean, as much as I Sure. Hit the complexity of Im I mean like permissions in AWS and GCP and so on, the server purpose, and I think like maybe in this page, like if you can hit any endpoint on the internet like how do you control which endpoint?[01:32:24] Yeah. So maybe this is, this is like a connection for flow, like one new generation of Im, which is, you know, you have a proxy sitting in front of, in front of the internet and you're only allowed to see certain parts of the internet. You said you have like, you have like right access on the post request already, but yeah, maybe there's something around.[01:32:40] Yeah. So we're looking into this kind of catchall guardrails right now. The way our must, for example, the Gmail API is, so it actually writes code, but at no point does it use a library to make rest API and, and phone calls, right? Like it actually we give it a function that's like Gmail, send email with like primaries for like two and subject and bugging and all of that stuff, right?[01:33:01] And certain of these actions, again, require an authorization token that is specific for like that one action, and these authorization tokens actually expire. So yes, in theory the model could circumnavigate that by writing code to like call the, the API endpoints directly. We've not seen it do that yet.[01:33:17] And, and that's just not the way we train the model to behave. That's pretty response. That's like general platform question for maybe you in the future, maybe OpenAI. That if you hook it up to the, how do you prevent it from, I, I'm not saying that the AI will do something malicious, but like a developer who gets it to write some code and hidden endpoint that you didn't give it permission for.[01:33:40] So for example, you can, in Deno, I I love the permission system in Deno. You can give it access to your file system or the n or you know, like the internet, but like how do you specify only a part of the internet or only a part of a domain or so on?[01:33:56] Yeah, so open by the way, I, I, I'm a little bit bearish on the Deno permissioning because it's permissioning on the whole executable. And and that's, you know, it's basically you're going to try to relax it the moment you run into errors and people just kind of relax it all the way, you know, it's kind of.[01:34:12] True. Very. I was actually I, the way I got around it, I, I was starting a new a new process subprocess and only giving it access. Really? So instead of making Yeah, it was, it was really done. Really annoying. Well done. They should go get it only. Exactly. Yeah. It's kind of overselling the security if like everybody just runs like, you know, pseudo whatever the pseudo is in, in, in Deno.[01:34:34] But yeah. Okay. Cool. Any other reactions?[01:34:36] Flo's Closing Comments[01:34:36] Flo, before I'll give you the, the last word here, just reactions to Chatt, PT and open the eye shipping velocity in general. You're, you're always a good speaker, so leaving to you for soundbites. Soundbites. No, it's great. You know, I, I, I'm excited to see this kind of product, see the light, and I, I, I don't use them as like direct competitors just yet.[01:34:51] And even if they. Look, I think the market, this is going to be the model of our market, so I think it's gonna be, it's gonna be more than fine, but maybe room full. Mini here. Blue ocean. That's right. Time to build. Let's go. What do you think swyx? What do I think? I, I, I, I don't know what to think. That's, this is why I started this space because I saw that CHE BT can run f fm Peg, which means it is a compute platform, right?[01:35:16] Like it generates Python code, it runs the Python code. It can receive files, it can store files, it has memory and then it can let you download the files. Give it some GPUs, and you can run Lama inside of chat, gbc, for whatever reason you want. It is a new compute platform now, and I want to build for it, but I don't know what I, what I can.[01:35:38] Yeah, I, I agree. I think it's, it's, these large models are like the next operating system. I'm, I'm very convinced that that's the way people are gonna interact with the computers. Like, you're no longer gonna do work at your computer, you're gonna have a conversation with your computer and the computers gonna work for you.[01:35:55] Well, you're, you're certainly building the platform for that. So everyone go check out Lindy. I think this is a great conversation. I always want spaces to end on a high note. But thanks for joining in. I know it's like zero notice. I was just DMing you. But thanks for coming on, man. Yeah, thanks everyone.[01:36:09] Yeah, all. Go out there. Bye. Thanks. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.latent.space/subscribe

Hello, when welcome to the latent space emergency episode. This is our first ever where ChattyPT just dropped a plugin ecosystem today, or at least they demo their plugins. It's still on the wait list. But it is the App Store moment for AI, and we did an emergency two-hour space with Logan from Open AI and Florence Cravello from Lindy AI and a bunch of our friends. And if you ever wanted to listen to what it's like,

2K developers process in real time when a new launch happens. This is it. Enjoy. I assume everyone has read the blog post. For me, the big shift was, do you see Greg Borgman tweet about FFMPEG? I did not. I should check it out.

It is amazing. Okay, so chat TBT can generate Python code. We knew this. This is not new. And they can now run the code that it generates. This is not new. I mean, this is like, this is good. It's not like,

surprising. It's fine. It can run FFM peg code. You can upload a file, ask it to edit the video file, and it can process the video file, and then it can give you the link to download the video file. So it's a general purpose compute platform. Wow, did they show how they do this? Agents? I just pinned it. I just pinned it. Did I pin it to the space? I don't know how to Yeah, it's showing up there. Okay. It can run arbitrage code. Like, Replit is fucked.

Is my... And by the way, I'm high to people. I don't know how to run spaces. I'm not something I normally do, but you want to say something please request. But yeah, reactions. Have a look at this video because it generates and runs video editing code. You can upload any arbitrary file. It seems to have good enough compute and memory and file storage.

This is not chat anymore, man. I don't know what the hell this is. this? What is this? Well, progress has been a lot faster than I expected. That's all I can, I, I don't know how to respond. Yeah, it's pretty wild. I wonder, I'm wondering how this will affect opening up the app store, different from, let's say, Apple App Store when it opened up, because there are a lot of big companies just building

stuff already and how a small developer will be able to build something. that's not already there. It will be interesting. So one thing that's really nice, have you seen the installation process for the plug-ins? It's right at the bottom of the blog post, and you have to play the video to kind of see it. But literally anybody can write your own plugin.

It's a small little JSON file. It's literally like 10 lines of code. It's 10 lines of JSON. You describe what your plugin does in English. You give it an open API spec. That's it. that's that's the plugin

so you can distribute your plugin this is this is this is easier than extensions manifest v3 which no way knows how to use this is English

you write English so yeah I mean I think I think there'll be a lot of people trying to develop for this if they can get access which everybody's on a wait list I've signed up to

200 wait list this week I wonder if it will be different if you if you sign up as a developer or as the chat dbt user hopefully it doesn't matter right so use different emails to set up to both let's see let's just see in fact use chat dbt to generate like plausible sounding reasons for why you want to build whatever because they don't but yeah I mean how do you compete I don't know man you know it's really opening eye is definitely using a partnership strategy to do

what they do here which means they're especially picking favorite so if you're a competitor of Expedia, Kaya, OpenTable, Wolfram, Zapier, you're a shit out of luck, kind of, you know, because these are presumptive winners of their spaces. Right, and it will happen to many industries probably, right? I was thinking about maybe summarization or, I don't know, YouTube video summarization, but there seems to be some application of that already on the examples that you shared.

Yeah, yeah. They have shared that, but I think there's always room to improve experience. It's just, you know, it's interesting which platform, like, sort of platform strategy, right? Like, if you write an Open AI chat plugin, you instantly gain access to 100 million users, right? All of them can instantly use your thing. Whereas if you're a standalone app or company, good luck trying to be able to use Open AI through you. There's just no point. So you much rather just be on opening a ad platform and

promote there. The fortunate thing is they don't have some kind of popularity ranking yet. Actually, someone should go open, someone should go up, register, like, opening eye plugins list.com or something, where, like, everyone can, like, submit their own opening eye plugins and, like, upload them,

review them. Because this, like, this is not a complete app store without reviews and a rating system and a reputation system and probably monetization. opening air probably doesn't care about that but i mean i can go start there right now fuck i'm going to start right now yeah it will it will take a while right

like this is the basic version of the of the app store and probably will be evolving a lot but we'll see it's crazy one this is a pretty good basic version i don't know yeah the basic version can browse the web it can write and write and execute code. It can retrieve, you know, we can retrieve data from documents, right?

So all the documents search just died. There's like five of these in my company there right now. All of them just died. The P-D example is pretty crazy. How they use the FMEPEG library, or if I'm saying that correctly, but right in there, you don't need to write the Python code to lead the video.

It's pretty crazy. I'm going well with that. It's crazy. I don't know. Yeah. Any reactions? Please, you know, open space. Anyone can request this speak? Oh, Ash. Come on in Ash.

I have to add you a speaker. Yeah, we're just reacting here. I just, I needed a place to talk, and I'm in Japan, and I don't have anyone else to talk to. So I need, I just want to share this moment. I think it's a special moment in history. This is the biggest new app source in stuff. Yeah.

Hey, Sean. I think opening, like, Instagram is already taken. Oh, man. someone someone bought it already yeah of course right of course what are your reactions how are you feeling what's what are you seeing out there this crowdsource all the tweeting yeah man it's it's been wild i mean i get it off later like five minutes and then in a way everything drops you know i think productivity today will be like zero if i if i still i quit my job you know a few weeks ago but i would not be working today there's no point right there's nothing else there's not

else is important, like nothing's going on. Like, this is the only story. Yep. I wonder if you have any, any frameworks or anyone that's listening, any frameworks on how you're handling all of this new stuff, like every single day is something new comes up and or you can like get the wait list invitations to use the new products. Like, for example, I just got the, the one from GitHub, CLI and I was just playing around with that and then suddenly I started to see all of these Twitter traits with the announcements.

It's getting crazy just to follow up with the stuff and every day something new comes up and I started to feel a lot of formal, you know, like how do you keep up with all of these or how do you focus? Does anyone have any good frameworks for that? Well, feel free to respond. Also, we have some more room if anyone wants to share your feelings. This is a safe space to share your feelings because we all don't know how to react right now. I don't know. I have a few notifications on for OpenAI employees and people that I think do good recaps.

So in other words, find the people who are high signal and who do a lot of gathering of other people stuff for and then just subscribe to those people and trust that that is 90% of it and forget the 10%. Right. And so on, probably I have another question. So I can't really figure out like what's left for us to do, you know, without this air tool.

What do you suggest we learn next, you know? There's no point in learning some coding stuff because you can only do that. We can't do arts. You can't do poetry. Farming, bakery. Making things with your hands and joining the sun. Do you guys think this should be regulated? Like, you don't go more than.

like the speed at which is going I don't know I don't know there's no point like if like if you regulate open AI then someone else will come along

the secret is out now that you can do this and at most you will slow things down by 10 years you call it a secret okay this is the end of the world

yeah yeah I don't know secret is out China's trying to do it right so I don't know if the people have seen but like

China was for it It was fairly strict on crypto, which is probably good for them. And now they're also trying to clamp down on AI stuff, which is funny because Ting Hua, like, the MIT of China, Tinghua was actually doing producing really good bilingual model. But yeah, they seem to be locking this down. So we'll see. We'll see. Right.

Like, you know, in sort of the free world, there's open innovation that may be unsafe. Open AI is trying to be safe. You know, there's a big part of the blog post that was talking about red teaming and all that. I'm sure everyone of us skipped it. I skipped it and then and then we just care about capabilities. And now that, you know, every time people have their minds opened, like, I did not know run FFMPEG in chat. Now that I know, my conception of what a rebel is or literate programming or what a notebook

is, is completely blown out of the water, right? Like, there's no, like, this is a new form factor for me. So now that I know that, I will be innovating on that or trying to shape this into something that I can use because I want to use it. This is clearly better. Does this have to do with the AI as backend ideas that have been? Yeah, you know, GPT is back in. So apparently I had a few friends reach out to those guys,

and they're not doing that because it's not mature enough. Like, it works for a simple demo. So for those who don't know, a scale idea, I did a hackathon, I think two months ago, just before I did mine. And the winner in the hackathon was something called GPT is all you need for back-end. and they actually went and registered GPC is backend.com but as far as I can tell they're not going to start a company based on that

because if you even push a little bit it falls apart, right? So GPC3 wasn't good enough for that. Maybe GTP4 is, maybe GPC5, but then it will still be super slow and super expensive. Like you don't want to run, you know, a large language model on every API request. So I don't know. I think it will be good for scaffolding.

I'll even good for Repel-type use cases. Like, hey, I need to edit this video on an ad hoc basis. I don't want to learn an FFN tag. I don't need to now because I can just talk to chat TPT.

That makes sense. But if you want a reliable, scalable backend, you probably don't want to use it on a large language model. But that's okay

because the language model can probably help you write it rather than run it. Hey, Lesio. Hey, guys. Oh, yeah. Hey, guys, what's up? Yeah, we're just,

there's no structure. Just drop your reactions. Let's go. Awesome, awesome. Guys, what do you think? what if Sean what do you think if you could use you know AI and the education field like you know like personalizing the education system for students what's a thought of my education or attribution education yeah that is the holy grail this is called the blooms two sigma problem like the the

one of the big issues of education is we have to teach to the slowest person in the class and and you know I'm a beneficiary of a gifted education system where they take out you know nominally high IQ people and put them in a separate class and yeah we did we did do better what if we can personalize every students experience there's there's some educational theory this is called blooms two segment problem where the results will be better i think that we are closer but like i still hope that we're pretty far sounds like a negative like why do i want to deny education to students because if we are there then we will have achieved theory of mind for ai the ai the ai as a very good model, is able to develop a representation of who you are, is able to develop

theories that attest who you are in a short amount of time. And I mean, it's a very dangerous path to go down. So I want us to go slowly rather than fast on the education front. Does that make sense? Yeah, definitely. It makes a lot sense. And yeah, definitely. I think a personizing the education for each student and making it run the best way would be great. And what do you think how about like first of all i'm not very curious question you know like we are having this week was full of launches so how you guys are keeping up with i'm not i'm not this is i created the space so because i cannot handle it today today was my breaking point i was like i don't know what's happening anymore yeah like every single day i'm just in constant anxiety that like everything i assume about

the world it's going to be thrown up like i don't know i handle it this is a therapy session so feel free to express. Definitely. It's been a very overwhelming feeling for everyone of us. I think, you know, like past two weeks and like the industry was definitely a lot of launches.

You're definitely open for, you know, to discuss more about it. Thanks a lot for this space. Yeah. Yeah. Fanch, one more thing. So I think that the most constrained version of education use cases

is language teaching. So there are a few language teachers out there. speak, I think is one of them that is an open-E-I partner, and they're also part of the chat GPT plugin release. But there are also other language tutor platforms. You can search and have your news. There was one that was released maybe like four or five months ago that you can try to see what the experience is like. And you can tell when the teacher has no idea who you are. And it breaks the illusion that you're speaking to another human. So I just, you can experience that today and decipher yourself if we're ready for that. I hope that we're not ready. And it seems like we're

already. Yeah, definitely. Definitely. Thanks a lot for sharing. And guys, what do you think, like, in the launch before, they have showed that we could, you know, generate apps and web apps just from, you know, like a single simple sketch, you know, different tent, just after a format sketch. So what do you think, like, how it would be impacting the industry? It's all. It's not just like that sketch was a very shitty sketch, right? It was just like drawn on a piece of paper. But if. If you combine that with Montymodo, like it was that they had another part of that demo where they had a screenshot of the Discord, the opening I Discord. And you're, and they put it in and it like read the entire screen to you.

And if you can read the entire screen, you can code the entire screen. So it's over. In game. It's definitely, I think interaction designers, you know, like people who like design, you know, like, design function still have some. sign yeah i just i just i just i just i just tried the same thing you know on bar today and it was like much more better than gpd3 so definitely it's you know things are really changing great forward i'm i'm really worried what we want to do you know do you think the competition will like stable everything like you what competition anthropic well like google google won't rest i don't

the Google race? Google? They will fight... The one that launched the Wobly linked list of blog posts that Google?

Not the list, not the list. Competitions will come. I have a question. I mean, my fear is many of the jobs that are going away, whether it is developer and designers, because I mean, I think

GPT4 is very capable. So how to deal with it. I mean, it's going to replace, I mean, many of the jobs. That's for sure. Yeah. It's okay. We'll find new job. Or we'll not need jobs anymore. We should also start universal basic income.

That is something I do believe. Yeah. I think the main change is going from the web of like syntax to like the web of semantics. So if your job is valuable because you know a unique syntax or like you know how to transform things from like words to syntax, I think that will be a lot of a lot less useful going forward. But the semantics piece is still important. So a lot of product work, it's not just writing CSS and HTML and like the backend for it. It's a lot more than that.

So I'm just thinking about how do you change your skills to do that. But yeah, even the sketch, you know, you got to draw the sketch. And to draw the sketch, you got to know where the button should go. You know, you have to know how people want to interact with it. Yeah, I'm just processing this as I just read the whole thing. as well. And yeah, I mean, it's been a wild couple of weeks and it's gotten me thinking that maybe all our role was over the past couple years was we were just middlemen to talk to computers, right? So we're sitting in between. It's over, man.

PMs or business folks or whoever want to build a product and then as a software developer, you're just a middleman, just talking to the machine and it seems like an LP is the way forward. Yeah. Yeah. It's been, it's been a while a couple of weeks. It's, I feel like we all just have to move, either move upstream or find other jobs. We just got to move upstream either towards product directly. Because right now the plugin is just, you know, it's still a very sanitized day that is controlled by OpenAI. But imagine them opening up the UI portion as well. So you no longer need to have a siloed product that needs to integrate with Chad GPT.

instead that you can bring your product directly into chat gpt i don't think i think that would be probably the next next logical move after this and i'm sure they're already thinking about that so that's a great i don't know if this is it's wild what do you guys think yeah yeah like so before you came up right i was talking about this thing chat tpt has at least 100 million users why would you bring people to your platform rather than write a plug-in for chat dpte and use their platform it's an open question now. Zapier just launched their integration of OpenAI and OpenEI just launched their

integration of Zapier. Which one is going to be more interesting? Probably Open AI's. Totally 100%. This is the App Store of our century, of our decade. I don't know. Maybe century. I think the thing with the App Store, though, if you think about it, how many native apps do you download

every week, every month versus how many web things you use? So I think it's all about weather not long-term open AI's incentivized to keep broadening the things you can do within the plug-in space. And I think they'll have, you know, as this technology

gets more widespread, they're going to have a lot more pressure from regulator, safety, blah, blah, blah. So I'm really curious to see. You know, all that government stuff that they'll have a congressional area on this in six months, and by then it will be completely irrelevant. It's like, like,

the time, they called it the GameStop guy after he made like 20 million on GameStop. And he just, you know, he was like, yeah, you know, follow the rules, made a bunch of money. For those who don't know, unless you and our co-hosts on the latency, we're supposed to drop an episode today, which I was supposed to work on, and then chat TV dropped this thing. And now I can't think about anything else. So this is my excuse for not working on the podcast today. I know. It's funny. We have like three, four recorded ones, and then last week, like, GPD4 came out and we're like, okay, everybody's talking about...

It's irrelevant. Like, I don't know. Exactly. But yeah, I'm really excited about the... I feel like the first use case for this, and I think he tweeted it about it too, is like, before, if you had to do, like, data reformatting and stuff like that, it was really hard to do programmatically, you know? Like, you didn't have a natural language interface and now you have it. And before, if you had to integrate things together, like, you could explain it very easily, but you couldn't, like, put the APIs together.

And now they kind of remove all that part. So I'm excited to see what this looks like for commercial use cases, you know? You could see, like, is there going to be, like, a collaborative chat GPT? Like, you're going to have two, three people in the same conversation working on things. I think there's a lot of things that will improve. And so I saw we had Lenny from OpenAI for a second, I almost pulled them up. but I'm sure you cannot talk about it. But yeah, it'll be interesting to see.

Yes, sir. We're extremely excited. Extremem excited. I don't care. I don't know what else. So as far as I can tell, there's the, there's hacker and Twitter. I haven't looked at Reddit yet, but I'm sure there's a bunch of reactions of Reddit. I'm sure there's the Open AI Discord that we can also check out.

I got locked out of the Discord at some point, but yeah. Anyone else, like news, demos, tweets? The whole point of this is that it's live. So please feel free to share on. comments or anything like that. The, the critical thing I saw was Mitchell from HashiCorp

pre-tweeted about how the integrations actually work and you just write an open API spec and then just use natural language to describe what it's supposed to do and then their model does everything. I wonder if they're using the off-the-shelf model or they have like a fine-tube model

to actually write integration. I wonder I don't think they'll ever say it. Knowing them probably they'll just use the base one because they want, like I think opening eyes kind of wants a god model, right? There's no point, it's not intellectually interesting to do small models for them.

Like, it's trivial. Yeah, yeah, yeah. This is a minor optimization problem as far as the long arc of history, and the point is to build a GI, safe AI. And I do think this is kind of safe, right?

Like, one of the criticisms that people were saying on Hackroniers was that this is very closed. It is an app store. At any point, opening, I can randomly decide to close this, like they did for a codex, and then they change their minds.

Whereas if you use something like a land chain, it is more open and something they... At the same time, like, clearly this is a better integration path than lung chain. Like, I'd much rather write this kind of plugin than a lung chain plugin. So they've managed to... I mean, they know how to ship, man.

They're an AI research lab, but they also know how to ship. product. Yeah. I'm curious to see what the pricing model is going to look like. Also, I mean, if I'm writing the plugin, this is great because I don't even have to take care of the compute. You know, like I just plug it in and then they actually run everything for me. But how it will be monetized?

I mean, if the Japier is giving their plugin or Xcadia, I mean, people will not go to their website. Yeah. I don't, I mean, yeah, I have no idea. I don't think they said, but also don't super care. Because in the app store, it's transaction driven, but on chat GPV, you're just paying a flat fee every month. So you can't really do revenue share on a flat fee. And I don't think that we use like the Spotify model.

It's like a, based on the amount of times. No. Wait, wait, wait, wait, why not? You have, like, Spotify. Spotify works because Spotify has power, right? Open and has power. Same thing. they have all the audience.

Yeah, but every, every song is like the same value. Like, if you listen to song X or the song Y, like you're going to make the same money. Like, if I'm calling the API to, for like the meme generator, or if I'm calling the API for the, you know, business summary thing, they're probably going to cost different things, you know.

So it's kind of hard to model out for open AI to say, hey, okay, we're charging. We're going from 20 to 35 bucks a month. But then, like, how do you actually do royalties on a per model basis? Like, how do people decide what royalty to negotiate is where it needs to be a flat P? But I don't know. I mean, or put your credit card in Open AI, and then every time you want to use a plugin, you pay for it separately. UVP usage-based pricing all the way.

And then you just get a surprise at the end of every month. Exactly. The only question mark is, like, how much does Open AI value the training, you know, and, like, how much they want to subsidize? the usage. It's Canada. They have promised to not use any of our usage data for trading. Oh, but I think like the plugins, it's a, it's a different thing. It's like how you could you could easily see how are like requests usually structure or like these things. You know, like are people searching for flights and stuff like that. I don't know. I haven't read the terms

for like the actual plugins, you know. Well, if anyone has, please come up to speak. we're all processing this line this is the therapy session yeah yeah good one thing I see is basically you have to change the plugin I mean to ask anything or even if it is browsing right I see I mean they are becoming directly competitor to Microsoft also I was in plug because now user can actually just see I mean instead of Bing chat or Google I mean they just basically select the browsing plugin and basically get all the updated data. And other thing I see is basically you have to change the plugins.

Like if you want to use the Expedia data, I don't know how it will fit with the browsing plugin or you can select multiple plugins. But yeah, it is interesting. I mean, if we get access. Yeah, there is no actual browsing plugin. The browsing is a new model. So just like you can select GP3, GP3, GPD-4-5, GPD, GPD, there's a new model now

that just says browsing alpha so you can use chat to the team browsing mode and then you can use it in plugins mode which is a different model again so the plug and browsing don't cross over. Oh that's interesting and how do you see I mean Bing in this

whole this and they are becoming computer to Microsoft or how they are playing it out? I mean Bing is just by the way like yeah this killed the Bing wait list because you don't need to wait for Bing you can just use the browsing mode of chat chipped. How does it compete?

It competes for sure. I don't think Microsoft cares. I don't think Open AI cares. This is one of those things where, like, you know, they are the two friends, you know, and they're clearly winning. So who cares? I don't, I don't imagine it takes up any of their mental bandwidth at all. Yeah.

The main thing is Google is. Yeah. Like, how is Google competing? Well, let's see, right? Bard is out there. I haven't got us yet, but it could be interesting. Again, like, it doesn't seem like they have the shipping capacity of velocity of Open Eye and Microsoft, and that is probably going to bite them eventually, because there's already been a big brain during. Something like four researchers, for the top Google Brain researchers left Google Brain for Open AI in January,

and, you know, those are the ones that I know about. And I imagine there's quite a bit of brain drain and firing going on to Google. So who knows. All right. Any other topics, concerns? Hyperventilation. If you just want to scream, I can turn down the volume and you can just ah for like five minutes. That was literally I was like, I need to like scream and just ah, because of what is going on.

I said that I'm killing out the form right now. Oh, yeah. Okay. So use chativity to fill out that form, right? And then use a different email and to fill out the form. a different way. Just maximize its chances. I'm going to ask

GPT for what plugin do I want to build for chat GPT? Right, right, exactly. Yeah, yeah. We can rest our plugins. We can brainstorm live.

Yeah, I think that would be a fun exercise. Like, the main thing that breaks my brain is just this whole ability to run code, right? Like, this is a new notebook, a new ripple. It looks like it has storage and it has memory.

It has GPUs. I mean, can we run Lama of ChargipT? I don't know. That's a model within a model. I think for me,

most of the things come to like, you know, if I have my own personal system, what I want the assistant to do, I think, like, travel is like the first thing that comes to mind. Like if I could use ChachyPT to plug in with my calendar. Yeah, yeah, yeah.

Yeah, yeah. but it needs to know where I'm supposed to be going to, you know? Like, if I just add a calendar, that it's like I'm going to, you know, Rome this week. Yeah. And then I can automatically both send my calendar and say, okay, these are like, or like the times that you like to travel. I know that you don't like ups and yada, yada, yada.

That's one thing that I've always, we had this thesis at my previous firm about personalized consumer. There's so many websites. Like, I go to a lot of basketball games. And every time I open ticket master or whatever, it always shows me that you see the seat. And like, I'm not going to see, that's not where, that's not the tickets I want to buy, you know, but it doesn't matter how many tickets I buy and you never remembers that. So I think a way to say, to see, take all of their information in and suggest, hey, I saw that there's actually a price drop for the specific seats that you want, not for like any seats, you know?

I think that would be a very good use case. So I've been a personal entertainment assistant for like travel, I go into shows, you go into games. That would be cool. That's what I'll submit on the wait list. Then we'll see if anybody cares. Right. Did you see Get Lindy?

Yeah. Yeah. Maybe you want to recap Get Lindy for people. I'm going to pin it up on the board now. Yeah. So basically, and this is like the kind of like an assistant Lindy AI, right? Yeah, Lindy AI. It's on the board right now for those who can see it.

through the space. Yeah. Yeah, actually at the AI thinkers meet up the other day, you can basically, like, create all kind of, like, personal workflows. And it kind of looks like integrations and like Zapier, but it's actually just natural language. So you can pop this thing up on your desktop and say, trying to hire 10 software engineers.

So go on LinkedIn and find 10 software engineers. The next step, draft an email that says, I'm the CEO of this company and I'm trying to hire for my team. Do you want to talk? Then the next step is like send emails to all these people and it's going to use people data labs or something else that they use on the back end to get the emails. Then it actually sends the emails and this is just going to run in the background as if it was like you actually doing it.

It's pretty neat that you don't have to write the actual integration. It's like it just uses natural language. So you're not bound by what they build. like theoretically anything you want to agree with you can just explain to it how it works and it's going to figure out how to do it so there's a wait list now flow didn't give us any papers just because we're at the need out so i'm also waiting to get access to it but it looks really really good yeah so generative a i's top use case is generating weightless right like we're so we have never had such an easy way to generate a lot of weightless a lot of sign up for waitness

oh my god so much interest so much so much product market fit but also you know one thing that you you raising this point. I think, by the way, I also pin this up, Nendy can support complex roles like, no meetings on Fridays, all one-on-ones are Monday, I like my meetings back-to-back

within five minutes, five minutes in between. So it's just arbitrary rules that you could not program in a normal assistant type environment without a large language model, which is kind of exactly what you want when you're booking your travel,

right? Like, hey, I only, like, I'll see it's unless it's a flight that is less than one hour, that I don't care, right? So stuff like that, I think it's super interesting. But also, like, not a common use case. Like, how many times you travel a year?

Like, you know, five, right? Like, more than that. But yes, I think for, yeah, a lot of times it's not a, it's not like a super widespread thing, especially if you don't do it for work. If it's in-frequency, you want high value. And then if it's, if it's frequent, you can do low value, right? Like, that's the sort of binary trade-off. Like, the Uber is sort of frequency and low-value, Airbnb is high-value and

frequency. There's something like that makes. So, like, you want, you want sort of spectrums of that sort. But the other thing that you brought to my attention was, and has room for Google to do something, is do you notice that OpenEI's plug-ins, none of them are Google? Because they're not friends.

So Open-Eite chat with TV will probably never have first-party access to Google Calendar, probably never your Gmail, and probably whatever, you know, Google copies opening eye again, they will do, hey, we have all your dogs. Yeah, I'm interested in that because I don't know if you remember, but like in the first iPhone, like YouTube came like pre-installed on the homepage. And then I forget when, but one of the early iOS is they removed it. So now obviously Google is not a friend who's going to be a friend in the future

who's not going to be. Like, do we all have to hail our AI overlords to get access to the change video login system? Yeah, the only one. are Brown CEOs. I think you're fine. All right. But yeah, yeah, I just invited Nader XU, my old boss. Hi, you can't lurk.

I want to hear from you. But also, you know, yeah, I think this Google point is actually novel. I'll probably write something about that. Yeah, I mean, I'll have to write something about this today. So please feed me things to write. There we go. Hey, what's up? Hey, man.

What are you thinking? I know it's like not entirely your space, but like you're all about the future. right? I mean, I did build and sell an AI company about a month ago. I did the, wait, what? Yeah, travel app was built on GPT3, tweeted about. You sold it? Yeah, it was getting like 100,000 visitors a day, like 60,000 to 80,000 unique a day. And then I, yeah, I sold it, like, within about 24 hours. I tweeted out that it was for sale. I had like 30 or 40 people in my inbox. Whoa, whoa, whoa, okay, okay. I need, I need back up. So like, but you're right. This isn't

my main like domain of expertise but it's fine it's right it's right you make you make hundreds a thousand dollars on the side it's cool wait wait so i saw you tweet the original thing which was hey you know gpc3 can plan your travel i don't know what happens since then can you feel the rest of what's yeah yeah so i mean i was basically you know i travel a lot for work i do travel like once a month and you know but i'm also very resource constrained on my time so i usually like to spend like one day sightseeing so what i typically do is i got a trip advisor and then i kind of like you know Google around and look at all these things. It usually takes me about an hour to figure out what I want to do on my day or two off

to go sightseeing. And then I realized GPT3, you know, you can just literally ask and say, okay, within X number of days, like I'm going to be in this city. I want to have an it, it's anteriorari, you know, can give all these different parameters. And it gives back a really good response. This is before GPT, even three and a half or four was out. So I just built like a nice UI on top. And then like I mapped over the results and was linking to.

you know, the Google searches for these different items and kind of made it into a nice user interface and, you know, just built it out and tweeted it out. And it just got a lot of traction and attention. Like I said, I had around 100,000 visitors a day, like right off the bat, 60,000 uniques like per day. So it was getting a shitload of traction. And I don't have a lot of free time to kind of like maintain or build something like that out. So it was costing me money, but I wasn't monetizing it. So the way that I was thinking to monetize it would be to use affiliate links and stuff like that. So I could either, you know, spend time figuring out a way to monetize it or just try to flip it and just make some money.

So I decided to sell it and that was kind of it. I just sent a tweet out and kind of said, this is for sale, who wants it. And I had so much inbound from that that I had to delete the tweet within about two hours because I was just unable to keep up with all the people that were coming in. And I filled out a couple of offers, and I found the person with the most money that could close within the shortest amount of time and just took it. Well done, well done. Awesome. I need an applause button right here. Okay, so with that context, your thoughts on today, what you see, there's Expedia in there.

But comment on travel or not travel, whatever you want. Yeah, I'm still reading up on the chat plug-ins, actually. And I was hoping to kind of chime into this to learn a little more about how they work. I'm here on the page. I've had API access from fairly early on. I signed up and I've been on and using it a lot. I'm trying to find some different ways to integrate AI and machine learning into the blockchain space. There's a lot of stuff around civil resistance that I think are going to be pretty interesting use cases for us.

It's obviously not like a type of use case that is going to be useful to the general public. maybe. But yeah, I'm still actually still trying to understand how these plugins work. So what, have you seen the developer documentation, which developer documentation at the bottom? Yes, that's where I'm checking. I'm reading through as of now. I see the examples which are pretty cool. Yeah, yeah. So my quote, the quote I put on Hackard News was this is open AI leveraging chat GTP to write open AI, open API to extend open AI chat GPT. I'm confused, but it sounds sick. But yeah, I mean, so open API, you know, not to be confused is Open AI.

It's randomly the perfect spec for open AI to navigate because it, you know, it's somewhat plain English. And then you just supply a description for a model. You describe a off method. So they actually provided a link to a repo where you can see some examples. The examples are not very, not very fresh out. But you can do like bearer off. I assume you can do O-W-W-W-2,

whatever kind of offer you are. Then you just provide like mobile URL, legal info URL. It's not that much. This is 10 times better than Chrome Manifest. Like, Manifest V3. Yeah, I mean, I'm reading through some of these examples, and a lot of them are in Python. I wish they would have more JavaScript stuff.

But I would say 10 times would be kind of an understatement if I'm understanding how some of this stuff is going to work. English is all you need, man. English is all you need. Well, so, and then I think buried in the video is sort of the experience, right, which is where you specify. So if you're first party, congrats, you know, you're inside of the chat, GPTI, but if your third party, you can just host your JSON file anywhere.

It's literally a JSON file on an API spec, right? You host your JSON file anywhere, and then you just like plug it into their text field here, and then they validate it a little bit, and it's installed. So there is a third-party app store on day one. Yeah, that open table plug-in example is pretty sick. Yeah. So what would you want as a developer that's missing? I think that we're like in the golden age of being a developer.

And I don't know if it's going to go downhill quickly or if it's going to go like get better quickly or this is like the end of all of it. Like it's open AI just going to be where like we do everything. like nothing else is like going to exist I think that okay you know what I know that's not the answer for sure I'm just kind of joking but I think it will obviously shut down a lot of companies this is the app store moment right for like just like

I mean you and I remember the iPhone app store moment some people dropped everything to write apps and they made it big and some a lot of people didn't but the people who were earlier rather than later benefited from understanding the platform like imagine you're a big React Native person for a long while

imagine if you have the chance to drop everything and be one of the first developers on a new app store that's pretty huge yeah 100% but I'm wondering like the type of mode that you'll be able to build with some of this stuff because it seems like that

Open Eye will just continue adding more and more features directly into the platform but I think like for very like niche proprietary type of stuff it might make more sense. But like if you want to build like an app for the general public, it just seems like they'll end up integrating something like directly within their platform for a lot of different ideas like such as this travel app that I sold. I have a feeling like they'll have a way better

version of that built directly into their platform sometime soon. Hey, hey guys, can I ask just to get a quick update? Does anyone here have access to it yet? Like is it is it open? Because I sign up for the wait list, but I haven't seen anything. Yeah. No, it's just it's just waitless where just like nine percent of the stuff that people launch, you know. She has a few videos and demos, but yeah, it's just a wait list. Who knows? I mean, opening eyes, opening has been pretty good about getting people off waitness, right? Like, a lot of people got off the GPT4 API waitlist, like, the day after they launched.

This one, I feel like they're quite fully baked. Like, it's, I wouldn't be surprised if they started dropping tomorrow. So we'll see. But, like, you can start developing your third-party plugins today. day because there's examples. The docs are like two paragraphs, but it's all you need, really. So I've been working and I've been following a lot of projects where people are, the one thing I don't see with chat GPT is like, why are we have Whisper, we have the APIs

for chat GPT. It's like, why are we not at the point where we're talking to this thing and it's talking back to us? Like, I don't know how we haven't, nobody's wrapped their head around that yet, but it's like, it seems to me like, don't you want to be? be like, hey, computer, build me an app that does X and it says, okay, and builds it for you you and talks back to you. Like, I just, I don't know, that'll be the first probably plug-in that I try to work on,

but it's just driving me a little nuts. That's awesome. Interesting. I never like the voice interfaces, because sometimes it gets really long. Like, some of the prompts get really long, and like, I don't want to talk that long. Yeah, yeah. So I was doing, I was messing with the system prompt, basically get it to be like, hey, look, I'm going to be talking to you, so keep it condensed.

I think, like, the ideal interface would be, like, for, like, talking to it would be, like, putting that at, like, the system level. But also, you know, being able to type as well as speak to it is just something that I'm trying to work on. And I think with plug, you know, if we can do that with plugins, that would be huge. Because I know there's already, like, a Chrome extension that allows you to talk to it. Or I guess you could do it natively as well, but, you know, native stuff on, like, iPhone and Android is not too good. so hey you mentioned that hi by the way you mentioned the way of talking to or having a way the i talking to you as a user so just today there was a new release to a flank chain i know it's

kind of not really the plugin but this is the closest thing probably and they edit a ask human tool so now the model can ask you a question if it's not sure about something to sure sure what So do I ask you if it's during its chain of thought when it's not sure to do an example? Right, right. Oh, I would love that. Yeah, it's chatipti's probably not going to do that. It's too carpeted. Yeah, I've seen a little bit about Langchain, but I haven't used it yet.

Has anyone here? Yeah, it's all about it. I did. I did. I built the Langtrain of the UI too. It's pretty nice. I mean, especially when you first came out, literally. It was like so rudimentary, but it's nice to be able to change things together.

I think the agent's part is pretty interesting. I haven't used it myself because I didn't need it. But, yeah, there's a very big community. See, LineChane was very smart, right? Like, they picked out the open source angle first, and then the others like Dust or Fixi did the closed source angle. Now they are in direct competition with ChartGPT, but Lanchain still has that.

It's open source, extensible. Like, you own your agent and them doing business deals with OpenEI in close. doors, right? So pretty smart, like strategic position, all things considered. It's a little, isn't it, it's like a little funny to me that, you know, it's like, because Google just came out with Bard, right? And I don't know if you guys have messed with Bart at all, but it's, at least to me, another way, this. Okay. Yeah, I mean, to me, it was a little overwhelming. I mean, I'm, I don't know if you've seen like the same. Yeah, if you've seen like the screenshots going around, like, it seems like, you know, someone tweeted it was like,

in a boardroom or whoever's in a boardroom just being like, shit, like, we need. Like, need to, you know, we lost our first mover advantage here. But it's just kind of funny to me that, like, I guess now Microsoft's going to have like an app store, right? Like, just after everything, you know, Microsoft dominated in the 90s and stuff. And then it was Apple, Apple, Apple. But it's just kind of funny to me that it's going to be, I guess, Microsoft now, right? Bard feels like Bing does to Google. Totally. Yeah, 100%. I agree with you, 100%. All the turnstables, right? Yeah. So for those of you who might have missed the earlier discussion, the one thing that OpenAI or Microsoft

will not do is integrate with Google Pounder. So the one saving grace that Google probably has, it probably owns your workspace, right? Like most of us have Google accounts, Gmail accounts. When we work, we log into Gmail and Google again, use Google Docs, spreadsheets.

So if Bard is smart, they will take advantage of that. And then slowly watch as everyone moves to Microsoft office. I think Apple should do a partnership with the OpenEI and basically Microsoft because Google has huge advantage of Android. So basically having Open AI on the iOS, I mean, having the partnership with OpenEI would make, I mean, really useful on iOS devices. I mean, Siri is really bad. And if they integrate with iOS, I mean, they win the world, I think.

so it would be a huge beneficial to Apple and basically Microsoft also if they integrate together because Microsoft doesn't have any of the devices and most people are most ordinary people use the devices iPhone or phone and Android phone so it would be huge advantage and for them and basically Apple I'm very curious to see what Apple ships next you know everyone's shipping AI stuff and then Apple was like hey look at our AR classes yeah but I mean AR, AR with the with the 3D models that are that are coming out. Because isn't it mid-Journeys working on like a three, like their lab I know is building a 3D generative model.

And I think that sort of stuff with with AR is. Oh, is that, is that public? How did you know that? I don't know if it's public. I saw a tweet about it. I don't know, like a week ago. It's a semi-open secret in this episode ago, but I don't know if it's public. Yeah, I think I saw them, it was some context of they were talking about text of video and

they were like, well, we're doing our like 3D modeling first. So, I mean, my assumption is, and I don't work in the space yet, unless anyone's hiring, please, I'm looking for work. But it seems to me, like Apple seems to have their head on straight. And like, it might be that if they're going to release these AR, like, mixed reality, AR VR glasses, like, you know, the thing that makes the most sense to me is like getting, with generative AI, video modeling, it's like, you know, it would be cool to go to, like, a coffee house or a bar.

And then, you know, when you see, like, the graffiti and the, the bathroom when people write sometimes funny stuff sometimes like the worst stuff you've ever read in your life and you're like what is going on when this person's going to the bathroom where they have this much hate but it's like it would be cool to have a component of that you know like in the metaverse so to speak right like so you put on your AR glasses and it's like oh cool I can see like a bulletin board here that exists in the physical but it's also in the you know it's like augmented right that's just to me it seems to be like the logical next step interesting we'll see that happens. I recently got a quest

to Quest 2. My parents love it. Any tech that my parents like, I think has a real crossover appeal, you know? The thing that your conversation gave me an idea for, winners of every app store in the early days, like Facebook has an app store,

Apple had an app store. You know the winners of the app store? Gays. Like, what we need is a multiplayer, like everyone logging into chat dbtee, and then playing a multiple your game. Good Jeremy. Yeah. MPC

NPCs are going to text you on your phone. That would be kind of cool, actually. I was thinking, I don't know if it's going to be games at first, though. It seems like games always push the envelope with tech. Well, it's like pornography and games, right?

But, like, I don't know. I was talking like, you mentioned your parents and, like, you know, I was talking my mom about this stuff. And I was like, you know, I'm seeing stuff that are just demos. I'm just like, hey, take a picture of your fridge and it'll tell you, like,

here's what you can make. or, you know, even like talking to it and just being like, hey, here's what I ate today. You know, what's my, how many calories I ate today? Or, you know, what's my diet plan? Just things like that. And that's why I brought up the talking to it just with using natural language and then having it being able to talk back to you. I'm, like, really surprised that they haven't implemented that yet.

Because it seems to me, like, that's a use case that a lot of people would use it for, you know, or if you could just, like, you know, call it on a phone. If you built like a Twilio back in into it or something. I just don't, it boggues my mind why they haven't put that feature in yet. Yeah, yeah, I really don't think it's going to be too long before you're sitting there at work and you get a text or call on your phone from an NBC. Hey, our village is burning down. You need to come over here and help. Do you guys think there's going to be different silos like, you know, with Bard coming out and, you know, people implementing GPT3 and four now, I guess, into all their apps?

but do you think they'll be like chat gpt will have their store and then google will have their store do you think it'll be like there's going to be a clear victor here and then you know it'll be like okay google's apps or you know google docs or whatever is like part of chat gpts plugins right yeah it's going to be like crypto everybody's just going to be fighting for the top you're going to have the couple of dominant people but then you're going to have all the the small guys who go up and down and yeah i i i feel like it's going to be pretty similar to how cook on release was so we're going to have some slurp juices is what you're telling me yeah boy nice nice i dig it so maybe we aren't tell me what you guys think about this because maybe we aren't thinking about this right because

maybe this is not an app store because typically in an app store you'll go ahead and choose which plugins you want installed like on a phone or whatever have you but the path forward seems like all the plugins are like omnipresent. I don't know why Google isn't shitting their pants right now because basically you check the opening eye could just force all the big companies to write plugins and then just be a single search box for everything. So imagine if you want to fly somewhere or you want to book a hotel. We have the Expedia and booking.com, both of those plugins summoned up.

And it shows you both the results. And then you can click through on whichever ones you want. And then, yeah, you charge them based on click-throughs. Like, I think, like, maybe we're just getting tripped over by the fact that you have to choose a plugin right now and only interact with that single plugin. But I think the smart move forward would probably be just to have all of them omnipresent and then have this like NLP higher layer up there to summon the right plugin when need be. What do you guys think about it? Yeah, so that's like the Langchain thing. That's what I haven't used Langchain yet, but it sounds like that's, from what I was reading

with Langchain, it sounds like that's kind of how I thought that worked. But I don't know. Can someone here like enlighten me? I don't know how Langchain works. Yeah, I don't know how Link Chain works either, but I think it's going to be a two-way street. Everybody's going to be making plugins with chat GPT and everybody's going to be making chat GP plugins for other services as well. I think there's going to be a whole bunch of people about to make a bunch of Gera plugins and stuff like that.

So I think it's kind of going to be a two-way street. I don't know. Is anyone else like this is super exciting to me? I haven't been this excited about like the internet since like probably like the web 1.0 days. Like I'm so happy. Yeah. Yeah. Like I hate Web 2.

Like this is cool. I'm glad that like spaces exist. But I hate Web 2.0. Like Web 3.0 I'm about and like I consider this part of Web 3.0. but it's exciting, right? Like, this is cool. Like, I'm really, you know, I'm stoked about the progress that's being,

like, the joke is like, you know, every day in AI is like, it's like way longer, right? It's like we're telescoping very quickly. Yeah, I mean, one of the things that, you know, I would say I'd notice towards maybe like three years ago when I was working at WS,

it just seemed like for about five or so years, everything was very stagnant and there just wasn't a lot of excitement. things that were happening. Everyone was like, if you remember, all the dev advocates were like all creating like tutorials around creating your own CMS and your blog. And you saw like that exact same tutorial given by like hundreds of people over the course of a few years because there just wasn't any cool shit that was happening. And then I think when crypto and blockchain stuff like that kind of caught my attention caught my attention and I'm still excited by that that stuff. And then this seems to be just

almost like when if you were like around when the iPhone was coming out and actually realized how important it was I think everyone now is seeing this and they're all like realizing how important it is and it's cool to be like part of this moment as a software engineer yeah yeah I was sorry I was gonna say like I'm excited for you I'm sure you guys saw the alpaca stuff right and I know that they're doing DMCA stuff but eventually someone's going to train one of these models and it's going to, you know, you're going to be able to run this stuff offline. And just like the way to, if you have access to like, I forget which one of the E Accelerate people was talking about it, but it's like, wharf in the flask. It's like you've gotten the machine offline. So if you don't

need internet access to access like the entirety of human knowledge, whatever's in the data set up until 2021 or whatever and you don't need internet access, like that's going to revolutionize everything. Like, that's insane to think about. Yeah. Well, we won't expect a good. We won't You can run inside of chat dvety since productivity runs Python. Oh, really? Is that happening? I mean, it has a file system and it has file storage and a CPU of memory. Yeah.

Turtles all the way down, turtles all the way down, man. I think the plugin system, if people can get to run their own models, like the Lama ones and the same structure for plugins, you can see it like, going back to the Metaverse thing, like in Snow Crash where people build their own like demons, you know, it's like I got the demon that like kicked people out of the club,

the black sun. But you can see in real life it's like, I have a bunch of plugins that only I have, you know, and I use them to make myself more productive, use them to make myself, you know, look like I'm working when I'm not working and I'm like responding to my emails and stuff like that.

But I think like, the opening, you're releasing this today makes it so much easier to start it because you don't have to worry about any of the infrastructure. You just build the plugin and then to run everything and you get the best model possible. But I think, down the line, you know, I would love to walk around with my own, you know, raspberry pie or whatever of my wrist, kind of like on fallout and say, hey, I want to do this, I want to do that. I don't know.

I don't think we're that far away. So I'm excited to keep building. Shoot. The technology exists where you could make. that now, but it'd be a little awkward to have a raspberry pie on your rest of the moment. Well, that's kind of what I'm saying with the alpaca thing, right? It's like if you don't need internet access to use the model, I mean, we're still pretty far off. I don't know if Moore's Law even applies anymore, but, you know, we're not that far off from being able to

run this stuff on, you know, consumer hardware that's cheap. And that's going to be huge for, you know, the majority of the world, right? Like, that's going to be very big. Like, Even bigger than this, like, it's great that we can do it with the internet, but as soon as we don't need the internet to access it, like, it's over. We're back, whatever, whichever one you believe. It's just, it's just crazy to think about that. Yeah, you could, if that happens, you can go and hook it up to a coding compiler and have it sped out human readable errors.

But at that point, it's probably just going to be writing all the code for us anyways. So, you have a... Hey, guys. Hey, Alex. Go ahead. I have one more question, but yeah. Oh, go ahead. No, no, no, I have a write-in question from someone who's trying to join but was unable to,

Stefania, who I met, by the way, at the Langchane Hackedon, Langchain Meetup in San Francisco. She has a lot of cool insights to follow it. Go ahead, Alex. I'll cue the question up. Oh, yeah, for sure. One thing that really got my mind about this stuff and, you know, high-vision mode is the fact that you can kind of externalize memories now. So the main use case I was thinking about is you could basically sort of cron job.

for lack of a better word. So suppose you're, I don't know, building a trading bot, right? And you can say, hey, chat GPT, look at the price of wheat every day at midnight. And you can just cue that up in the background and then have that send the response back to the LLM at a certain time interval. And, you know, that's just like one use case. But here comes like the play where like there's time sensitive things that break the one-by-one synchronous nature of chat CPT and adds a little more, you can say, for one level, more humanness to it rather than like, direct response and reply latency. So there's that level, but also you can like schedule tasks.

And I think that's going to be the killer plugin, whoever creates like the Cal.com or the, you know, the Kron integrations for just like, hey, look at this point in time and they give me the response. I don't know if anybody's been thinking about that. Yeah, I was thinking about that a lot. Like how you said the expand, it's like an expandable, it's like a portable brain. Like it's like, hey, here's my secondary brain. And it does, it's like my secretary or it's like my assistant, right? Like somebody had a prompt where it was, you know, you're a form of, you know, one person's wisdom, one person's, you know, thinking about things X, X way, someone's thinking about it Y way. And, like, being able to have that just on demand with the, like, expandable component where you're able to basically, yeah, delegate tasks to it and be like, hey, you know, keep what's like the way to think about it? Like, not like a cron job.

Well, sort of like a cron job, but like, you know, like news alerts, like Google news alerts, like things like that. just being able to be like, hey, like, keep, keep an eye on this thread for me while I do other things. And then if something comes up, you know, whether, you know, you just do some NLP or whatever, search for keywords, you know, alert me or do whatever. And being able to do that without having to go through, you know, setting a reminder or doing all that painful, like pain in the ass calendar stuff because I think there's so many, there's so much software for that because people just hate doing it so much. Like, that's going to be so big.

Yeah, no, I was thinking that's probably a better way to put it, right? like asynchronous alerts, or I guess you could do timed alerts also, because the one thing I was thinking about is the Instacart API, which is what they're demo in. I don't know if anybody uses Instacart, but it's pretty slow on the lookups. So that's like, you know, that's a blocking process in the current integration of chat GPT. But if they could figure out a way to make it like asynchronous and then actually interact when it's done getting the fetch and then you can do stuff in between that, that's going to really change the interface. And that's like, that's really the step closer to having like a real personal assistant in your pocket.

Man, being able to just give Chet, BPT, all of your pieces that you cook that week and then just have it, order all the stuff from Instacart from you. I can't wait for that, man. Oh, my God. That's great. Oh, okay, okay. You know, you can ship a book like a cookbook with, like, actual recipes. But, yeah, yeah.

Let's introduce Logan. So does this be like physical companies that integrate with software are going to be coming like more of a mode as opposed to just software-specific companies? Every software is a software company, I know. Yeah, but if you're just a software company, Open AI or some one of these companies can just build that feature in now a lot easier than they could maybe in the past. Yes. For instance, you know, I don't know, like we were talking about travel and stuff like that, but let's say you have a physical, you know, product that maybe you can just separate. yourself from other products by building a better quality user experience.

So we got Logan here was our first podcast guest and the first Devrail person at Open AI, actually. So Logan, welcome. Obviously, a lot of people here are excited to talk about this. One thing I noticed from the plugins is that a lot of them are more mundane things. You know, you got travel, you got grocery. Can you tell us a bit more about how you picked those and maybe give us a sneak peek of other use cases that you're all excited? that about? Yeah, I think, first of all, I think going back to the conversation about the ability to, like,

queue up tasks for you in the background. My understanding is that Zapier actually already does this by default, and I'll go play around with it after this and see. But I think Zapier has the ability to schedule things. And I think this is the part that, yeah, people are sleeping on this the most, is that basically Zapier is already connected. Zappear's already connected to 5,000 different plugins, and now you can just integrate directly with all those through Zapier,

which is incredible. So you don't even need to wait for the plugin or whatever to come. Zapier will already do that for you, which is super cool. And it already has the ability. I'm 90% sure to like schedule certain actions to happen, which is awesome. So I think going back to the point of like how these folks were more specifically chosen,

I think the reality was when it was initially scoped out for doing this work. There was just we needed people who were willing to sort of deal with the idea of sort of we were still building this entire platform and infrastructure from the ground up. And I think those folks who were featured today during the blog post did a lot of work of iterating on these things with us as we figured out a lot of the challenges. So a huge shout out to all those, the engineering teams of those companies for working with us so closely to make it happen. I just got to say too. Shameless, shameless, I'm a shameless plug here.

It's my birthday day, and this is a super cool birthday gift. So thanks for doing this. And the blog post, it's really awesome. Happy birthday. Yeah. Thank you.

Thank you. I think we all just got a huge gift. Like, yeah, Logan, you don't have to speak on openly as we have here. Like, we're all just like,

you know, large model enjoyers here, I think. And this is a, this is an app store moments for, like, all of us. Like,

it's, I'm just processing this and just trying to do, therapy in public. There's a lot of weight list for them here, so we're all excited. Oh, yes. How do we have to do to get out of weight list?

Yes. I think the reality is, yeah, it's, they're rolling people out really slowly, and I think the intent is part of this is to understand, and I think it was one of the big highlights of the blog post, about what are the new sort of accesses for harm here? And I think we know some of those. things but there's a lot of known unknown so it'll be intentionally small for the time being but hopefully we'll we'll expand that access soon bottom line get on the wait list and and keep your

fingers crossed to come up like come up with a cool use case i think there's something there's part of the wait list is like submitting what you would be interested in working on and actually and they actually will we will actually read that to make sure that you know we're bringing people in who are going to build cool things not stuff that's uninteresting or potentially harmful Okay. Are you using TadGBT to analyze the weightless? Yeah, that was my question. It will probably be humans to analyze the weightless, would be my guess, but maybe, maybe not.

I'm not sure. Very old school. That's the difference. Old school. I like you. Yeah, yeah, yeah, yeah. We have a question from Wright-in who couldn't join for technical issues. Stefania, who is a researcher at Microsoft right now.

And her question is about search. What is the future of search for plugins? How do we discover new plugins? do we need a schema for plugins with complex queries or complex behaviors? And does it limit the context window as well? Like, do we install like 100 different plugins? And like, does that hurt, help? I don't know.

Yeah, it does. So there's a limited and it's all in the developer documentation right now if you want to read through it. But there's a bunch of limits on like your open API spec and the descriptions you use. But we actually take all that information. We take a sample request. We take a sample response. We take the description of it, and it's actually all inside of the context window to begin with.

So it is limited right now. And I think that's where some of those larger models like GPT4 with 32K context in the future, when that's the available, will be super helpful. And you'll be able to bring a lot of plugins in. But at the current moment, the more plugins you add, the less context you actually have in the conversation. Yeah, yeah, it makes sense. I mean, with like 50 pages worth of context, that that's, that's, a lot. And, you know, I was very impressed at the latency as well. At least the demo was able to pull off, which is awesome.

Yeah, any other, like, reactions, fast questions to the games? I have a couple of new people joining. Hey, Arjun. Yeah, I had a couple of them if I can chime in. First of all, I'm just blown away. I mean, it's a fairly interesting approach to deal with, like, live data versus data that you guys train on. A couple of quick questions for you.

How do you see this? Maybe it's too early to ask, but how do you see this padding out to something like a Bing chat. The reason why I ask this is I mean, currently Bing is more of the UI that you're dealing with and chat GPT has been launched on the side, but do you see it more

being like a platform or do you see it more consumer facing? I mean this question was to me or not. Yeah, you don't have to answer that. You know, obviously Logan cannot comment on Microsoft stuff. I do think though that the interesting differentiator is that

the work, and I think this was in their public blog post is that a lot of the stuff that Bing is doing is optimized for search specifically. So it's just a fundamentally different experience. I still think that like if you're, if you want like that search first experience, I think something like Bing makes a ton of sense. Yeah, it's just, it feels like a different experience to me. So I think it's been mentioned a few times that this is like the new AppStorm of AI. What I guess I'd like to hear thoughts of other people as well.

So the app store is monetized, right? So that's a big incentive for people to put their apps on there. So how does, in this case, you put a manifest and it hits the API for your app maybe? So what's the sort of the monetization strategy here? I mean, this is not a question for opening eyes. It's just like a general sort of direction for things. Yeah, I don't know if they care. This is like trivial to open air.

You're paying for the API, right? So you mean like on top of paying for API access? Yeah, you're using your credentials. You supply your credentials when you sign up to plug it, right? So I guess you do building off that form. Yeah, I guess so not from an Open AI point of view. So Open AI, of course, makes money and wins anyway. What I mean is like for an app developer to go on there.

So I guess you have an app outside of Open AI, which is useful. And this is kind of distribution for your app? Is that kind of the sale for the app store? I mean, we're three hours into it, so it's hard to say, definitely. But I think, but yeah, I mean, I'm just waiting for someone to write a mega threat on how to make money at the store here's seven ways. I'm sure, I'm sure there's going to be people on YouTube making videos with themselves

streaming and that's how they all saying I just figure out how to make a million. But yeah, one model we were talking about was maybe you can do a kind of like Spotify or like you have a chendipd subscription and then people each plugin gets royalty or a lot of things like Instagram like the chat GPP thing it's more like a UI alternative rather than like an app itself so it makes a lot of sense do I have things like that but yeah it would be interesting

I guess what I mean I think Dylan or somebody else said earlier that this might not be the app store might be like something different I think app store is like the closest we have to think about like that's the closest analogy but it might be just something completely new And that's very interesting. I think that's a pretty exciting place to be. Well, I don't know how much overlap with, like, the Web3 stuff, but it seems to me, I know there's like a couple projects out there that are,

I think there's one called BitTensor, where it's like people are, you know, basically selling their, you know, their GPU usage, right? Like, you know, there's tons of gamers out there that just have, their cards are just sitting idly by. And I don't know, it seems to me like a monetization model for OpenAIM might be to, you know, they own the model, right? So I don't know if they can, like, lease out the model. You could, like, write a smart contract that, like, uses their model somehow.

Or, I don't know, maybe plugins could be, like, written into a smart contract where it's, like, if you're using this plugin, like, I don't know how that would work specifically. But thinking ahead, like, I don't know, do you think it's going to just be centralized this whole time? Or, like, surely there's going to be a way for this to spread. And, you know, obviously, like, there's a, what's the word? It's kind of like you're trying to hold all this water back with like this one stone. And it's like eventually it's going to break. So like there's going to be some decentralization in this at some point. So I don't know if that makes sense.

I'm just trying to think about like how how there's a monetization, you know, pathway for this, for the, for the, for these plugins. Yeah. I think we're not going to get the answer today. Well, I think so like I'm convinced I have a way list. Okay, yes, let's here. It's Farmville. We're going to be Farmville on Chat, GPT.

Let's do it. Yeah, I was interested in, like, if there's already an API for this, or if there's, like, in a plant, so, like, when chat, it was just the web interface, and then we got the API later, or is this, like, a web-only thing?

There is an API available today, but you have to have access to actually create. plugins, so you won't have the interface to install a plugin or do anything like that. You can basically build all the stuff on the back end right now if you want to, and then when you get access, you'll be able to actually install the plugin through the chat, GBTUI, test it out and all that stuff. But as of the present moment, no one beyond a very small group of people are able to actually

install those developer unverified plugins. Yeah, I was, I don't know if that's what you meant, but I was thinking about, like, do we have a programmatic way of calling the chat GPT API with these plugins enabled and get like a JSON response back opposed to like using the weapon interface with the plugins enabled. Yeah. So that that doesn't exist yet today either. I think it's it's unclear when and if that will come but it's definitely something that folks are thinking about. I think there's just a little bit more a bunch more security and other challenges like that when you give the plugin access through the API. But it's it's definitely something in the team has talked and thought about internally.

All right. Thanks for the insight. Leo, follow our question. Did you have a specific use case in mind for that specific need that can help to motivate things sometimes? No, not right now. It's just the general question. Exploring.

Yeah, well, okay, you know, you can sort of hack it together with the stuff that died and grows just doing in the early days of chat TV. But I also like, I feel like we could make like a mock validator for bug games such that we were ready to go when it's live. I don't think it would be too hard. Yeah. funny clones out there for like chatypUI so you can sort of kind of hack it in maybe it's like not the highest fidelity but the scheme is out there so there's nothing really stopping us apart from you know waking up tomorrow and seeing that chat opening i've done it already so i think the only you could definitely do some of that today i think some part of the challenge will be that it's a different model that's powering some of these things which isn't available Yeah, I think that would be, but I still think even with probably base Sahara and just injecting some of this in there, you could probably get most of the way there.

Yeah, by the way, that there was a misconception that I had to correct a bit early on in the space before you came on. You dropped three models today? Like, there was a browsing model, and then there's a separate plugins model, and the plugins model doesn't talk to the browsing model. And then there's a, you know, there's Python running, which is still blowing my mind, by the way. Yeah, the Python running also goes back to the piece around if you want to basically, have things, like set things up to dispatch, you can essentially have it write the code and just like plug into any third party library and like set up cron jobs and all that stuff for you. So going back to sort of having chat chbtee do your bidding, you could you could do all that

with the code interpreter, which is super cool. And I think Greg tweeted like 20 minutes ago or an hour ago, something like that, an example of it. Yes. Like doing video compression and like editing and stuff like that, which was super cool. That is the one, like, are we going to have that, or is that Greg's special box? No, I think that he's just running straight up interpreter is my understanding. I don't think there's anything special going on there. Because, like, that is insane. Like, you have storage.

You have compute. You are a compute platform now. Like, chat GPD is not a chat. It's crazy. Like, this is what made me start this space because I was like, wait, like, this is not chat. This is a new thing. I don't know what this is. I have to drop, but this was awesome.

Thanks for hosting this, and thanks for having me on again. Thanks for you. Always appreciate you. Happy birthday, Dylan. Hopefully this was a worthwhile present. It was great. Thanks for coming on. Yeah, yeah, yeah, all right.

Bye, Logan. Okay, a couple more questions, if anyone has them. These things tend to drag on a little bit, so I always like to end on a well-defined note. Anyone else have reactions, questions? See anything out there that might be interesting? I did see, you know, the chatypc partners are starting to tweet out some stuff. So, Avnei Patel tweeted out about the Milo plugin that they developed with OpenEi. So we can see a little bit of that.

Particularly, I haven't specifically died in. But, yeah, you know, I'm collecting all sorts of information and reactions. I'm going to write out something today because I think this is one of the biggest days again in tech since, I don't know, Tuesday. Since last week. It's hard. But I mean, does anyone agree that things were like really boring for a while? And this is like the first exciting game that out. The React people are still talking about user effects.

Like fuck that. Yes, exactly. Like we were stuck in music effects and React and like CMS land for like 10 years. Thank God. Hey, Peter. Hey, thanks for having me on. I just wanted to say something real quick to the person that was asking earlier about a monetization models. and plugins and such.

And I just, I thought it, one thing that occurred to listening was that, you know, a lot of these, I've done a lot of these plug-in marketplaces over my career. And I think there's obviously an opportunity to like offer different levels of validation and sort of test compatibility kit, pass. And, you know, there's also an ongoing component of it because there's, you know, potentially data streaming through. And, you know, there's, you know, concerns around, you know, the quality of that data. Does it, you know, circumvent or interfere with open AI safety systems?

So, you know, one obvious. way that they could potentially monetize, you know, any marketplace, really, you know, app store or whatever JetBrains, you know, IntelliDia marketplace, right, is to have that concept of different levels of validation and compliance, you know, to a certain specification. And, you know, you get a little logo or something like that. And, you know, so anyway, just a quick thought as I was listening, fascinating and thanks for having me on. Peter, since I want you to, since you have a bunch of experience, could you list, like,

the, the, the, the, the, the marketplaces that you've been a part of and, like, maybe, like, one thing they did well. I think they did for you. I'd love to get a top-down view. Sure, yeah. I don't know that I've seen all of them, but I mean, you know, obviously I'm an iPhone and Android users. I've seen the marketplace like the rest of us, but JetBrains marketplace I think was particularly good. Postman has a really good API marketplace. Rapid AP. Yeah. You know, I think a lot of platform companies have gotten the message and they think about marketplaces. Obviously, duh, the hyperscalers, right? You know, you've got the, you know, the cloud marketplaces from Amazon and Google and Azure and such.

But sometimes it's these smaller ones that are also surprisingly good. Like the Intelligy idea, you know, you go to their website and it's like you can buy an ad banner if you're in marketing. But, you know, yeah, anyway. So this concept of like validated plugins, right, especially when there's this aspect of the data that's flowing through them, I think presents an interesting opportunity. Not only for developers to make non-shitty plugins, pardon my friend, for, you know, for Open AI to, you know, say, hey, we looked at this and not just with chat GPT, no offense. We're giving it a seal of approval, right?

And that'll carry weight and carry meeting and people will pay for that, is my guess. Yeah, yeah, yeah, yeah, awesome. Well, I think there's an appetite for understanding how to do well in the marketplace right now. If you write a post about that, that you'll be very well received. Sweet. Cool.

I'll try to find you on Twitter. I just kind of dropped in. This was sort of an instinct. And then I saw Nader's here and all these other people are here. So it was just kind of like, wow, this is awesome. I know. Oh, no.

I know. I know. Well, we're all just, like, reacting. And we need a, we need a space to yell because this is cute. So, thanks, Peter. No problem. And, yeah, let's disconnect offline. Flo is here.

I'm trying to invite you, Flood, because we were talking about Lindy earlier. We were talking about what this is what Chatsy Kuggan means for Lindy. I don't think it will, I think actually, like, it will help highlight the differences. But, oh, there's a speaker. Hey, congrats on your launch, by the way. Very, very, very, very well done. Thanks. Yeah.

one hell of a day Hi everyone hell of a day Did you know this was coming by the way We didn't know it was coming today But yes we knew we knew about this And we knew it would come in the very near future Yeah

So I'll readjut it's like The space is like 4X since the time I talked about But you know AI virtual assistant is able to arbitrarily Respond to emails and step meetings And use national language to do all of that I think the user interface also was very very well designed Thank you

Which I can't imagine how long you'd have to do that. But that is the polish that you need for personal use stuff. Right. This is the table six. Thank you. I'll pass your compliments to the designers who hate me now. It did take a long time to reach this point. I mean, my take is that I think like the baton is being passed from the folks,

like the lab coat researchers working on the models. They're passing the baton over to like the product teams, basically. And I think we're going to see a new wave of that are not just about, hey, we have a model that is X billion parameters, but we're going to see a new wave of startups that are in the business of building great products around these models. And with a very simple interface, which is, well, sorry, sorry, yeah. Well, I was talking about plugins, but you're talking about over the foundation model APIs. That's correct. Yeah.

Yeah. So, I mean, are you worried about competition from, like, you know, chaty-tacety? Like, let's talk this out, right? Like, what do you see sort of the product gaps that plugins do? versus your stuff. Yeah, my understanding is that chatypT is really, like chatypt plugins, my understanding so far from the announcement, is like it's really more of like a developer product.

So opening eye is remaining true to their DNA of like, you know, we're building models and more building stuff for developers to build products on. So the impact on companies like Lindy is that it's lowering the barrier to entry, which I think you're not targeting developers. Yeah. Well, it's not just, it's like it's become easier to build. like a whole lot of stuff that we built like, oh, very I just released for free and we're like, well, fact, like, I guess we built that.

So it's lowering the barrier to entry, but you know, you're still left with your product expertise. Yeah, yeah, that's true. That's true. Yeah, and also commenting before you came on that opening I probably will never have Google calendar on their list of

preferred, you know, plugins. They'll never have Gmail on. And your integration is already super tight. Like this plugs in exactly to where, what people will use today instead of having different between Microsoft and Google. Yes, I wouldn't say never. I think the AOLVEN has, but certainly the incentives are not secure aligned. And so I think there is going to be merit in being Switzerland here,

right? It's like, look, our incentives are aligned with you as the user. Like, we'll not embed with Microsoft or Google or whatever. We're not protecting an existing ecosystem. We'll just like send AI assistant. And we are going to play as well as we can with all of your product. Yeah, yeah. Does anyone have, like, I'll open out, you know, Obviously, we have the founder of Lindy here.

Does anyone have questions about Lindy? Did you see the launch? Did you have a follow-up? This is a very nice place to ask it. Alessia, you want to start? I just want to get access. I'm going to pay. You just want to get access?

I already think it yesterday. It would be cool for you to maybe talk a lot about how the integrations work, and I know you're using natural language for it. I think when tools like it, they think, oh, is my tool going to be supportive? So, yeah, there you want to talk about it. Yeah, definitely. And so I actually tweeted about that separately.

Like the way we build integration is we literally just give the documentation of the API to Lindy and then she figures out how to use the APIs on her own. And so it's trivial for us to build a new integration. Like it actually takes 15 minutes to build a new integration. And so the answer to will my product, like will my be supported will be yes, like in 15 minutes. Like it'll be like, hey, you asked us to do something. And literally it's like we couldn't do it yesterday and today we can. And it's going to be as simple as that.

So, yeah. Yeah, I think to me the most interesting thing is that a lot of companies, I mean, even if you think about AirBide and like 5Tran, like when it comes to connectors, there was like the whole close source versus open source. Like the open source usually at an advantage because the community can help you build more connectors. But now using natural language, like the barrier is so much lower. It's just super exciting to people to use everything right away

instead of waiting like four months because I'm the only person using the, I want tool, so excited to be. Yeah, 100%. Well, even considering a world in which the user creates the own integration by themselves in like 10 minutes, it's like, hey, like give us, really the only thing we need is like we need a documentation and then we need like an API token. Like that's the only part that right now requires like an engineer's involvement. But, you know, perhaps some power users would be fine generating some developer API token

and building their own integration in like 10 minutes. I mean, the sort of app store model between Google and Apple, and it's like the bar for quality that they held. You know what I mean? I don't know. It makes me think of that whole race again. It's like, do you lower the bar for quality and go the Android route? Or do you keep the bar high?

And especially if there's issues with circumventing or interfering with safety systems and data quality and things that are quote-unquote inappropriate. Like, I don't know. I wonder. It makes me think. Well, the thing is that there is a ceiling to quality here when it comes to these integrations.

like how good can you make a Gmail integration? There's like 20 endpoints or something. And then the question is like, can you call these endpoints and can you support their parameters? And it's not even the user who would actually like write the endpoint and the parameters. They would literally just like point us to the right API documentation. Good point. I do think it's a little scary when I give my, you know,

if I give like my Gmail integration and then you have right access. Like actually just open sourced a GPD4 like email director. And I didn't put any autofsand or anything like that. because I was so scared of it. But I wrote all the code. So I trust it. But it'll be interesting to see how people are going to trust these systems. Yeah.

So we've built some like hard guardrails in place where certain actions, especially any end point that is a post endpoint. We flag these actions as like we call them like a right action. So it's like read action versus right actions. And if it's a right action, we require user confirmation in a way that, I mean, this is like technical details. But like it is physically impossible for the model to actually take a right. right action without user confirmation.

So the user, it asks for user confirmation, and like, the user through the confirmation actually issues a token that is required for the model to be able to call that, that thing. How worried about you about AI safety? Is this, like, coming from a place of UX or AI safety? I'm super worried about very long-term AI safety, right? Yeah, I am moderately worried about, like, medium-film AI safety, like, the whole, like, misinformation thing, and, like, yeah, like, I'm sure there are all ways in which Lindy may go wrong, but that's not

the top of my concerns. And especially because I've built this kind of system, like, I see the ways in which you can build garg rails. And this is just like an engineering challenge. Like, it's very soluble. Now, the very long term, AI safety thing, like, yeah, I mean, there's like an existential risk, and this is a whole different beast. Yeah, part of me, like trying to build B2B

stuff, you know, in the face of AI safety issues, it feels like, you know, you're just kind of rearranging textures on the Titanic or, like, you know, you have a four-piece string quartet playing music to entertain people while the strip of thinking. Yeah. Yeah, it is a discouraging a little bit because you don't really have a take on the problem, do you?

Right? They're like, all right, I guess this is coming, and I'm, like, I'm pressing my head, and I'm like, I don't really see what I can do about it. Sam Altman seems to think he can turn it off. Like, he has his blue bag, which presumably has the off the off button. That's why he always has it with him. Yeah, I don't know. Yeah, yeah.

So can I, well, can I get your reactions just generally on, like, potential of, like, maybe multimobal Gip4, like, just anything that your, you know, U.S. builder are looking to really take advantage of as it comes down the way. Yeah, I think multidality and, you know, audio and image, especially, I think, is, like, the next big zero-to-one thing. But otherwise, I think, like, just language gets you so far, man. So I was just having this conversation. To me, it's the same thing as, like, the CPU, right? where it's like Phil Child Semiconductor and like Intel, like they give us the CPU. And I think, again, like the LabCote researchers passed the button to the hackers in their garage, like the Steve Jobs and Steve Bosnack, who now owns the business of building the PC.

And so that doesn't mean that innovation in the CPU is over. Like the CPU still has like four decades of Moore's Law ahead of it. But yeah, like we've got the CPU and now I think that product and engineering and hacker teams have to take it from there. I mean, Intel will be pretty well. Totally. I'm not saying like open AI is going anywhere, for sure. Cool, cool. Any other, yeah, does anyone else have questions? Novia? I see you unmuted. Yeah, just upon the safety, AI safety side. I mean, as much as I hate the complexity of I am, I mean, like, permissions in AWS and GCP and so on, the server purpose. And I think like maybe in this space, like, if you can hit any endpoint on the internet, like, how do you control which endpoint?

So maybe this is like connection for flow, like when you generate. of IAM, which is, you know, you have a proxy sitting in front of the internet, and you're only allowed to see certain parts of the internet. You said you have, like, you have, like, write access on the post request already. But, yeah, maybe there's something around that. Yeah. So we're looking into this kind of catch guardrails. Right now, the way I'll must, for example, the Gmail API is, so it actually writes code, but at no point does it choose a library to make rest API and point goals, right? Like, it actually, we give it a function that's like, Gmail send email with like parameters for like two and subject and buddy and all of that stuff right

and certain of these actions again require an authorization token that is specific for like that one action and these authorization tokens actually expire so yes in theory the model could circumnavigate that by writing code to like call the API endpoint directly we've not seen it do that yet and and that's just not the way we trains the model to behave that's pretty good that's like a general platform question for maybe you in the future, maybe Open AI, that if you hook it up to the... How do you prevent it from... I'm not saying that the AI will do something delicious,

but like a developer who gets it to write some code and hit an endpoint that you didn't give it permission for. So, for example, you can... Indino, I love the permission system in Dino, you can give it access to your file system or the N or, you know, like the internet. But like, how do you specify only a part of the internet or only a part of a domain or so on?

Yeah, so like Open question. By the way, I'm a little... little bit bearish on the Dino permissioning because it's permissioning on the whole executable and and that's you know it's basically you're going to try to relax it the moment you run to errors and people just kind of relax it all the way you know it's kind of true I agree I was actually the way I got around it I was starting a new new process sub process and only giving it access to instead of making yeah it was it was really hard really annoying well done they should build that it was the only yeah exactly yeah it's kind of over

selling the security if like everybody just runs like you know pseudo whatever the equivalent of pseudo even in dino but yeah okay cool any other reactions flow before i'll give you the last word here just reactions to chat tpt and opening i shipping velocity in general you're always a good speaker so leaving to you for soundbites soundbites no it's great you know i i'm excited to see this kind of product see the light and i i don't view them as like direct competitors just yet and even if they were you know look i think the market this is going to be the model of all markets so i think it's going to be it's going to be more than fine. Maybe room full

and mini-ween here. Blue Ocean. That's right. Time to build. Let's go. Yeah, that's great. What do you think, what do you think?

I don't know what I think. This is why I started this space because I saw that Chargbt can run FFM peg, which means it is a compute platform, right? It generates Python code. It runs the Python code.

It can receive files. It can store files. It has a memory. And then it can let you download the files. Give it some GPUs, and you can run Lama inside of chat GPS for whatever reason you want.

It is a new compute platform now and I want to build for it but I don't know what I can build. Yeah, I agree. I think these large network models are like the next operating system. I'm very convinced

that that's the way people are going to interact with their computers. Like you're no longer going to do work at your computer. You're going to have a conversation with your computer and the computer is going to do work for you. Well, you're certainly building the platform for that.

So everyone go check out Lindy. I think this is a great conversation. I always want spaces to end on the high note. But thanks for joining you. I know it's like zero notice. I'll just DM in you. But thanks for coming on there. Yeah.

Thanks, everyone. Yeah, yeah. Go out there and build. Bye. Bye. Bye, guys. Thanks.