This Week in Startups - AI Demos: Meta AI Ups it’s Game with Llama 3 | E1935

Episode Date: April 20, 2024

This Week in Startups is brought to you by… OpenPhone. Create business phone numbers for you and your team that work through an app on your smartphone or desktop. TWiST listeners can get an extra 20% off any plan for your first 6 months at http://www.openphone.com/twist Eppo. Experimentation is how generation-defining companies win. Accelerate your experimentation velocity with Eppo. Visit  https://www.geteppo.com/twist HiddenLayer. Generative AI is revolutionizing industries. HiddenLayer’s AI Detection & Response Solution secures your Generative AI & LLMs from malicious attack.  Helping you generate more – by enabling seamless & secure Generative AI. Visit https://www.HiddenLayer.com/TWiST to learn more. * Timestamps: (0:00) Sunny joins Jason to dive into this week's AI news and demos. (1:39) AI, LLMs, and Groq infrastructure discussion. (9:32) OpenPhone - Get 20% off your first six months at http://www.openphone.com/twist (11:00 ) Meta's AI landing page, new search engine, and investment strategies (20:06 ) Eppo. Accelerate your experimentation velocity with Eppo. Visit  https://www.geteppo.com/twist (23:19) Zuckerberg's approach towards Google's dominance and the impact of Meta's search engine (30:19) HiddenLayer. HiddenLayer’s AI Detection & Response Solution secures your Generative AI & LLMs from malicious attack. Visit https://www.HiddenLayer.com/TWiST to learn more. (32:11) Importance of a dedicated domain name and Google's commitment to Google Plus (34:36) Meta's progress in AI and the strategy of open sourcing (45:34) The industrial revolution in technology, AI development, and rights issues * Check out Meta AI: https://www.meta.ai/ Check out Groq: https://groq.com/ * Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp * Follow Sunny: X: ⁠https://twitter.com/sundeep⁠ LinkedIn: ⁠https://www.linkedin.com/in/sundeepm * Follow Jason: X: https://twitter.com/Jason LinkedIn: https://www.linkedin.com/in/jasoncalacanis * Thank you to our partners: (9:32) OpenPhone - Get 20% off your first six months at http://www.openphone.com/twist (20:06 ) Eppo. Accelerate your experimentation velocity with Eppo. Visit  https://www.geteppo.com/twist (30:19) HiddenLayer. HiddenLayer’s AI Detection & Response Solution secures your Generative AI & LLMs from malicious attack. Visit https://www.HiddenLayer.com/TWiST to learn more. * Great 2023 interviews: Steve Huffman, Brian Chesky, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland * Check out Jason’s suite of newsletters: https://substack.com/@calacanis * Follow TWiST: Substack: https://twistartups.substack.com Twitter: https://twitter.com/TWiStartups YouTube: https://www.youtube.com/thisweekin Instagram: https://www.instagram.com/thisweekinstartups TikTok: https://www.tiktok.com/@thisweekinstartups * Subscribe to the Founder University Podcast: https://www.founder.university/podcast

Two years ago, they weren't in the race. They weren't even in the stands. They weren't paying attention to this. They were changing the name of the company to meta because of the metaverse. Now meta means search engine for AI. He literally took the brand meta and just like, you know what? Meta. It's meta AI.

I meant it all along. Like literally, he guy fell on his face, got barbecued by everybody. Everybody said he's distracted and he's like got this stupid idea with the metaverse that nobody cares about. And he just turns this entire. judo move. This is a judo move. He redirected the energy and I think the MMA stuff got him reinvigorated as an entrepreneur. He just took the battleship and turned it around. Congratulations to the team over there because- You cannot fuck around with a guy that was a chain on the outside

of his shirt. I'm going to tell you this could be the most important news story of the year. This week in startups is brought to you by Open Phone. Create business phone numbers for you and your team that work through an app on your smartphone or desktop. Twist listeners can get an extra 20% off any plan for your first six months at openphone.com slash twist. Epo. Experimentation is how generation-defining companies win. Accelerate your experimentation velocity with Epo. Visit getepo.com slash twist.

And Hidden Layer. Generative AI is revolutionizing industries. Hidden Lears AI detection and response solution secures your generative AI and LLMs from malicious attack, helping you generate more by enabling seamless and secure generative AI. Visit hidden layer.com slash twist to learn more. All right, everybody, welcome back to this weekend startups and with me after pulling an all-nighter, my guy, Sunny, Sandeep Madra, how are you doing, brother? Big day.

Big day. There's a lot to talk about. Lots to talk about. AI never sleeps. Just like you, Sunny, now that you are trying to. get all of these new LLMs up and running on the GROC infrastructure. Everybody knows definitive intelligence. Your company was bought by GROC.

And now you are working with developers. And big news dropped this week from Facebook. Their open source model, which is called Lama, released version 3. Explain to people why this is important and what it is. The best way to explain its importance, I'm going to pull up a chart from the, and you know, we've used this before, is that it is a new model

they trained, they open sourced it, but as people got their hands on it over the last 24 hours, that this open source model, 70 billion parameters, it's almost

as good, just a little bit behind GPT4, but better than Claude 3, which was at the top, better than Gemini Pro, better than Claude Sonnet, better than CommandR, better than the original GPT4. Wow. So here we go.

The race is on. Yes. This is big news, big news. An open source model has arrived that's in essentially the top two models in the world. And it's more than an order of magnitude smaller. So not only has... Explain smaller in this context, right? A lot of folks are new to AI.

Yeah, for sure. We're talking about parameters. We're talking about the versions of these models. We're talking about the context window. Let's do the audience of favor and just explain these from first principles. When you say size, do you mean the size of the software, the size of the package of the model? What does size mean in this context? So I'm going to use an analogy that I think makes it simpler for folks to understand,

and then we can double click if you need to. The way to think about number of parameters is neurons. Okay. And the way to think about neurons is like in, you know, animals. The more neurons, the smarter the animal. Got it. Like an octopus or a human or a dolphin or a whale. All those delicious sentient creatures that we eat. That's a shout out to this week's all in which you haven't seen yet. But we had a little bit of a little bit of a touchy moment on our shared love of octopus, which I have a lot of neurons. Okay. So. Neurons. When we say neurons, parameters and neurons, got it. And the more parameters we have, the more neurons the model has, the smarter it can theoretically be.

Got it. And so the general thinking has been, we're going to create bigger and bigger models by bigger being more and more parameters. And the more parameters you have, the more training data you have to give it. And it's usually like several orders of magnitude to me, but let's just say one for simplicity.

So if you have a one billion parameter model, you need to kind of give it 10 billion pieces of data, right? So if you have a trillion parameter model, you have to give it 10 trillion and et cetera, et cetera. What Facebook did, meta did, they really change things up. So one of their, one of their, you know, I guess, motes is, they have a lot of data.

They have all the world's data. They took a smaller model and kept giving it more and more and more data and what they've been able to show. And what's really interesting is, Zuck in an interview yesterday said, they stopped training this model. It was still getting better and better.

They needed to reallocate the GPUs to train Lama 4. So they're like, we were blown away and it was getting better and better and better. So it's the same model architecture, just given more and more data.

And the data they have. Yeah, where do they get their data from? Have they been clear about this? Because it's an open source model. Yes. That means the code to build the software is open source. You can go see that code. But open source data is different.

So tell us what can we understand about the data in the model, if at all anything. That's not as clear. right? But, you know, if you watch the interviews, one of the things that he said is they trained it with a lot more code. And look, one of the things that they have, they have a lot of code. They've been running one of the world's largest services or several of the world's largest services for years. They have tons of code. And so they have every right to take that code and feed it in the news. If they want to, right? They may have rights on, you know, I don't really know what Facebook's rights are on your eyes data, but. I'm sure somewhere along. I think they can use your data to train their model. Yes. Yeah.

You can be certain their terms of service has that basic right. Yeah, or they changed it recently or, you know, within the last couple years to do it. So, um, you had to spend all night getting this up and running on the garage all day. Yeah. Yeah. So this drops onto GitHub or hugging face. And then just, you know, explain to the world here listening how that winds up being deployed on the GROC infrastructure.

Yeah, so for us, like, so these models are trained on Nvidia hardware. And when you're training a model, you're doing, and I'm going to do an oversimplification, you're doing a forward pass, which is like running the model, and then you're doing like a back propagation. And so you're, in training them,

you're running the models all the time. So once the model is done, you can run it on Nvidia hardware, and so others can get it up and running. We obviously have our own custom hardware. So we have to take that model, and we run it through, you know, part of our secret sauce,

is our compiler, and we run it through that compiler, and then that compiler takes that model and basically runs it on the configuration of chips that we've given it. So there's two models that we're running in the last 24 hours. One is the smaller one, which is Lama 3,8 billion. What's interesting is Lama 3,8 billion has the performance of Lama 270 billion. So it's got 10 times less parameters, but has the same performance as one before. Fascinating. And then they release that. Why is that? Why is that? Well, I think it comes back to, and look, everyone is being blown away by this, right? That's, you know, I was showing some tweets and I'll pull those back up in a second here. What everyone is realizing here is that maybe you can take, you know, this sort of makes sense in biology. All of us humans have about the same number of neurons, right? You know, I don't think there's like a 50% difference, right? Right. If you give one human a lot more data, their output, capability can be a lot more than another one. Okay.

So I think what we're learning here is that if you give more and more data to even a smaller model, the results that it can produce in these benchmarks are incredible. And I think that's the path. And, you know, Facebook, again, who's a lot different than any of the other companies because the core of their business has access to a huge amount of data is proving that they can build world-class models without even making them. You know, GPT4 is generally considered to be a 1.7 trillion parameter model. So if you think about that, that's more than 20 times larger than Lama 370B.

Juggling multiple devices and apps to run your business is a mess. Open Phone is here to make it simple. By simplifying your business communications with one easy-to-use app. Open Phone has rethought every detail of what a modern business phone should be. And here is the magic. It works through a beautiful, elegant app on your phone or you can just use it on your desktop, making it super easy to get a business phone number for your entire team. And you know how brilliant open phone is?

My teams use it every single day. My sales team loves it. My ops team, they use it all day long. And here's the features that we love. You can create a shared phone number like customer support with multiple employees fielding all the calls and all the text to that one number. At my investment firm launch, we pride ourselves on replying to every single call. or email instantly. And OpenFone is the number one rated business phone on G2 for customer satisfaction. So here's your call to action, super easy. Open phone is already affordable. Starts at just

13 bucks a month, but Twist listeners get an extra 20% off any plan for the first six months at openphone.com slash twist. And if you have existing numbers with other services, no problem. Open phone's going to port them over easy, peasy, lemon squeasy, no extra cost. Head over to openphone.com slash twist to start your free trial and get 20% off. Okay. So you've got the model up and running, and I was looking at an interface. It looks like meta is trying to... Let's pull that up.

Yeah, I think this is kind of important. If you go to meta.a.ai... Yeah, I got it queued up here for us. Okay, great. Because this is... I started playing with this myself today in between meetings. Oh, you did? Okay. So this is there...

Just on a very cursory basis, and I just want to make one observation. when you pull up the meta-a-I landing page, it has a very unique style to it. It's a fun style with a number of different ways to ask questions, but you don't have to log in. So I just want to pause on that. Because not having to log in, there's another website where there's a search box

and you can type something in. That one doesn't require it either. So you can continue without logging in, And it just asked you what age you are, because I think they've gotten a little trouble with age gating or whatever. And so they're being trying to be thoughtful of that. You remember when Suck was pulled in front of Congress or the Senate or somebody to discuss these kind of issues. But I tried asking it, who is Jason Callicanus? And it did a wonderful job of like pulling from my Wikipedia page or whatever, a really tight summary. And it did seem to me like they've built an interface that looks very reminiscent of the Google original search. page. I hadn't thought about it through that lens, because when I see all these chat bots, they all kind of are starting to merge for me. But like, now that you're bringing it up, it does have those vibes of like sort of an early Google, very clean look, search page. Yes. And you know, now we all use browsers, so I never even hit Google. We always just search

out of our, um, exactly. The URL. And they told, uh, I saw Zuck in some clip of the interview he gave, uh, with his new haircut. Yeah. People were mentioning the new haircut, I guess. I guess he's He's got a new stylist or something, so somehow that. His new look and his approach is interesting that people are noting, but he said they're going to put this search box on the top of every app they own. Yes. Okay, I want to pause for a second there. This is a shot across the bow of Google, and there's two reasons.

The first reason is that they are both a place where people start their, you know, journey on the internet, right? you're on your phone, you're open your browser right now, there's probably a tab open to, or an app open that's run by these two companies, whether it's YouTube, Google, Gmail, Facebook, Instagram, or WhatsApp. So they all, in other words, have massive distribution to billions of users. But there's never been a search engine to speak of, or a search function. of the open web

in any of these products by meta. And now there is. And they're going to super distribute it. So if they can cut, if they can get one, two, three, four percent of searches away from Google, part two is they have an ad network already. They already have advertisers.

And the advantage that Google has always had is that in the box you type your intent, looking for a sushi restaurant, flying to Sydney. I'm going looking for a hotel in Dubai. There's a lot of purchase intent, right, in a search. Yeah. Oh, yeah.

It's a window into the user's mind. Exactly. At that moment in time. And you can connect it with an advertiser. Facebook has had to connect based on psychographics. You're a 53-year-old living in the Bay Area. You're married. You have three kids.

You like to go skiing. Your friends share pictures of you skiing. You also go to Mexico quite often. And we see a lot of sushi. and, you know, oh, you, you seem to be, you know, commenting on photos and following accounts in Dubai. We have some psychographic on you to give you ads. Well, now meta's going to have both. Direct intent and psychographics.

This is going to create the greatest threat to Google advertising competence that's ever been created. And this is going to make meta stock and revenue go wild. Ooh. is the J trade is the J trade is on is on but is it are you going to

lever the J trade are you going to spreading I'm going to spread the trade am I going to short Google the wrong meta well no you can deliver it

just by getting into call options because that gives you some levers I mean listen it's Friday night when we're taping this where you know the market is closed

so we can discuss this we got a little window you know before this drops but I think I might go into my Robin Hood account and I might J trade

I might sell half my positions and put it into meta. And now, listen, I bought meta at $90. I don't know what's trading at now. $400. 500. It is trading $480. Okay. I've already run this bad boy up 5x. Okay. I'm 5x. And I'm thinking that this could, you know, be explosive. And the fact that Zuckerberg is talking about this in a direct video is extraordinary. It reminds me of the impact YouTube had on Google. Google had, you know, a certain type of advertiser, you know, a direct marketing type advertiser, right? You're kind of get like this little, I refer to it as the sniper shot.

Okay. You weren't getting, you know, like an emotional advertiser, psychographic advertiser. You weren't going after moms or dads or teens or single people versus married people. You get the idea. When YouTube came along, now you started having the ability to show people video ads, which evoke emotion. It's like a whole different group of advertisers. And you combine those two things, you know, you see ads. Was it net new or was it a shift? Did like people move budgets or did the budgets just increase? This gave them access to a budget that they didn't have access to,

which is some advertisers want to visually show their product. And so you take a car company, how many times have you seen car ads on YouTube all the time? How many times do you see a movie trailer or a TV? show ad all the time. Why? Because, you know, if you show a car, a Volvo, you know, a Toyota, zip, zip, zipping along, you might buy it. And if you see, you know, Volvo is an interesting car in a search ad, you're not going to, it's not going to evoke any emotion, right? So you have this emotional connection, this visceral connection that comes from video. That really, really, I believe, was a key moment in the history of Google in terms of making a really great ad platform. So you had people who were marketers who now were able to spend two different ways.

That's what's going to happen here. That's what's going to happen here with Facebook, you know? You're seeing it. You've seen this movie. I've seen this movie before, and I think this is going to be explosive. I don't think necessarily Google's the loser here. I think anybody else with advertising revenue in the world, newspapers, televisions, you know, magazines, content websites.

I mean, I just think it's going to make them even more dominant. Correct me if I'm wrong, but it always feels like that from the earliest days, Facebook has sort of had the best relationship with their advertisers. And they've done pretty well. Yeah, both of them, Google was, Google had a very hands-off approach. They didn't, they weren't really talk to you that much, but YouTube did. So, you know, those people who like to do video ads, that's like, let's go get a, you know, that's a madman, you know, let's get a three martini lunch.

let's go to Cann, you know, that whole group. And so, you know, I think you're right. Facebook did have like a little bit more of that shake hands and, you know, go out for dinner kind of approach. And this is going to just get them the direct response people in a really amazing way. Yeah. Wow. This is a game changer.

The J-trade is on. I think I might just go in there and just literally sell everything I own in the J-Trade portfolio and just put it into. you know, uh, meta and Google. I'm doing these searches in real time while we're having a conversation.

And let me just share my screen here because you've been to Dubai, yeah? Yep. Yeah. So I mean, going in the next couple weeks again. Oh,

okay. Well, maybe I have to jump on a plane with you because, you know, I love that. Here we go. Oh, yeah.

I can jump on the GROC, uh, Gulfstream. No, no, no Gron Gulfstream yet. Oh, my God. Oh,

that would be so yummy, yummy. Ooh, who, okay, so look here. Forcy, here we go.

Here are some of the best hotels in Dubai. Four Seasons Resort, Dubai at Jumara Beach. We know that one. The Palm, the Ritz, one, and only one, Palm, we know that, Bulgaria. I mean, these are the best. And, you know, it gives citations. And, you know, if you click on those citations, one and two, it's dumping you to a Google search. Oh, wow.

I wonder if they're getting paid like the... The Apple arrangement, isn't that interesting? Are you tired of slow A-B testing? I'm sure you are. Do you have any trouble trusting your experiment results? I know I do sometimes. We'll get ready to 10x your experiment velocity with Epo. That's EPP.

Whether you're a scrappy startup, a tech giant, or anybody in between, their feature management platform will turn your risky launches into clear-cut experiments. Data teams, of course, love Epo. And so will your product growth and machine learning teams? The executives are going to love it too because they're going to love the results and the discipline that comes from defining really important product experiments and then executing on them really well because it gives data teams better coordination and faster innovation. Online marketplace Inventa has cut down experiment time by 60%. And click up, the project management company has cut down analyst time by over 12 hours. And Epo's cloud-based system is all about empowerment.

You get instant access to your experiments from anywhere in the world, boosting flexibility and teamwork. you get a system that grows with your needs, easily scaling up to handle more tests as your business grows. With Epo, the daunting becomes doable. I love that. So your team can rely on the experiment results and make faster decisions. Here's your call to action. Experimentation is how generation-defining companies win.

Accelerate your experimentation velocity with Epo. Visit getepo.com slash twist. Just visit get EPPO.com slash twist. And let's get some experiments running. Let's get that product market fit. And thanks to Epo for supporting. media like this week in startups and all the startups who are listening well done. You look at my screen here. Look at this. When I hit sources, it's another Google one and it says

the luxury, the two web pages where it took this information from. So that web page now at Forbes is going to get some traffic. So, okay, this is interesting. Why is there a Google search down here? Does anybody know what's going on here? Is there a Google relationship we're unaware of? These are dogged competitors. So why would they link to a Google search down here? Does anybody know what's going on here? Is there a Google relationship we're unaware of? These are dogged competitors. So why would they link to a Google search or are they using the results of the Google search to get this information? And then number two, when you click view sources and it just has these links here, it puts the Google logo next to them. Why? So I can speculate. So basically, you know, all these modern answer engines that are being built, and, you know, we did a demo before

as well, these modern answer engines, right, are using, they need search results. and there's different services that have been created to do that. And so what has maybe happened here, obviously meta is not going to just go use one of those services. They're not going to scrape Google. So they maybe just went and did a direct deal. Because what these engines need is the results to come back. And then the engines use their own reasoning capability to like, you know,

read the results and then parse things out and then return it to you. That's a good answer, though. Kakari is incredible. Look at this. So this is a, search engine journal, which is actually you know, a thing,

you quite reliable exactly for this particular thing and say meta integrates Google and Bing search results into the assistant. And so that's what they're saying. Both are coming in and they're talking about that. And they're talking about the Zuck interview

where he brought this up. And so really interesting now. And here's the examples of bringing meta into all the applications. Amazing. Wow. And so this is going to just change everything. You know, Zuckerberg is now coming in and he's looking to steal Google's cheese.

I got to tell you. And I feel like you have one of these and you definitely had one back in the day. When you break that chain out. Yeah, that means you're going gangster. This is, I mean, Zach is going into his, you're talking to me phase. You talking to me? I don't see anybody else here, so I think you must be talking to me. Zuck's hair is out of control. control. Yep. There's no gel. Or maybe he's putting clay in it.

I don't know what's going on. But the hair's on fleek. He's wearing a gold chain around his neck. I think he's hanging out with these UFC guys. Yeah. His testosterone has got to be off the charts. Maybe he's doing human growth hormone. I don't know what's going on here.

But this is a level of aggressiveness that is even like for Zuck a little bit out there. But this is a big deal, folks. This is like a weird, you know, weekend. Thursday, Friday, drop. And if you're at Google right now, if I'm Sergey, if I'm Larry, if I'm Sundar, this is another war room moment.

Now you've got Microsoft on one side with Bing and you got Facebook on the other side. And they're both looking at that search money printing machine. And they're saying, yum, yum, is there a chance to steal it. I saw this and I had to bring it up. Okay. I think it's like, it was good.

It was good. This is the three phases of Zuck. Obviously early Zuck. This might have been like a CNN interview when he was probably, you know, just started. He just made it to San Francisco. He just left Harvard. This wasn't that long ago. This is the in front of Congress. Yeah, well, he's been pulled up in front of Congress for the last five years. So who knows which one that was. Is that the most recent one? The most recent one. Yeah, he's got that. Yeah. Obviously, someone did a little bit of touch up here and gave him.

I think they gave him a goatee there. I don't think he's rocking up here. No, he wasn't. No, no, he wasn't. But like, everything else is pretty good. But this is pretty awesome. It's pretty awesome. Because what they're saying is this is this famous bell curve chart. So you have like the elite person all the way on the right of the bell curve. You got the average midperson. And then the left, you got like the more raw person. So usually the way this is presented is like there's a ninja hacker all over on the right. There's like a low IQ. I don't want to say the term, but like mentally disabled person on the left. And in the middle is like everybody. And what they, the point they kind of make is the people on either end of the spectrum are like the unique, interesting people in the world. And so here we go. I mean,

kudos to Zuck, but the game is on now. And, you know, this is one of the interesting things about antitrust. By the time, Lena Con or, you know, the UK or the EU or any federal agency starts to take apart a monopoly, the free market takes them apart. And the barbarians are at the gate. You got Microsoft coming in the front. And now you've got on the side, boom. Another person coming in on the side. Can I show one more thing from the interview that he did yesterday

or he did a couple but the one with Dark Wash which he said something really interesting like hey how did you get on top of the GPUs? He's like

well we needed the GPUs to basically compete with reels and we needed in order to compete or create real sorry that would compete with TikTok

and in order to pull in order to create the algorithms they had to go from algorithms that were built for like, you know, for your own network

to TikTok style algorithms, which is they have to find the most interesting thing in the entire network. And so they did a monster purchase in 2022. So it was really interesting. And then they ended up having all this compute, which they've been able to leverage and turn into all this wonderful stuff.

It's really awesome. And, you know, what I'll say is the implication for the broader ecosystem. So once you look outside of that, and I'm just going to pull up another tweet, So we talked about what having, you know, more powerful models means. But if you really look at what's happened last 24 hours and why I left our poker game to come in and get this launched is we are running Lama 3 at 300 tokens a second.

Claude Opus, which has moved down on this list, runs at 18 tokens a second. And GPT4 is 36. So if you're building something and they're all, you know, in the relatively same bucket of capability, you want the fastest one. So that's what we've been very excited about over the last 24 hours. Okay. Yeah. And Reuters is reporting that meta has struck some kind of a deal with Google to include those results.

And so something's going on here where the results are being provided. And so we don't know the details of that deal. But it's definitely a big deal because whoever gets that search result into their database is going to have a lot of power because you can connect that search forever to that person. So, you know, if you were to search for something like you're feeling sad and depressed, now, you know, you're going to see depression, medicine, ads, pharmaceutical ads, to the cows come home because you did a search, you know, like, how to feel less sad. Or if you're like, you know, you do an Ozempic search, I want to lose weight, whatever it is.

Yeah. Yeah. Whoever has the search. search, man, I mean, it's just such purchase intent. And you combine that with what pictures you're sharing and what's in those pictures. It's going to be incredible. So we don't have the details of what's going on here yet. We have two grades to give up. Two grades. Okay. We're going to give out one grade on the model, Lama 3, and the second grade on meta.a.i. A and A plus. I'm going A and A plus. I mean, it's clear this model has broken in with an open source model into the top two. Yes. And if you want to want to say, hey, one, two, and three, it could be wrong. It's a mistake. We need more time to

figure it out. Even if it was in the top five, the top ten models have been proprietary models, closed source models. Yes. Yeah. So just the fact that it's even in the top three would be extraordinary, let alone, you know, number one or number two. Okay. So that's an A. I'm not going to give an A plus. You don't have enough information, but next week we could reserve the right to raise our grades. Yep. And then for this interface, the reason I'm giving an A plus is not because the interface is there, but because the vision is there. And it's not just the gold chain and the crazy hair. And the fact that he's doing the product discussions himself, it's that he said in the product discussions that he's putting this at the top of every app. And there's going to be a search box,

and he's going to super distribute it. That means he has made this a priority. War Room Micromanager. Like, this is my company. I'm going to win. Listen, we all know, generative AI. is revolutionizing every industry. In fact, we talk about it here on this podcast every week. And companies that are slow to leverage this technology, well, they're going to risk falling behind their competition. But new innovations also bring new threats. How do you safely accelerate your company's gen AI adoption while also managing the risk? Well, let me tell you about hidden layers, AI detection and response platform. It's a security solution specifically designed for generative AI and large language models, LOMs. You know that. It provides your security team with visibility and

tools necessary to detect and prevent threats like leaking of confidential information. We've seen that a couple of times, as well as malicious prompt injection. That's a serious threat and model theft, right? People are starting to steal. That's just the truth of it, folks. People will steal your innovations. That's going to enable your company to harness the power of AI and to do that securely and confidently. It's trusted by leaders in finance, tech, healthcare, and even the US Department of Defense, the DOD. Hidden Layer helps you generate more by a enabling seamless and secure generative AI. So here's your CTA, the old call to action. With Hidden Layer, go from pause to possibilities and step into the future of secure AI innovation.

Learn how to protect your generative AI today by visiting hiddenlayer.com slash twist. That's hidden layer.com slash TWIST. You know that vibe, right? Somebody's here. He's not asking anybody in the company what they're going to do. He's telling them. Put the search box. at the top. We could discuss everybody's feelings about that, but we're doing it. And I tell you what, have a good time discussing it. I'm out. I got an MA. I got to get to Vegas to go see UFC 301 or whatever the hell it was that he was at. So this is, you know, that's why I give it an A plus. If I was just judging the interface based on the searches I did, I'd give it a B or a B plus, but I think because the vision is there and, oh, I'll have one more thing to add. He created a look

and feel and a specific domain name. And you can tell how committed people are on if they give something a specific name and brand and let it stand on its own. He's telling people, go to meta.a.ai, and I'll give you another reason this is really important. He didn't say you have to log in. He's like, you know what?

I know this is going to cost me money. Every time somebody searches, I know I'm going to be hidden the server farm. I don't care. This is the investment I want to make. I don't know how much he's losing on these server farms, but he was willing to lose 10, 20 billion dollars a year on

silly goggles. I know, I'm talking about the goggles. Remember, he was losing 1020 million a year on the goggles that nobody was using? 10, 20 billion on goggles. I mean, if he gets but 10% of search, it's going to change the entire industry. And so you give it a domain name,

you give it a look and feel. Yeah. You tell it's going to be super distributed. We're putting this on every single app. I mean, it tells you everything. you need to know. He's going for it. And it's strong. Like, you know, everyone was kind of like, oh, meta, now meta.com. I could go there and I could search.

I would use it. And you know who doesn't do this? Google. Remember Google Plus? Where did Google Plus exist? BARD. Google Bard. They never did bard.com. Google Plus should have just done plus.com. They never made its own look and feel. Google Plus,

they were like, we're going to put it up in the little carry on the top right. It was hard to get to even, right? It was up in the top right hand of your navigation. It just showed that they were not committed to it as a standalone long-term brand. Whereas with YouTube, they were like, it's going to have its own office space. It's going to have its own logo. It's going to have its own vibes.

It's going to have a creative space in San Francisco, a creative, sorry, San Bruno, and then a creative space in L.A. This is how you know when the CEO's committed is, do they put it in its own building? Do they give it its own brand? And this is, I'm going to tell you this could be the most important new story of the year. Wow. I think this might be the new story of the year for our industry. I am the other way around. I'm A plus on the model.

Okay. And I'm A on the AI integrations. Okay. Say more. Well, the model, look, putting that out in the open and giving it to the community and giving them a challenge. And he also said this, right, was, I want the community to take it.

I want them to make it better. I want them to make it run faster. I want them to make it run cheaper. And he goes, even if from the community does something and it's 10% better, we're going to spend $100 billion on this stuff.

That's a $10 billion saving for us. He also said, it's important that no one company owns the greatest technology ever invented. And so that's a really, really strong move in this world where most companies are trying to create closed AI and not just, you know, close the eye.

But a bunch of others. Yeah, I mean, Claude's closed. Yep. You know what's interesting also about that? I think when you're behind and you've got like a giant business, yes. You're totally fine when you're behind being open source

because it helps you catch up. So where was meta a year ago? Or let's say two years ago. Where was meta two years ago in the AI race? No, two years ago. they were just buying the GPUs to try to compete with TikTok. Exactly. They were not in the race.

They literally didn't have their running shoes on yet. Yeah. A year ago? They launched Lama. They launched Lama. So a year ago, they're in the race. And if there's 10 people in the race, they were in 9th or 10th place.

Yeah. trailing the pack. And now you're telling me, and I trust your judgment, Sandeep, you're telling me their neck and neck at the front of the pack. Well, it's not just my judgment. I'm just sharing what the standard industry benchmarks are saying right here. Like, they are tied for two. Yeah, exactly.

So let's just pause again and recap what we've learned. Two years ago, they weren't in the race. They weren't even in the stands. They weren't paying attention to this. They were changing the name of the company to meta because of the metaverse. Now meta means search engine for AI. He literally took the brand meta and said, you know what? Meta.a.a.

It's meta. AI. I meant it all along. Like literally, he fell on his face, got barbecued by everybody. Everybody said he's distracted and he's like got this stupid idea with the metaverse

that nobody cares about. And he just turns this entire... Judo move. I think that the, this is a judo move. He redirected the energy and I think the MMA stuff is got him

reinvigorated as an entrepreneur. He just took the Battleship and turned it around. Congratulations to the team over there because... You cannot fuck around with a guy that wears a chain on the outside of his shirt. I mean... Jake, you might have to break one. I'm breaking it out.

I got it right here and draw. I'm breaking it out. The point is... I see. This chain is indicative of where he's at, which is, you're talking to me, Zach. This is just incredible. It's incredible. You know, and like I said, if he can get one or two or three percentage points of

search, there's no reason he can't beat Bing at search. So now you've got to be Microsoft going, oh, man, this lunatic, but open source allows you to catch up quick. And then he can take this high road position like Elon has taken, which is, hey, participate in my, participate in my ecosystem, don't use their software. Yes. And you know what? He would never, he specifically turned off the app ecosystem inside of Facebook, I remember? He screwed every developer who every partner who ever work with him, he screwed. From his personal partners in the business, to advertisers to people building pages and content providers,

content providers, app providers, and his own co-founders, he screwed everybody. Now he's going, you know what, let's build together. Smart move. I don't know if I trust them, but we'll see. I mean, look, I think there is so much going to happen. I'm going to put another prediction out there, J. Kel. Yeah, we go.

In the next 60 days, this is really going to shake up. I mean, if you're any of these other companies, right, you're really sitting there saying there is a open source free model that's available. The only people that really can't use it are like other internet companies, right? Their license limits you if you have. Oh, yeah? Yeah, I think the license says something. Like, if you have something more than like 100 million active users, you can't use this,

which it's just targeted at like Snapchat and TikTok or, you know. Really? that's interesting. Then how can it be open source then? I guess it's, I've never heard of it. I've never heard of an open source. The commercial use license. Because open source have different licenses, right? But have you ever heard of a license based on the number of users? That's the first time I've ever heard. I've heard of licenses like you have to contribute back. Yeah. You have to give credit. Link back. So anyway, this is, I think somebody's got to get in there and read that license bullet by bullet point. Because this does matter. And if you're going to build on somebody else's system, you really do want to understand that. But yeah, I agree. with you. This is it's another one of these like earth-shattering moments. I'm just going to pull this up, Jacob, because this license is actually pretty simple and clean.

I want to give them credit for it. So obviously, here's a license. Playing English license. Obviously, there's an agreement. There's a licensee that's you. Meta-Lama materials. And then they grant you're right. Exactly. They grant you right. Redistribution. Here's the

only thing that you need to understand. Additional commercial term. I'm just going to read this for the folks that are listening. If on the Meta 3Lama version release date, the monthly active users of the products or services made available by or for the licensee or licensees affiliates is greater than 700 million active users, then you must request a license for meta. And meta may grant it to you at their discretion. So this is very specifically targeted at like two or three companies because this doesn't affect anyone else. It doesn't affect the corporate, like an enterprise. It doesn't affect anyone else.

Yeah, I mean, it's rarefied error to get to that number. They're probably including, I think Reddit probably breaks that number of monthly active views. I think Reddit might be right there. I wonder if that's a Reddit clause. $700 million? Twitter's at monthly, we're doing monthly active users. We've got to get the monthly active users.

Twitter's in like the, like I think 100 or 250 years, like that kind of range. Yeah. Top monthly active users, 24. Yeah. 700 million is a big number. I mean, it's like a top internet services by Mao. I'm just going to ask meta. Yeah, that's meta.

That's it. That's meta AI. Right here. Okay. Facebook 3 billion. WhatsApp, 2.78. 2.5. Instagram, 2 billion.

We chat, TikTok, telegram. Then you fall away off. There you go. But look who's that 750. Snapchat. You're right. It is a Snapchat rule. This is a Snapchat rule.

Exactly. Or TikTok and TikTok right here. Yeah, I don't think TikTok's got their own jam. I don't. think they need them. Monthly mouse, Reddit, 2024. Let's see what Reddit has. Dude, this is so good. Like, I'm just using it here. I'm such an idiot. I'm like literally using a Google search. We're talking about this

replacing Google. This is why habits take a time. I know. Monthly active users for Reddit and Twitter. Oh, interesting. It said 1.2. Wow, that's interesting. I think because of all the SEO traffic they get. Yeah. Okay. Uh, Reddit had, I'm getting a different answer. I'm getting 400 million in 2022. Okay.

Twitter had 440. Reddit had 430 in 2020. Yeah. Okay. So anyway, it's, um, I think probably Twitter and Reddit are bouncing up against this and obviously Snapchat's over it. That's a very interesting clause.

That's the first time I've ever seen it. Oh yeah. That's been around from the earliest licenses. So that's not a new thing. Hmm. But you could still look at their code base and be inspired by it. Look at this. Look at this.

Twitter, 550. Yeah, it's growing, yeah. Yeah. All right. Well, there you have folks. Is there anything else we want to demo or talk about when it comes to this crazy meta moment? I'll just do like one more kind of fun demo just for the sake of it because it's really fast and it's super exciting. So one of the things that they've done is made it so that it can code incredibly well.

I'm going to pull up an example here. here, give me a second. So we were trying this last year, you're in you. Right. Let me a snake in HTML and and you can see. Whoa.

See how fast that is? Yeah. And so basically it gives you two files. Right here's the script and the index at HTML. And if you bear with me for one second, I'm just going to pull that up. I'm going to save those. And I'm going to pull them up.

And you're going to get a, you're going to laugh. They're going to get a kick out of this one. This is where the internet has come to. So I just saved those two files because you can see this. I got a snake game. Yeah, you made the snake game. Yeah.

But I made it in like three seconds. Incredible. Yeah. Somewhere Atari, 80-year-old Atari engineers are banging their heads on the wall. Yeah. This represents like their careers. Like, literally, that represents like Waz's, like, five years of Steve Wosniak's life. And it's like, Nolan Bushnell just jumped off a roof.

He's like, what? I mean, this does also, I think, lead us to the discussion we've had many times, which is an organization as big as Facebook with as many developers it has as it has using co-pilots and building AI at the same time is like the snake eating its tail. they are, because they're building the LLM, that's going to help them be better coders. They're going to use that LLM to write better LLMs in code. And so this is when we talk about the pace increasing, and people talk about we're going to reach AGI, artificial general intelligence, faster than people think.

When you see, I think this is another proof point or evidence that the velocity is increasing. When you see new entrants take the number one or number two slot or the number three slot and it starts changing like this, what's happening is, you know, these models and these tools are making the people build the tools and the models better every day, every week, every month. You must be seeing that up close and personal as well. Maybe you could talk about what's happening in the developer community in terms of people getting better at building product. Yeah. So there's an interesting.

framework here that I'm going to share with you that I think you should think about for your cohorts of companies. When human or humanity went through the industrial revolution, I'm going to use two examples. We went from bespoke car making, which means like a team would make like one car a day to like a factory where you got a thousand a day. And you went from like farming for maybe your family and your village at most to like industrial farms. You can feed entire states and or countries. Yes. Right. So that's like. the industrial revolution impacting our society. We really haven't seen this in technology.

Because if you have a designer on staff and that designer you ask to create a mockup for you, right? Or if you have an engineer on staff, you ask the engineer to build something for you. What we now have is the industrial revolution for those folks. Because I can now have a thousand images generated in just a few minutes. Yeah. Right? or I can have 50 code games generated.

And one of the things that Zuck did talk about also, so that's like the first thing. The second thing is you can now use these models going to feed them, create data to feed themselves to get even better. That moment is here for us now. And so the folks that are using these tools are starting to accelerate and go faster and faster and faster. And my guess is that more so than anyone else,

they've really cracked that and they've really figured out how to put AI itself in their loop of driving AI forward. Part of the Industrial Revolution was, you know, there were different machines. And to your point, we did have this happen in the information industry. It was called the printing press. Now, if you wanted to have knowledge, you had a priest, a monk, sit there and they would take a book and then they would take some parchment and they would write a copy of the book. They would try it. And then a month later, they would have rewritten some text

and then they would sell it to some prints or king and they would put it in their library. And then a printing press happened and they would make a metal template of that book. Set, said knowledge or book. And they would set, you know, the knowledge there. And then they would press a button and it would stamp the paper and cut it and put it into a book.

And then all of a sudden, everybody could have that book, the printing press. right, the printing press changed the world. And then you also had that happen with looms and building of clothing, where you remember these looms that people started using to make clothes and all of a sudden somebody would be making a sweater

and it would take them a week and now it would take them a day and then a machine eventually wound up doing it in minutes. And so that is, I think, a good way to look at it. If an app took a person, if building an app as a developer and a designer was the equivalent, of that monk

rewriting the book. And it took them a month or let's say it took them three months to rewrite the Bible. Okay. Now they could make 100 Bibles in a day. Could you make 100

apps in a day with one developer? And the answer is yes. Yes. Yes. It's coming. That's wild. Well, it's here,

but it's not polished enough. And the answers aren't correct. And this is part of why the Hume AI PIN I don't know if you saw Marquez, you know, barbecue and said it's the worst product ever. Marquez said it's the worst product he ever reviewed. But did you watch the actual review? I haven't seen it yet.

I watch those with my son, so we're going to watch it tonight. So anyway, watch it. What you'll find is it's a love letter to the hardware device. It's he's incredible about, you know, the build quality and how unique it is. There are some issues with battery life being short and it's a little bit heavy. it's hot, you know, things you could normally see. And he has a, but the problem he has with it is the price of it, the fact that it's not as good as his phone, and it takes 12 seconds for the LLM to give him the wrong answer.

So all the hardware, he thinks, is incredible, but the LLM is wrong. And so we just need to make sure the answers coming out of these LLMs are correct, because, you know, people were like, oh, he's beating up on these things. Well, the truth is, we haven't been as critical of these LLMs and the answers they're giving. But, Jacob, we just saw how they're getting better. They're not using their training data. In those two examples, it went out to the internet. Yes.

And then it reasoned over the answers. Yes. That's the future, JCal. You don't want it to recall from its training data. Yeah. That's when you're subject to hallucinations. But if you tell it just the same way you or I would, hey, go and get this information, parse it for me, and give it back to me in a table.

That's what it just did there on those results. Yes. And it was much better. Yes. And it has a citation. So, and now, since it's giving a citation, that leads to our ongoing discussion about rights. If you give citations, and I think we started, when we started doing these, you know, weekly AI discussions, I said, if you give citations and you link back, I have a lot less problem with this, because, and then I don't know if you saw the Adam Schiff or. Yeah, we talked about it a little bit, right?

We talked about a little bit, yeah, how there, you know, there's agreement that you just have to tell it what you trained to. on. I think Zuck is, realizes that that's how this will shake out. And he's like, you know what? I'm just going to link to the pages that Google has in the top results. Zip, zip, zip. I did a deal with those guys.

I did a deal with those guys. And I'll do a deal with you. And if you don't want to be in the index, just put no robots. At TXT and we'll exclude you from these results. Yeah. But man, this is disruptive. This is disruptive. Another crazy week. Congratulations, Sundeeep on getting this going.

You want to go to console.grock.com. Is that the right place for people to go? That's the way they can go and they can go to grok.com. Just play with it. But you go to console, get a key and start building your own stuff, which is what we want you to do. And he's Sundeepe on the X platform, X.com slash Sundee. He's super active. Getting the replies there.

Say hi to him. Tell me you watch the show. Have a great weekend, everybody. The world is moving out of breath. The three, two. The world is moving at an ever-increasing velocity. And the way you're going to get through that is to be a part of these discussions we have here every week.

Tell your friends about this weekend startups. Search on YouTube for this week in startups. Hit subscribe, hit the bell. Make sure you don't miss an episode so you can stay informed. And so you can figure this all out with us. Sunny, any thing people should know about in terms of, I don't know if you have a startup program or a way for people to learn more. We gave them the URL, but is there a startup program there at Grock yet?

We do. Just hit me up. We'll sort you out. Okay. Let's just make a, you should make a URL slash twist. I'll give you a free. Oh, let's do it. If you make grok.com slash twist.

That's twist. Yeah. I think like I do for my advertisers here, since you do the show and you put so much work and I'll give you the free ad. You send people to that. It'll be that this week

and startups deal. Oh, I like you. And you can just offer people like some deal and, you know, webinars or whatever. That's my gift back to you in the GROC team. Is it Brock.com slash twist. Is it GROQ or K? GROQ.

Yeah, you're a GROQ. Yeah, you're a GROQ. We have that trademark. You have the GROQ. I know that this is a little contentious. If you're GROQ.com slash twist, T-W-I-S-T, at some point we'll have a twist landing page with some offers. Sunny, thanks for sharing your knowledge.

We'll see you on next time. Bye-bye.