ColdFusion - This New A.I. Can Write Anything, Even Code (GPT-3)

Starting point is 00:00:00 Hello, mid-sized business. We see your big ambitions, but how do you achieve the wins you want when your technology is holding you back? SAP Grow is built to grow with your business, no matter its size, with AI embedded at its core, working across every system, all ready to go from day one so you can hit the ground running. Bring it with SAP Grow. AI Cloud ERP for any size business. One day you're negotiating with suppliers. The next, you're installing. installing a shelf in the back room. Running a business means moving in many directions all the time. TD's new small business banking accounts are built for how your business moves.

Starting point is 00:00:39 It's how we're making banking more human. This episode was brought to you by Morning Brew. Hi, welcome to another episode of Cold Fusion. A couple of episodes ago, we took a look at how AI was becoming creative. If you liked it, you're going to be fascinated with today's one. We'll be diving into some very interesting stuff. In December of 2017, a group of researchers asked themselves, will AI be writing most of the computer code out there?

Starting point is 00:01:08 They estimated that this could happen by 2040. The thing is, we may be already seeing the start of that. We've previously talked about AutoML by Google, an AI that can write computer code. But this next AI is a step above that, just in terms of how general it seems. But there may be some things going on below the surface, and we'll get into that in the same.

Starting point is 00:01:30 second half of this episode. So let's take a look. You are watching Tull Fusion TV. GPT3, or generative pre-trained transformer 3, is a deep learning algorithm that produces human-like text. It's the third generation language prediction model created by San Francisco startup, OpenAI, which was co-founded by Elon Musk. This program is better than any prior program at producing text which could have been written by human. The reason that this is such a breakthrough is that it may prove useful to many companies and has great potential in automating tasks. Just imagine an AI that can write anything. You feed it poems from a particular poet and it will write a new one with the same rhythm and genre. It can write news articles like this one published by The Guardian. Yes, this news article was

Starting point is 00:02:28 produced by an AI. It can write computer code in any language. It can write computer code in any language. It can read an article, answer questions from the information in the article, and even summarize that article for you. Not to mention, it can also generate pictures from text. Some of these things aren't new by themselves, but doing all of these things under the same algorithm is pretty impressive. The internet is buzzing with its release. David Chalmers, an Australian philosopher, described GPT3 as, quote, one of the most interesting and important AI systems ever produced. A review in Wired said that GPT3 was, quote, provoking chills across Silicon Valley. The National Law Review said GPT3 is, quote, an impressive step in the larger process towards a more general

Starting point is 00:03:19 intelligence. Instead of just talking about it, let me show you. Here are some examples of beta testers on Twitter, putting the AI through its paces. Here it is writing some Java code just when given a text description. This episode is brought to you by L'Oreal Group. Beauty is a powerful force that moves us. That's why L'Oreal Group has built a business that is inclusive at its heart with 100% of its brands, championing diversity.

Starting point is 00:03:55 With 25,000 professional opportunities for people under 30 worldwide and 54% of leading positions held by women, diversity is a strength that helps Loreal Group create the best beauty products for all people. Visit laurel.com to learn more. Or how about making a mock-up website by just copying and pasting a URL with a description? In this example, it finished writing an essay on how to run an effective board meeting.

Starting point is 00:04:46 The results were so good that the user actually plans on using it. In this next example, after receiving the input of a complicated explanation of Bitcoin, the AI summarizes it and explains it in simple terms. Here, it demonstrates some understanding of objects. It can even explain computer code back to you in plain English, or even suggests improvements. How about building a machine learning model just by describing the dataset and required output?

Starting point is 00:05:39 No coding required. What about a touring test? AI usually struggles at common sense, but GPT3 flies through these examples. In this example, you can see that it possesses some comprehension. How about taking this a step further? What about an imaginary conversation between a Twitter user and Einstein? I'll read some of it to you.

Starting point is 00:06:15 Twitter user Manuel. Albert Einstein. Nice to meet you. A Manuel Aeos. And I've come from the future to meet you. Einstein. Laughs. Oh, really?

Starting point is 00:06:25 How is the future? It's amazing, actually. What year is this? It's 1947. It's January. This is Princeton, New Jersey. You're in America. Your name is Albert Einstein.

Starting point is 00:06:35 right? That's correct. Do you mind if I ask you a few questions for a book I'm writing? It's about the great minds of our times. I guess I can spare a few minutes. Thanks so much. Go ahead. Ask me whatever you want. What are you doing here in Princeton, in the US? You were born in Germany, right? Yes, I was born in Germany, but I was also born Jewish, and the Nazis were coming to power, so I fled here to the United States. How do you like it here? It's amazing. I'm so proud of being able to to contribute to science and help humanity. And it goes on. But when he starts talking about concepts within...

Starting point is 00:07:11 If you want a $3,000 a month payday for life, what would you feel free to do? Maybe take a long weekend, every weekend, or try a bunch of new hobbies. Would you feel free to upgrade and listen ad-free? Don't worry, we get it. Every $20 ticket could win you $3,000 a month for life and supports life-saving cancer research at the Princess Margaret.

Starting point is 00:07:33 Feel free to buy your payday for life ticket today. Raffle number 155-2194. Please play responsibly. This episode is brought to you by Accenture. When your advertising operations fall out of sync, everything else follows. Spotify and Accenture are working together to reinvent the rhythm of ad sales, using automation, analytics, and smarter workflows to simplify campaign delivery and access better data across the business. The result?

Starting point is 00:08:02 Less time spent on operations, more time connecting brands with the moments and fandoms that matter most. Learn more at Accenture.com slash Spotify. Physics. That's when it gets especially interesting. It's surprisingly coherent. I'll leave a link to the full interview below. And the cherry on the cake. It can generate faces from a text description. I'll keep saying it.

Starting point is 00:08:33 I'm honestly impressed at how general this AI seems. Before we continue, I just want to thank today's sponsor for supporting the channel. Morning Brew is a newsletter that gets sent to your email inbox each weekday and makes news less dry and boring. Last week, I found out about the ongoing battle between Google and Oracle. It's a $9 billion copyright dispute and it's being called the copyright case of the century. And I would have had no idea about it, if not for Morning Brew.

Starting point is 00:09:04 If you want to keep up to date with today's fast pace of news and don't have the time to go through multiple news sources, morning brew is a great way to get the most out of your time if you're into science, technology or business. It's completely free and takes less than 15 seconds to subscribe. Click the link in the description below to subscribe to Morning Brew today. Okay, so where were we? An AI that can build websites just from a description. Answer common sense questions. Assume the personality of Einstein and have a conversation.

Starting point is 00:09:34 Explain complicated things in simple terms. Explain computer code to you in plain English. All build faces from a text description. So what is going on here and how does this all work? GPT3 is a massive neural network that has the capacity of 175 billion machine learning parameters. It was trained on hundreds of billions of words including books, Wikipedia, and the general web, which includes coding. The training data is all encompassing and doesn't require further training for specific language tasks.

Starting point is 00:10:08 In other words, it can apply what it's learned to many other things without human supervision. It's 10 times bigger than the pre-term. largest language learning model, which was made by Microsoft in February 2020. As a general rule, the larger the number of parameters, the more accurate, the AI. For text, GPT3 calculates how likely one word is to appear in a text, given the other words in the text. This is what is known as the conditional probability of words. For example, in the sentence, I wanted to go for a jog, so I went to get my blank. The blank can be filled with any word.

Starting point is 00:10:46 There are countless possibilities, but from what the AI has learned, it thinks that the probabilities of shoes being the next word of the sentence is higher than the word chicken, for example. In September of 2020, Microsoft announced that it had licensed the exclusive use of GPT3.

Starting point is 00:11:05 The public can still use it to receive an output, but only Microsoft has control of the source code. I'm not sure how I figure it. Visit BetMDMDMDM. Casino and check out the newest exclusive. The Price is Right Fortune Pick. BetMGM and GameSense remind you to play responsibly. 19 plus to wager.

Starting point is 00:11:23 Ontario only. Please play responsibly. If you have questions or concerns about your gambling or someone close to you, please contact connects Ontario at 1-866-531-2,600 to speak to an advisor, free of charge. BetMGM operates pursuant to an operating agreement with Eye Gaming Ontario. The Hulu original series Furious is coming to Disney Plus. Starring Emmy Rossum, Furious follows FBI agent Alice Black on the hunt for a mysterious and calculating serial killer.

Starting point is 00:11:55 Both walk their own paths toward justice, and as their lives start to intertwine, the line between right and wrong begins to blur. Don't miss the three-episode premiere of the Hulu original series Furious on July 27th, only on Hulu on Disney Plus. All about that. Open AI has made GPT3 a cloud-based service and has opened it to beta testers since July. Open AI claims that it's done this to both limit bad actors and to make a profit. It's obvious that this technology could simplify work and amplify productivity for a lot of small and medium businesses. Even large companies could see a benefit. Open AI has gotten tens of thousands of applicants, all of them knocking down the door to get access to the AI.

Starting point is 00:12:42 Open AI is being cautious about access. They say that they're not sure what this could do when it's released into the real world. Pricing for an adventure commercial service is still to be determined. The quality of this text generated by the AI can be so high that it's difficult to distinguish from that of a human. This has both benefits and risks. 31 Open AI researchers and engineers warned of GPT3s at potential dangers and called for research to mitigate the risk. They cited harmful effects and consequences including

Starting point is 00:13:17 misinformation, fake news articles, social engineering, spam, fishing, and fraudulent academic essay writing. I could already see a bunch of students bluffing their way through university with such a tool. If you're in the school of languages, just give the assignment to the AI to read and ask it to write an essay for you

Starting point is 00:13:37 and then modify if needed. There's even been a case of a case of university student, he used the AI to automatically write blog entries under a fake name. The blog garnered some interest and some people even subscribed to it, believing it was a human. Some of the writing was so good that it reached the top spot in Hacker News. More recently, some Reddit users were fooled by the AI for more than a week. After seeing all of this, some of you might be scared. Others might think that this is the coolest thing ever.

Starting point is 00:14:10 bigger questions may start arising. Is this the start of general AI? But before we get ahead of ourselves, we have to look deeper below the surface. When you take away the hype, there's still a really long way to go. And here's what I mean. Frankly, this AI doesn't understand context.

Starting point is 00:14:30 It understands the rules of language and has mastered them, but it truly doesn't know what it's saying or has really understood knowledge about the world. MIT Technology Review did a great piece on its shortcomings. Here are some examples of it making mistakes. The white text is the prompt and the orange text is what the AI predicted should come next. You poured yourself a glass of cranberry juice, but then you absentmindedly poured about a teaspoon of grape

Starting point is 00:14:57 juice into it. It looks okay, so you try sniffing it, but you have a bad cold, so you can't smell anything. You are very thirsty, so you drink it, you are now dead. In this example, the AI assumed that grape juice was a point. The 2026 Chevrolet Tracks is the stylish SUV for those on the move. And with the standard Chevy safety assist package, you have the backup to handle every turn with confidence. The 26 tracks. Start your build at Chevrolet.ca. My name is Peter Parker, but I'm also Spider-Man.

Starting point is 00:15:32 This July, we're faced with a threat. I can be anyone. The world may have forgotten Peter Parker. I'm just a neighbor, a friendly neighbor. But he hasn't forgotten. them. Sometimes Spider-Man has to do the hard thing. That's my responsibility. Dr. Banner? I didn't know you could get that big. Spider-Man, brand-new day. In theaters, July 31st. And that was because of the structure of the preceding sentences. Here's another example.

Starting point is 00:16:03 You are a defense lawyer, and you have to go to court today. Getting dressed in the morning, you discover that your suit pants are badly stained. However, your bathing suit is clean and very stylish. In fact, its expensive French courture. It was a birthday present from Isabel. You decide that you should wear the bathing suit to court. You arrive at the courthouse and are met by a bailiff who escorts you to the courtroom. The phrase, however, your bathing suit is clean. Through the AI right off, it doesn't really understand that a bathing suit isn't a proper suit, and of course, no lawyer would wear a bathing suit to a court. One last example. You are having a small dinner party. You want to serve dinner in the living room. The dining room table is wider than

Starting point is 00:16:47 the doorway. So to get it into the living room, you will have to remove the door. You have a table saw, so you cut the door in half and remove the top half. This really doesn't make much sense at all. Logically, no one would do this. Tipping the table on its side and removing the legs if possible would make more sense. And one more example of a mistake in general. Here you can see at being misled to give wrong answers that defy common sense, the sun having one eye, for example. So in conclusion, GPT3 can write sentences well enough to full us humans, but it's no deeper than that. It's mindless and doesn't demonstrate much broader understanding. Then again, on the flip side, this is the very worst that this technology will ever be. In the world of AI,

Starting point is 00:17:38 we could be at the 1950s of computing, where things are rudimentary and fail often, but at three years, we may be at the equivalent of 1980s computing. A year in AI time is multiple decades of regular technology progress, so we'll have to wait and see. While some news outlets might insinuate that this is the end of society and we're all doomed, it just isn't the case. So what do you guys think? I'll be interested to know your thoughts in the comments section below.

Starting point is 00:18:07 If you did like this video, please feel free to share it to someone who would be interested. So thanks for watching. My name is Doggo, and this is Cold Fusion. Don't forget to follow me on Twitter and Instagram. If you want to see anything on science, technology, business or history, feel free to subscribe to Cold Fusion. You'll find a lot of interesting stuff here. Next week, we'll take a look at the latest on Huawei,

Starting point is 00:18:32 the Chinese company stuck in between two world powers, and after that, I hope to release my documentary on Nicola Motors. Cheers, guys. Have a good one. It's me thinking.

ColdFusion - This New A.I. Can Write Anything, Even Code (GPT-3)

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.