Y Combinator Startup Podcast - #68 - Cost vs Quality in Edtech - Keith Schacht, Avichal Garg, and Geoff Ralston

Episode Date: April 6, 2018

Keith Schacht is the cofounder of Mystery Science, which makes lessons that inspire kids to love science. They were part of the Summer 2017 YC batch.Avichal Garg is an Expert at YC and prior to that he was the Director of Product Management at Facebook.Geoff Ralston is a Partner at YC and before that he cofounded Imagine K12, an edtech accelerator that’s now makes up YC’s edtech vertical.

Hey, how's it going? This is Craig Cannon, and you're listening to Y Combinators podcast. Today's episode is about ed tech, and it's with Keith Schacht, Avigel Garg, and Jeff Ralston. Keith is the co-founder of mystery science. They make lessons that inspire kids to love science, and they were part of the summer 2017 batch. Avichel is an expert at YC, and prior to that, he was the director of product management at Facebook. And Jeff's a partner here at YC, and before that, he co-founded Imagine K-12, an edtech accelerator that now makes up YC's edtech vertical. All right, here we go. Avichro, you founded PrepMe in 2001, sold it 10 years later in 2011.

That was actually the year we founded Imagine K-12, the world's first educational technology accelerator. And Keith, you founded mystery science, I think in 2013. We just celebrated our fourth birthday in January. And you just celebrated your fourth birthday with Doug Peltz. And you guys actually did YC in summer 2017. So the idea of this podcast was to have a conversation about educational technology, about maybe some current past and future stories around ed tech.

One of the things that started the, that was the initiative for this conversation was a blog post that Vichel wrote in 2011 titled why educational startups do not succeed. His summary of that post, I'll just give it really quickly, since he helpfully put it in the post itself, was that entrepreneurs in education built a wrong kind of business. They think of it as a quality problem

when actually it's a cost problem. Building an education does not follow an internet company's growth curve, and because of that, you have to think way longer term the venture capitalists are interested in funding you. So the opportunities for servicing education are actually not in the U.S. They're actually in Asia.

So it's not really going to be relevant for another five years. That was in 2011. So maybe it's relevant now because that would have led us to 2016. Maybe eventually you can start by sort of reflecting on why you wrote that post and how you're thinking about it today. And hopefully you guys can start having a conversation about that. Yeah, I think that's a great summary. That's a great intro.

I mean, the genesis of that blog post for us was really, we started this company. We had a lot of ideas around how to make education better using machine learning and using technology and personalization. And it turned out a lot of people wanted that in the early days. And so we got some early signal that that's actually what the market wanted. And then very quickly, things started a plateau from a growth perspective. And I think my conclusion was that we'd sat down. a lot of the early adopters, and the mainstream market just wanted different things. The mainstream market really cared much more about cost rather than quality.

And the fundamental sort of disconnect between people who start education businesses and the consumer themselves is fundamentally that. The people who start education businesses tend to care much, much more about the quality of the product. And in the U.S., the average consumer just looks at it differently, and the buying psychology is fundamentally different. And there are a whole host of reasons why I think that's the case that we can get into that I think I actually have very interesting downstream ramifications on things like politics. About whether people value education in themselves, right?

Yeah, exactly. And I mean, actually, so if we want to sort of unpack that, the thing I think, and this is I have very little other than anecdotal to back this up. So this is my current belief. I could be wrong. We'll love to hear probably from Keith, why I'm wrong. But I think what happened was post-World War to America was really good for a lot of people. So I grew up in Ohio and Kentucky. And so, you know, if you're in the 60s or the 70s, you could get a job at the GM factory.

You could make a good wage. Your spouse could make a good wage. So maybe together you make $80,000 a year working in the factory. And a house cost $80,000 a year. So that would be like living in San Francisco and you and your spouse make like $3 million a year. and you never went to college. I think you would rationally, you would look at that and be like, why would I go to college?

I'm making $3 million a year. I can buy my house and I can have a great life. And then the people that were sort of born, just to make the math easy, let's say you were born in 1982, so you'd be 18 in the year 2000, you'd be graduating from high school. The people were born in 1982 were raised by people of that generation.

And so kind of the value system sort of, I think, came from a belief that the world would still work that way. But the world doesn't actually work that way, Like starting with 2000, you know, the internet with the crash in 2001, the massive, you know, there was in between little recessions. There was a crash in 2008. So basically if you were an adult in, you've kind of been in and out of work for most of your adult life. If you were kind of in that camp, if you didn't go to college. And that kind of, I think, has bleed over effects into things like politics where like the system, the way you thought the world was going to work, the world doesn't actually work that way anymore.

And that disconnect has been a really hard transition. this entire sort of, you know, 15 to 20 year range of adults, it kind of got trapped by it. And I think we're seeing some of the effects of that right now in politics. Keith, maybe you can react to that. I'm especially interested in this perspective, which I think was more true in 2001 than it is in 2018, which is that if you're going to make any money in educational technology, you better appeal directly to parents because schools weren't going to pay for technology. Actually, they'd been burned with a whole bunch of technology.

bunch of hardware and technology wasn't so relevant to them at the time. That seems like it shifted a bit. So maybe you can. Yeah. I mean, one, one interesting thing when talking about the space is it's, I think it's actually hard to talk about the education space. Like elementary versus high school are totally different markets in many respects. And parents versus institutions are very different markets. So it's interesting. We often sort of group this as the education space or the education industry and we have to be careful about generalizing. And so, I mean, just one line. I mean, mystery science, we are helping fix science education in this country by giving

elementary teachers a remote science expert to co-teach the class with them. So we effectively sell schools a curriculum that replaces the textbook. You can think of it in a sense as a digital textbook. And our whole pitch to teachers and to schools is that this. This is better. This is better education. It's better than the textbooks. It's better than whatever the conventional curriculum is.

And it's notable that our teachers and the students and even parents increasingly are starting to recognize that it's better. So it does give me a pause to hear, you know, you can't build a business by making something better. I think there are some interesting challenges to trying to how you communicate that your product is better and how the customers appreciate it. But yeah, you know, so for just very early on, we've gotten a lot of traction selling into schools and getting appreciated for making a better educational product. It does seem to be true to back up a Vichel's point about parents in general not being willing to pay, especially sort of the mass market to be willing to pay for education quality. the value that they place on that in the United States at least is still not clear. There's a lot of money being spent outside of school and education, but it's test prep and tutoring for pretty affluent families.

Isn't that true? Yeah, it is an interesting. So we are preparing for our transition from selling to schools, selling direct to parents. And so we've sort of dipped our toe in the water with homeschoolers, which is a relatively small market and are getting ready to go mainstream. And so there's still a lot yet for us to prove about that. But there's a couple interesting observations that we've made so far. I think the thing that makes the market a funny market, the parent education market,

is that you get this product for free. So basically through property taxes, that's how you pay for school. But as an entrepreneur trying to build a business in the space, it's interesting to compete with free out there because parents feel like, well, I have this thing. And so one thing we've noticed in interviewing parents is that at the very young age, parents feel very involved in learning. So, you know, from birth to when they send their kid off to kindergarten or preschool, the educational value of the products they're buying is one of the dominant factors in considering whether you're going to buy that speak and sound or that play mat or that book or whatnot. It's a huge factor in buying decisions.

Once you send your kid off to school full-time, parents remain involved in some respects. I think reading is one of the main ones. They still feel like it's their job to make sure they're reading regularly to their child and helping to reinforce their ability to read at home. And then it sort of drops off for the next six to eight years. Your involvement as a parent in education is making sure you're supporting the school and going to parent-teacher conference and picking the right neighborhood or you sort of you get involved in that respect, by buying products and sort of delivering education at home.

And then towards the end of high school, it kind of ramps up again with the whole, like, getting into college thing or shoring up a week grade or whatnot. Yeah. Well, it certainly seems that your prediction that venture capitalists wouldn't fund ed tech companies has not come true, especially since 2011. And it was very interesting. We founded Imagine K-12 in 2011, and the companies that we funded alone received hundreds of millions of dollars in venture investment.

So obviously venture capitalists saw opportunity somewhere, right? Yeah. I think they basically made the mistake that I tried to call out in that post, which is I think they expected that the ramp of those companies from a business perspective would look like an internet company ramp, whereas I think, I mean, I don't know the numbers of most of the American companies, but I think they pale in comparison to like Chinese. education companies that go from like zero to a billion, you know, an IPO in seven years. It's just

like the ramps are just crazy in a place like China. And on the on paper. There's a lot more people in China, too, as it turns out. Well, yeah, I mean, that's, that's part of it, right? And the public school system is much worse. Exactly, right? I think the cultural dynamics are different. The public school dynamics are different. There are a lot of factors there for sure. But, but the net effect of it then ends up being on paper, you might have a company here as an education company that's worth $100 million or $200 million and has raised a lot of. And it's raised a lot of lot of venture capital, but do the revenue numbers actually back that up, right? Could you actually take that public on the market in two to three years at a billion dollar valuation? And what kind

of revenue would you have to do to support that? And I think by and large, that hasn't been the case, which is why you haven't really seen education company IPOs. But is that unique to education companies? Because just take consumer tech generally. There's many $100 million plus valuation consumer tech companies that don't have the revenue to back it up. And there are also many consumer tech companies in China, where the Chinese equivalent will scale much for. faster than the American equivalent. Yeah. The reason I, so it's certainly true that I think you have a lot of companies that are, that end up in this kind of dead zone. But the reason they do is because there are some that make it out. Like every now and then you'll get a Snapchat or a WhatsApp or an Uber or a

Lyft or a Stripe or like the list goes on. And most of these companies are not that old, right? Like, these are all seven to eight year old companies, right? So it's the hope that you stumble into an Uber or a stripe that really, I think, supports the rest of the ecosystem. Right. But I don't see, like where is the Uber or the stripe of the education space? Yeah, yeah. The closest is probably, you know, ABC Mouse, recent billion dollar valuation straight to parents. Yeah.

And teachers pay teachers would be another one. And, you know, Chegg is worth $2.5 million now. That's actually a great example. That's actually the one that I use most often, which is by and large, if you look at Chegg, the way they got to where they are is they didn't reinvent digital learning. They just made textbooks cheaper. Yeah, but they've almost completely shifted.

If you look at Chegg's website today, they don't talk about textbooks anymore. They're a smarter way to a student, whatever that means. So that, you know, but I think it's all about digital education for Chegg. Now, you know, I know it's a multi-hundred million dollar business for them. I was going to ask, do you know how that number breaks down between like their core textbook business versus their digital? I think the core textbook business and volume is bigger, but the digital business is rapidly growing And scaling and scaling. So it's interesting. There are, there are ed tech companies that are scaling.

Certainly revenue has been tough for many of them. Although, you know, I look at companies like mystery science, which has actually scaled revenue without matching any numbers very well by selling to schools. I do think selling to parents still because of this free zone. And we have to be clear that for better or worse, that free zone is for the mass market in Middle America. There is plenty of more affluent families that spend tens of thousands of dollars every year on private schools, on private tutors, on an SAT prep, on all sorts of educational advantages that do constitute a pretty big market, right? Yeah. And it's notable that ABC Mouse is, in some ways, I'm not. I think of them as the new leapfrog. Like, they're targeting that same age demographic that leapfrog used to, which is outside of that free zone. Yeah, it's the early state, like the early.

Yep. Yeah, and I think that, I mean, that pattern has held for a while, too. That's why, I mean, in that blog post, I called out something like five years because I think what you're starting to see is cultural shifts just take a while, right? And I do think there is a cultural shift. And the cultural shift essentially is that generation of parents that were able to. 18 in the year 2000, or, you know, they're parents now and they have five-year-olds, right? So the person that was 18 in the year 2000 would be 36 today. So they probably, you know, they might have some young kids. And I think they're starting to look back at, you know,

they probably don't have a 25-year-old, but they might have a six-year-old or an eight-year-old. So starting to look back at their life and saying, wait a second, like, what happened? Oh, the world changed. And so I think people are generally pretty smart. And so that that cultural change is starting to happen. Or that might be the 36-year-old that's now the head of the science department and is looking at it and saying, wait a second, I grew up with the internet, like, I get this, we should be buying better stuff. And so I do think that change is happening, but we're kind of at like the early parts of that change. And hopefully it accelerates, but I don't think we're like, I don't think the mainstream is like flipped quite yet.

There's another aspect of the cultural change. What seems to me is a cultural change within schools, which for me has shifted radically. You know, in 2011, when you wrote that post, the fact is that most schools were not connected with. reasonable internet access. Today, almost all of them in the United States are connected with enough bandwidths for more than one person could run YouTube at the same time. Many schools have directors of technology and are thinking about their technology buying plans. So it seems to me, I don't know how you think about this. Yeah, I think that's in the school space, I think that's one of the most significant things is it's from my perspective, it seems like it is mirroring the

enterprise cycle lagging about 10 years or so. So when we start, started four years ago, we finally could assume that most of our teachers would have a computer and at least one computer in the classroom, a projector so the kids could see it and an internet connection. Not the best internet connection, often consumer grade shared. It would slow down during lunch hour and then speed up afterwards, but we could assume this baseline level. And that was 2014.

So maybe that only happened around 2012 or so. Like that's relatively late compared to what happened in business. And so, you know, I think we are, we are, you know, really deep into this first generation cycle where there's a whole wave of companies that are just bringing efficiency to schools. So it's like, hey, now that we're on the Internet, we can make attendance easier, we can make grading easier, we can make student rostering easier, we can make, you know, a lot of back office stuff. And so that's a whole wave of companies that aren't even involved in learning. They're just involved in making these business operations more efficient because, hey, Internet's software is good for that. Yeah, totally. And then there's the second parallel we're seeing, and this was part of the wave we're riding in other companies where it used to be that there were directors of technology in business who made this software purchasing decision and then rolled out to everyone.

And so, you know, that's how the school director of technology started. And now, you know, we take the Salesforce sales model to these teachers where Salesforce didn't get permission from an IT department. They just got someone in marketing who signed up for a free account and got started. and then three or four or five more people got it. And eventually the AT department had to take notice because they had 50 users in the company. And so we do the same thing with our software. And other ed tech companies, too. I don't think we pioneered this.

Yeah, this is called pull model instead of the push model. Instead of having to wine and dine supervisors around the country, you actually convince persuade teachers that you have a great product. And in the end, they persuade their administrators to buy. Yeah, yeah. And there's a bunch of interesting shifts that happened there. So, you know, Salesforce was selling against incumbent CRM providers, like I assume Oracle had a product like that. And their product looks different. Like the onboarding for it looks different and the cost structure looks different.

And we're seeing that same shift. We've got the Pearson, McGraw, Houghton Mifflin, that generation of companies who still assume they're going to sell top down and roll out. And then mystery science and other ad tech companies that just do the a la carte and roll it up. So, Vichel, do you think your conclusions? still stand today or have you modified your take given what's happened over the past? I mean, you sort of gave it five years and it's been seven. Let me just read your conclusions. And I'm wondering if you think they're still valid today or whether you would counsel new ed tech entrepreneurs differently. This is the good and bad of putting things in writing. Right. And to be fair, I disagree with very little of what he wrote in 2011, right?

And so the real question is have we moved on? And if so, how should we move on? So your first point was don't make a better product, make a cheaper product. Which, by the way, the sufficiency stuff that Keith was talking about plays directly to that. Don't start in the U.S., start in or other developed countries because it'll be too slow, start in Asia. don't take VC money don't target the middle class because they don't really care

and don't expect a quick flip or quick growth you want to you want to you can take those as a whole or one at a time however you like I think I can take them as a whole I think they're generally still true but there are pockets where it's starting to change

and I think the places where you're starting to see change are especially around I think schools have changed a lot. I think things like I was talking to Dan and Clever, and he was talking about how Chromebooks have just changed the landscape. Dan, the CTO of Clever. Also, is Clever of Clever? Also, is Clever, YC?

Yeah, Clever is a YC. Should be an Imagine K-12. Long story for another time. So he was making the really great observation that, to your point, too, I think, is that just changes the game. All of a sudden, you can actually assume that there's an internet connection and a thing that looks like a laptop and is pretty reasonable and has good specs. So I think kind of like the fundamentals have changed, but the way that the fundamentals then manifest in terms of startups

is just starting to change because there's a phase shift there. So now that Internet is good, now that the person making the decisions might be the department head or the teacher, now that there are products that you can just sign up for and you don't need to go through the district. All those are structural changes that have just started to happen in the last, you know, let's say two years, three years that's really gone mainstream. So I think looking forward now,

So I think the question really is, like, are they still true today, take a snapshot? I think the answer is mostly still true. But that's not really the question that like a startup should be asking or a founders should be asking. Is like, will it be true in five years. I don't think it will be true in five years, right? Like if you're starting a company today, the question really is, are there enough customers for you to get going? And has the world evolved such that in five years, it will be dramatically different and look a lot more like your early adopters and I think it will. Well, they're all forward-looking statements.

So I think you're basically saying, ignore that blog post because the future, the future is different. The future looks actually better for intent. I think the future looks a lot better. The present as of today still kind of looks like that, but the trend lines are good, right? And so you look at mystery science, or you look at No Red Ink, or you look at Clever. There are all these companies that I think have managed to get pretty substantial traction. And so if you're starting today, I think some of these markets are actually...

You can't get quick growth. You can get pretty reasonable growth pretty quickly. I think the part of it that's still hard is actually the monetization. And I think that part of it is just going to be a phase shift. And I think that will come. And so it kind of is a case-by-case basis. I think in the early, early parts of the market, kind of what Keith was saying, if you're targeting four-year-olds and five-year-olds and six-year-olds,

you might actually be able to make a lot of progress and actually monetize because the buying psychology, I think, has changed. If you're talking about 14-year-olds, you might not be able to. Right. And so it kind of depends on the market that you're going. after. I still think the Asia thing is 100% true. Like I think if you just look at the growth of companies and the revenue in those markets, I think China is just an amazing, amazing market. And so unfortunately it's not, most people are not faced with the decision of should I start

a company in the U.S. or should I start a company in China? It's like one or the other. It's difficult in the U.S. to go overseas first because you just don't know the markets and vice versa. Yeah. And so that's not really for most people a decision point. I think the more important decision point for most entrepreneurs probably is like which part of the market am I going after and why? And is it higher ed? Is it, you know, high school? Is it science education? Is it math education? Is it pre-K? There are a lot of ways to segment the market. And so I think some of those have moved much more than others and the trajectory looks really good. So I think there are going to be pockets of pretty substantial change in the next five years. And some of that I think

will just take a while longer. Like I actually think high schools will take a bit longer than some of these others just because the phase shift, right? Like the parents, you kind of have to have the market grow into it. Keith, maybe we can talk a little bit about. about Laveo's original first point, which was the precise opposite of what you guys did later, right, which is not don't build a better product, build a cheaper product. You guys, in fact, did build, didn't build a massively expensive product, but you built a better product. Your whole idea was to build better science education.

And I think this is an interesting conversation because the real issue in American education isn't price, it's quality. It's how can we get better outcomes. Maybe you can reflect a little bit on that opportunity. Yeah. So I definitely think there's opportunity to build a better product in the education space. I think right now that's absolutely true. And I think it was true four years ago even when we started that you could build a better product.

And I think to the extent that the advice is useful of don't build a better product, build a cheaper one, it's not unique for the education space. There are many, many startups whose growth is driven by lowering cost. I mean, the whole media space, like the news media space online is being driven by free newspapers instead of print newspapers. And lots of people argue, oh, my gosh, consumers don't care about the quality of reporting anymore. All they care about is something that's free. And I think it's true that free is a really important driver in every industry or lowering cost is an important driver in every industry. And that's not unique to education. But the conclusion that the consumer doesn't care about quality, I think is it's one I'm very hesitant to make because oftentimes we as the creator have a unique set of things that we think are important.

And then we imbue that in a product. And if it doesn't resonate with people in the same way, you know, it's oftentimes you have to charge it a little bit more. Then it's easy to think, oh, they just don't care about quality. Like I could imagine, you know, in the furniture space, just to pick a totally different industry. You know, one of the high-end designer furniture stores for many years was design within reach. Never actually shopped there. But I walked in one and they sell like $20,000 couches. That's probably like the low-end couch there.

You know, and you can imagine this, the whole fine furniture industry concluding the average consumer, they don't care about design. Like, they just want cheap stuff. And then IKEA comes along and brings design to the masses. And so do you think IKEA thinks, oh, consumers don't appreciate good design? It's like, no, they absolutely do appreciate good design. They're not going to pay $20,000 for a well-designed couch. But they'll pay $500 for a well-designed couch, maybe even $1,000. It's more of a balance for that sort of consumer between cost consciousness and quality.

Yeah. So I don't think there's something unique about the education space to conclude, consumers don't appreciate this. I think that you create more value, you price it right, and you play that you have to figure out the market dynamics to scale. but customers appreciate it. In our case, we started out focusing on teachers. And the challenging thing in education, and this is also true of other industries,

is how does the consumer know what's better? How does the customer know what's better? And teachers, our particular customers, they don't have a lot of strong opinions about, you know, a better science resource would have the following attributes. So they're not searching for better necessarily, at least with a clear set of guidelines. But when they see it, they can recognize it.

And we hear all sorts of feedback from teachers like, wow, I've never seen it's a lesson taught this way before. I don't know what it is about it. There's just something different. And you can see it in their testimonials that they're sort of, they're groping at their own identification of what it is. So they can tell it even though they can't put their finger on it. You know, and you can imagine a consumer like you make a healthier, you know, granola bar. And, you know, the average consumer doesn't know what is the right balance of nutrients to make something healthier. but they could notice how they feel in the long run by changing their diet.

I think that's actually a good example. Yeah, I mostly disagree with what you just said. Tell me more. So I'll give you examples, right? Tesla started at the high end, right? And like electric cars probably wouldn't have happened had Tesla not price it the way they did. And there was like a bunch of work that they had to do to come down. The iPhone kind of worked that way.

Like a lot of technology cycles, I think, actually work with things that are more expensive that are smaller and niche. And then they like come down and price over time. because often there is a trade-off between quality and cost. Now, in like content creation, I think you could argue that the tooling has gotten so much better that the cost of production has come down dramatically. And therefore, you don't really have the same trade-offs that you use to. And so I think, like, mystery science is a great example, right? Like software tooling has gotten so good that you guys can have massive leverage and create

really high-quality stuff and price it very competitively. It's actually affordable for people, but it's really, really high-quality. but a lot of things don't have, it is a trade-off, right? And so to the extent that you have to make the trade-off, I think that's actually where things get hard. It's like the average person is going to make likely a different trade-off than the person building the product. And that's kind of where I think companies end up making the wrong trade-off. It's like the person building the product says, clearly if it costs 10% more, but it's 20% better or 30% better, that's a worthwhile trade-off. And that's actually not the buying psychology of the consumer.

And that's where I think on the margin things like get harder. Well, do you think, but do you think that's unique to education? Like most consumer products. I think it's unique to certain things. And I think the characteristic of education that makes it, there are two parts of education, which is kind of like health care that I think make it really hard. One is the long ROI cycle. It's just like it pays off in 20 years.

And us, like humans are just bad at that, right? That's why healthcare, I think, has some of these challenges. And the other is, I think, your point, which is how do I know it's better? Right. Like, what tells me that it's better if the payoff cycle was 20 years or granola, right? like better food for you. Nutrition is a great example, right? People make all sorts of suboptimal decisions in the short term when it's clear what the right long-term decisions are, and most people just don't make the right long-term trade-off. And I think it's exactly this. It's like

the payoff is really, really long, and evaluating quality in the short term is really tough. You wouldn't really argue that people don't make quality trade-offs, though, for food. They sure do. They might be wrong, and they might be a little opaque, but they sure do make those trade-offs all the time. And I think that's probably true in education as well, and health care. How do you, how do you mean? Well, people think certain granolas are better than other granolas and think certain berries are better than other berries and think like there's, they'll pay extra money for organic, for example, because they're, if they believe. And of course there's because, and part of that is that there are, um, there are shorthands for what quality taste better.

Yeah. Yeah. It's like so, you know, a mystery science lesson tastes better than, than a dry textbook without Doug actually doing it. So, so maybe, maybe there are ways for people to signal quality and to believe in quality. I look at kind of as like, you know, the way that I think like the way that we would evaluate quality here, I think like making fun and accessible, absolutely part of quality. But fundamentally it's about driving educational outcomes, right? Like if you didn't learn the thing better, is it actually better quality? I argue if you didn't actually learn the thing, like it's not better quality.

So we need shorthands because the ultimate educational outcome, which means you get a better job that's more satisfying, higher paying, et cetera, is too long a cycle. what schools use and parents by default then uses test results. Yeah, that's right. And I guess those are the outcomes that we have to use as a shorthand. I think this is more, I will argue that this is more of a symptom of a mismeasurement of better education. So since so much of a measure, the way that people evaluate whether a product is a better educational product is very often with some internal set of standards and heuristic. that a district will use for purchasing,

or it's a standardized assessment that they're going to measure at the end of fifth grade and eighth grade or whatnot. I personally question whether those are actually proxies for quality at all. And meanwhile, the thing that they ignore, which I think is the right proxy, is what's the level of student engagement?

Are students excited and eager to take the next step in that lesson or to understand this concept? And that's largely ignored by most people designing educational products because they're striving for some platonic ideal of raising a standardized assessment. And they're just missing it. And so when you understand that a child's motivation is central to learning, I mean, one of our internal principles, you can't teach a child something that they don't care to understand. Like if they don't want to understand it, no amount of trying to shove it down their throat will lead to any kind of. of learning outcome whatsoever.

And so when you understand that when you see motivation as essential to learning, you get an immediate feedback loop. And students respond right away. You can tell whether they're learning. Students want more of this. And so I think that this idea that there's a long cycle to measuring improvement is one of the sort of legacies of the educational system that we're still working to shed because we lack a real measure of learning outcomes.

Yeah, 100% agree with that. I mean, I think a huge part of it is the side effect of the way that we do the measurements. And therefore, like, the way that we measure quality, quote unquote, ends up skewing in a very particular way, which has all sorts of downstream consequences. And I think the disconnect that people feel between, well, I've made a product which is better according to this mistaken measure of quality. But gosh, it's just not working in the market. Like, I'm not getting in the reception. It's not that the market doesn't value quality question the assumption. It's maybe what I thought was an indication of better quality is really.

not an indication of better quality. Just to advance that conversation a little bit, something that I struggle with a lot, is that the educational system that we're stuck with today was building children, building outcomes for a world that doesn't really exist anymore. The world has changed so much. And I think one of the issues we have with measuring. quality is for what? I think there's a lot of questions being posed as to what the value of an education actually is in in actual long-term outcomes for children. How should we even think of that?

And how would one advise an ed tech company who's trying to build some platonic ideal in that world for what to do? That's a great question. I think you're basically, I mean, that is the core of the problem, right? It's like, what are we actually building the educational system for and towards what end? And I think, I don't think there's a great answer right now, honestly, and I think it's as much a public policy question as it is a technology question. Like, what are we actually trying to optimize for? And I think all that people are, for what is worth, I think what's starting to happen is people are starting to at least realize that it's broken. And so I think that whole generation of people that sort of went through that system and ended up kind of, you know,

misaligned for the skills that you actually need in the job market today, realizing that system is broken. But I don't think there is like a, there's not a cohesive plan that I've seen that says, like, here's how to actually fix it. And so I wish I knew the answer to that personally, but I don't think there's actually like, I don't think there, I haven't really seen a great solution to it other than sort of very pointwise, oh, we should have more STEM education or we should, you know, get programming in,

in earlier, you know, schools or I think there's sort of these like pointwise solutions that are very tactical, but there are, isn't like a cohesive strategy that I've seen. Yeah, program is an interesting one. Sorry, Keith, you wanted to say something. Go ahead. I think you absolutely have to have an opinion on that fundamental question. If you are building an education company, you have to have an opinion on what is the purpose of education? Because if it's to create more of a certain kind of professional because of a career shortage, that will lead to a whole set of decisions and an assessment of progress. Or if it's, you know, GDP growth or, you know, there's many, I think, mistaken views of what the

purpose of education is. And the fact that that as a culture we don't have alignment on that, you know, that speaks to to the system that's being pulled in so many different directions. I agree. I mean, we hold a very strong unconventional view on it. And it's that the ultimate purpose of education is that children grow up and live happy and productive lives. And even taking something like science, like I think it is an absolute mistake to say that we should teach children and more science because there's a lot of STEM careers out there that need to be filled. That's absolutely the mistaken approach. And many people hold that view.

And it leads towards a bunch of wrong decisions. Why do you think it's mistaken? It's a great long conversation that we're trying to condense it. But I'll give you a data point, which will speak to it. I think if there was a young child who knew that he or she wanted to be a dancer, that's the profession they knew they wanted to be. And there was no chance that they wanted to pursue a STEM career. they should that child too should learn science.

It's not that they should learn science because of a particular career outcome because the implication of that is once I decide that's not their career, then like, forget this. I don't need this knowledge anymore. I think there is a fundamental baseline understanding of the world that you're surrounded by, the way it works, and the habits of thinking that you form by figuring out how the world works. And so science is this body of knowledge, this core knowledge of. about how the world works, and it's a methodology in discovering these truths about the world. And every child should learn that because it will enable them to be a happier and more successful

dancer, just as it will, a happier and more successful programmer. So where do you think the bounds of that kind of end? Is it like computer science and programming? Is it math? Is it writing skills? That's absolutely the right question. And it is the harder question to answer, which is so what does a core fundamental pedagogical, you know, a pedagogy and curriculum consist of in order to maximize for as many

children as possible growing up and living happy and productive lives. Like, there's a lot of healthy debate that should be happening there. I wish that was the debate that was happening. I wish there was agreement on the outcome and the purpose of this all because then we'd be having the right discussion. You know, the industry would be having the right discussion. I love that you make the point that people can live happy or more fulfilled lives by knowing science. I'm not sure that there's a lot of evidence to back that up, but I would like to make

a point and maybe start a discussion on the social case for certain kinds of education, because what certain types of education does bring to kids is critical thinking and the ability to ask hard questions and think skeptically about the world, which seems relevant today for all sorts of reasons. Isn't even a more powerful argument is that when we're educating our kids to be productive citizens of the 21st century. And without an understanding of the scientific method and what science implies for everything, as an example, there's more, right? How can you be that productive citizen? What do you guys think?

Yeah, I mean, I think that's hard to argue with. I think critical thinking skills, science, math, I would argue actually programming just as a framework to think logically and clearly about the world. Writing, I think the ability to communicate effectively. I think these are all just foundational skills regardless of what you end up doing. So no argument for me on that. I think the hard part is can you be happy and productive if you don't have a job? Like, just to bring it back to Earth a little bit is like, if I can't

can't feed my family, am I going to be happy and productive? And that's, I think, kind of like where the boundaries are. But are those separate? Wouldn't you argue as well that if you think clearly and you have great communication skills, you're better positioned to get a job in the world that's being created all around us than otherwise? Maybe. I mean, I'd like to think so.

I'd like to think so. as somebody who, you know, loves reading philosophy and science fiction and, you know, loves music and all these things, I would like to think so. But, you know, like, I think the edge cases are kind of the interesting ones. Like, you know, if you have an English degree and, you know, there's a gross under supply of data scientists, like, that feels like a, like, could that person learn how to do Python and SQL and, like, go get that job? Absolutely. They're smart. They certainly do that. But, like, that, is that, like, a missed opportunity?

Is that person now, like, in an awkward place having taken $100,000 in debt when they probably? should have just like done, you know, could have done something else, not probably, but may have. And those like boundary conditions, I think, are the tough part. I think you have to be really careful with the societal argument, you know, and so there is a subtle switch where you're saying, but what about the societal? This is good for all of us if people learn these skills. And I agree with your restatement of it. It is, you're right, it is good for every one of those individuals to learn those skills because it will help them. But it, but I don't think we can justify this on the grounds of, but it's good for

society. And I'll give you an example. My wife was with someone who was in AP math and science classes in high school. And as a woman who was good at math, she got a lot of pressure to join the math team and be the female math representative for the school. And it was really hard for her for a while because her passion was history and the social sciences. But there was lots of pressure because it would be good for society to have more female representation. And she struggled with that for a little while. Ultimately, she pursued the things that made her more happy and fulfilled, not the thing that other people felt would be good for society because of some metrics that we need to hit. And I think that as soon as you hold a societal standard, you very

quickly start to make decisions which will be at odds with what anyone individual would want for themselves because it's best for society. Yeah. And I think like sort of probing on that a little bit more, to me, the hardest tradeoffs are actually for the individual in those sort of like edge case situations. Like, it's an interesting example. Like, if your passion is in one direction and you could go really deep on that, but all the jobs are in the other direction, like setting aside some baseline level of scientific method and math and you're going to a good college, like that's kind of an interesting

and hard individual tradeoff. And that, I think, starts to get at actually, like, what is the purpose and what are you optimizing for as a system? because I think in a lot of those cases, I think there are, you know, you can look at, let's say, unemployment rates for people who have a college degree, and it's actually relatively low, right? It's below 5%. And it's really like whether or not you have that college degree that changes whether or not you're employed. But there are a lot of nuances to that. There's underemployment. There's how, you know, what kind of salary growth potential do you have? And I think, I don't know, I think I take a little bit more of a pragmatic approach of like probably more people should be getting computer science degrees and like learning data science. And that's like, like, If more people want to be giving computer science degree. But it's a critical and important part of being happy and fulfilled that you have a job that pays you well and that you can feed your family and you feel comfortable. And like that's an important part above and beyond like your knowledge. It's a whole separate conversation whether you believe that having a job is a critical part of happiness.

Because and it's easy for those of us who have the sorts of jobs that frankly the people in this room have where they're, you know, we're the opposite of wage slaves, which is what most people are. And so that's a different conversation. But it is interesting to talk about the societal goals of education. I mean, education, public education, United States was for the benefit of society as opposed to the individuals. I don't think people necessarily knew that getting people ready to be good factory workers was good for them. It was more about, we need factory workers, so we better. educate them sufficiently so they can they can be good. Let's let's bring the conversation

back to education technology. My hope is that educational technology helps both individuals at society achieve outcomes that that that we we in this room and in the country would be happy with. What do you guys today recommend when you meet an ed tech founder? I suspect you probably say different things. Maybe you can each in turn say, like if someone tells you about their tech startup, it's a hard general question to answer. But where do you guys sort of go with your advice? Do you, I'll start with you of each other. Do you sort of channel your 2011 self?

Or do you talk about sort of how the world's changing and the opportunities that are thus created? Yeah, I try to channel Keith a little bit and I ask them what their motivations are and try to do what's good for the individual. because I don't think there's a right answer. There are a lot of reasons that people might want to start an education company. And so I think the foundational thing is really what is your motivation and why are you doing it? And I think, especially in Silicon Valley, there's too much of a lens of, well, if it's not a billion dollar outcome or if it's not a $10 billion exit, it doesn't matter. And there are lots of motivations that people may have. And so the first step, I think, is what is your motivation? And there are lots of great businesses that people should start and could start that would have very, very meaningful impact on people's lives and in their communities. And there'll be $50 million businesses or $100 million businesses, and that's fantastic. Like, people should go do those things. But if that's kind of the zone that you're in and that's your motivation and that's what you want to do, then it comes down to, well, what are the right tactics to executing on that? And how do you stay really smart about it? Because the worst possible scenario would be you had this great thing.

It was actually working. But for example, tactically, you just ended up raising money in the wrong way. And now you've kind of gutted your company because you don't actually control it. You had these options. They're mispriced. Nobody can actually make money by being at your company, so all your best people leave. You can under this bad death spiral if you, like, you know, grew your company in the wrong way. So I think the fundamental thing is, what is your motivation?

Why do you want to do it? Okay, let's figure out what the best way to make that happen is. And there are tons and tons of great education and ed tech businesses that are all on that spectrum. Sounds not too different than any other startup. Any other startups in that way. Tactically, then, the specific thing that I say about education is I try to get people to really double down in their understanding of what is the actual thing that you want to accomplish? You have your motivations, and then if you're successful,

a certain thing will happen in the world, and is the path that you're on the best way to necessarily make that thing happen in the world? Are you better off, for example, if you're really into computer science education, there are lots of ways to make that happen that are not necessarily an education product, right? Are you actually better off trying to do job retraining?

Are you actually better off doing it outside of school? Are you better off doing it inside of school? Is it actually at the high school level or at college level? Are you going to target subpopulation? There's so many ways. to actually go about making that happen that are sort of adjacent to ed tech. And so I think this kind of gets out

as like, what is ed tech exactly is an open question? And they're kind of like ed tech heavy and ed tech light and ed tech adjacent. Yeah, we've really sort of skirted over the fact that actually Keith mentioned in the beginning, there's so many aspects to ed tech. You can slice and dice in many ways

from the homeschool market to the elementary school market to the high school and post-secondary market to training sorts of markets. At YC we funded lots of schools that train folks for... Inside Data Fellows is a great example. Inside data, Lambda School is training people to be programmers. So it's actually a pretty broad field. It seems like the opportunity is only grown in what we're broadly calling Ed Tech.

Even in the United States, Asia completely aside, right? Yeah, totally. Yeah, and I think those, actually, those things that are a little bit more on the fringes to me are some of the most interesting because they start to sort of redefine what it means to get an education or they redefine outside the bounds of this sort of like public education, you know, real estate funded, tax funded sort of model and start to start to explore what it means to actually get an education. And stay educated. And stay educated and stay educated throughout your life. And I think those kinds of models are actually where there's a lot of potential innovation because they're free from a lot of the constraints that exist in these. models that have existed for 50 or 100 years. And that freedom, I think, breeds a lot of innovation. I agree with most of what I Joel said, particularly with regards to giving some of advice

on picking a business they're going to start. And most of my focus as well is on, you know, well, what are you going to be so excited to work on that you're not going to give up after two, three, four years? Because it's probably going to take you 10 years. So that, you know, that kind of heuristic when you're picking a business is more important than almost anything else. But specific to the education space, I think there's one, the most contrarian thing that I would share with someone is that the education space, you know, I like to say that we're a learning company, not an education company. I'm very interested in learning and how to improve learning. And when you think of yourself as a learning company, learning is a field that's in its infancy right now. And it's deceptive because it's an old industry.

So it feels like, well, we figured all this out. And, you know, it's just like, I don't know, some efficiency gains that are left and things like that. But to me, learning is much more like genetic engineering or, you know, in figuring out how to arbitrarily sequence DNA and inject it into an organism. Like the level of understanding we have about that, like we're still poking this black box of genetic engineering and trying to make stuff happen for the first time. That's the state of learning. And fundamentally, we, even though science has progressed for so long, the science of the mind is still at, such a beginning. You take a field like physics, and we know so much about, you know, the furthest corners of the universe and the subatomic level, whereas our level of understanding of psychology

is at this, is that the level of physics when it was, well, maybe the gods are angry and they're shaking the ground, and that's why there's an earthquake. Like, we're still not that far beyond Freud, where it's like, I don't know, maybe you went into this profession because your parents had a particular relationship with you and they steered you in that direction. It's, it's very much like opening a computer. and noticing that when you press this sequence of buttons, this part heats up. Like, that's our level of understanding of the brain. It's like we image this thing and we notice where the blood flows and try and draw these conclusions about how it's working.

So if you, anyone who wants to start a company in the learning space, to the extent that you really think, focus on understanding the science of learning, it's a wide open territory. Like we are actually still discovering profound truths about even something as simple as like space repetition and the power of that or or the role of concept formation and what's the difference between being able to recite a fact and actually holding that fact as knowledge. Like we're at the beginning of a science and to the extent you figure out anything new, there's huge business implications of that. Are you optimistic, Keith, that we'll figure it out and that we'll see a transformation in American education over the next five, 10, 15, 20 years that will actually make for better outcomes for individuals and society? And then maybe of eachel, if you could answer the same question afterwards, we can sort of close on that note. Absolutely. I mean, I will say I'm long on the human race, right? So we are very good at figuring things out and mastering sciences and plumbing them to new depths.

And we will do that for learning and for pedagogy as we have for all of the other sciences. And, you know, there is this industry and this infrastructure, this education infrastructure, that will crumble and go away and be replaced by another version and another version. And what's so exciting about the Internet is, you know, the Internet generally and mobile in particular, is these disruptive forces give you these opportunities. to rebuild the whole stack from the ground up. So most likely the business opportunities in the learning space will be outside of the existing stack.

Like, it's the fact that you can go straight to teachers and not have to go through an approval process is dramatically changing things. The fact that there's an internet and the cost structure fundamentally changes. And to parents too, right? So the science is wide open. The industry is going to be transformed multiple times

in the next decade, and we will take learning to the next level. Yeah, I'm hard to argue with not being optimistic about the human race. Yeah, very optimistic about it. No, I'm optimistic. Many people wouldn't. Yeah, no, at least as entrepreneurs, it's hard. You have to be an optimist, right? Like, you can't imagine you're going to change the world for the better if you aren't.

It's almost a definition of an entrepreneur. It's an optimist. You know it's impossible, but you're still going to go. Yeah, it's like, how do you decouple that, right? So as an entrepreneur, I think it's hard to separate that. And so all of my beliefs are tinged by that personality trait. But what I would say is I am very optimistic about the experiments that are happening by, you know, reaching teachers in new ways, reaching parents in new ways, platforms like the iPhone or Android or iPad, Chromebook,

that sort of allow people to interact with information in novel and new and interesting ways. And things that are happening on the fringes, things that are education but don't look like education. I think Insight is a good example. I think people sort of exploring the internet on their own and kind of going down a rabbit hole of open source or YouTube as a platform with Khan Academy. I think there are all these really interesting things happening on the fringes where some of them look like education, some of them look more like learning and some of them look like job training. They all kind of have different flavors. I'm less optimistic about the likelihood that we dramatically change the state of public education in the environment. United States anytime soon because there's just so many entrenched components to that from funding

to the psychology that Keith was talking about where like for the first couple of years it's really on the parent and then there's a handout. There's so many like cultural and governmental and public policy things kind of rolled into that. I think unbundling that is going to take a long time. But I think there are a lot of entrepreneurs kind of on the fringes that are doing really interesting things that that's often how disruption happens, right? It kind of comes from the side a little bit in very unexpected ways. And the timing can surprise you. So maybe we can leave on a slightly more optimistic note, which is that I think even in public education, we know a lot of what the solutions ought to be. So we're kind of in a unique position

where there's a lot of structural reasons. It's hard to close the achievement gap and to overall improve outcomes. But we do know a lot of the outcomes. So since the stakes couldn't be higher, I think that we have good reason to believe that that those, that not, that not knowledge will eventually matter and that things will get better. I want to thank you both for podcasting with me this afternoon. It's been a great conversation. I've enjoyed it a lot. Thanks. Likewise. Thanks. All right. Thanks for listening. So as always, you can find the transcript and video at blog.combinator.com. And if you have a second, it would be awesome to give us a rating and review wherever you find your podcast. See you next time.