Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 278 | Kieran Healy on the Technology of Ranking People

Episode Date: June 10, 2024

We claim to love all of our children, friends, and students equally. But perhaps deep down you assign a ranking to them, from favorite to not-so-favorite. Ranking and quantifying people is an irresist...ible human tendency, and modern technology has made it ubiquitous. In this episode I talk with sociologist Kieran Healy, who has co-authored (with Marion Fourcade) the new book The Ordinal Society, about how our lives are measured and processed by the technological ecosystem around us. We discuss how this has changed how relate to ourselves and the wider world. Support Mindscape on Patreon. Blog post with transcript: https://www.preposterousuniverse.com/podcast/2024/06/10/278-kieran-healy-on-the-technology-of-ranking-people/ Kieran Healy received his Ph.D. in sociology from Princeton University. He is currently a professor of sociology at Duke University, and a member of the Kenan Institute for Ethics. As an undergraduate at University College Cork he won the Irish Times National Debating competition. He has a longstanding interest in data visualization. Web site Duke web page Google Scholar publications Wikipedia

Transcript
Discussion (0)
Starting point is 00:00:01 With the new My Lowe's Pro Rewards American Express card, earn three points per dollar spent on Lowe's qualifying purchases for the first six months after card account opening. Plus, save 5% every day on eligible purchases at Lowe's and earn points on eligible purchases everywhere else MX is accepted. Card members get more at Lowe's. Subject to credit approval. 5% can't be combined with any other offer.
Starting point is 00:00:21 Exclusions and restrictions apply. Points subject to loyalty terms at Lose.com slash terms and credit reward terms at synchrony.com slash MLPRA dash terms. Visit Lose.com slash business credit. Wellness looks different at every season. The right support makes all the difference. Elevate daily wellness with vital proteins advanced collagen plus colostrum and prebiotic fiber. This three-in-one blend supports radiant skin, gut health, and immune system wellness, designed to mix into room temperature or cold liquids.
Starting point is 00:00:47 So your inner harmony works with your outer wellness. Vital Proteins. Stay vital. Visit VitalProtene's.com to get started. These statements have not been evaluated by the Food and Drug Administration. These products are not intended to diagnose, treat cure, or prevent any disease in combination with resistance exercise. Hello, everyone. Welcome to the Mindscape Podcast. I'm your host, Sean Carroll. I wanted to start today's podcast by reading a paragraph from a new book called The Ordinal Society by Marianne Forkod and Kieran Healy. So it goes like this. The idea of modernity has long been seen as having two
Starting point is 00:01:19 contending aspects. On one side, the side of social organization, is the domain of rationalization and control. This is the modernity of bureaucracy, science, technology, and planning. It is the technocratic, sansimonian vision of a society run on rational principles and devoted to the elevation of humanity in the abstract. Here, the administrative task of modern organizations is to know and manage their subjects. On the other side, the side of the individual is the domain of experience and expression.
Starting point is 00:01:52 This is the modernity of the Romantics, of the full and authentic realization of the self and all its powers. Here, the exorcist, task of modern individuals is to know and create themselves. I like this paragraph because, you know, there's a little bit of historical resonance there, but also the contrast or the dilemma here is very real between the organizational systems-oriented view of the world and how that can bring about tremendous real benefits versus the romantic individual, you know, ignoring the system and going their own way. I think that for whatever reason in the modern world, we prefer to personally identify with the romantic individual. But, you know, as we will talk about in this podcast, the modern
Starting point is 00:02:39 world offers all sorts of conveniences and services that are only available to us if we kind of do agree to participate in the broader system. You know, I recently noticed when you go to the Apple App Store and you want to download an app, they tell you. what information the app gathers about you, your location data, you know, your information from other websites or whatever, and where it sends it to. So in principle, you could just not download any app that collected information about you that you didn't want it to. I'm betting that in practice, most people go ahead and just download the app, right? Because the app is useful. It's not like there's no point to do it. I bet that most people use Google Maps when they want to go
Starting point is 00:03:26 somewhere, even if that means Google knows where they're going. I've noticed that Google Maps will sometimes tell me where I parked my car. That's, on the one hand, a little weird that Google's keeping track of where I park my car. On the other hand, super convenient because I am often not very good at keeping track of where I parked my car. So today's guest is Kieran Healy. He's one of the co-authors of the new book, and the idea is the ways in which the modern world not just keeps track of us, but classifies us, right? The ordinal society is one in which people are characterized and ranked in all sorts of different ways. Ranking people has been something that has been going on forever, of course, but technology
Starting point is 00:04:09 has enabled it to happen at an enormous rate, from very simple things like a credit score to hyper finely divided ways, like what ads you get served up when you go to Amazon or Google or YouTube or what have you. And these forces are somewhat invisible, but all pervasive, and apparently they really matter to our lives. You know, a lot of people are, when you buy a new dishwasher, you buy a smart dishwasher, and it sends information to the dishwasher company about how often you're washing your dishes. And where do we draw the line? Where do we decide how much convenience is worthwhile versus how much individuality and romantic experience is worthwhile. I think these are questions we're going to have to be struggling with more and more because these systems of surveillance and classification are not going away anytime
Starting point is 00:05:06 soon. So let's go. Here in Healy, welcome to Blindscape Podcast. Delighted to be here. I think we got to start with a question you will find, embarrassingly simple. What is the word ordinal mean to you? You have it in the title of your book. Yes, I know. And I get, you know, it's funny, I've gotten kind of when I, when I, I've been talking about the book online or to other people, you know, immediately the mathematicians and the physicists come out and I get a lot of, you know, quite, quite abstruse jokes. You know, what is this? Yeah. Right. What does this mean? Yeah. So in this case, it's fundamentally focused on the idea of ranking, although it's twofold, right? So first of all, and most importantly, it's the idea that, you know, we live in a world where the pairing of kind of massive data sets with various processes, you know, algorithmic, broadly conceived, statistical, you know, mathematical written in code of some kind have made inroads into every social institution. And techniques of optimization and data collection are deployed to kind of streamline and organize processes across those institutions, a whole wide range of things. And the way they work is to take kind of information or data in computationally and spit out scores and especially rankings, ordering, out the other side.
Starting point is 00:06:55 And so fundamentally, the idea of ordinality or an ordinal society is one that's based around and justified by the idea of kind of measurement and ranking. I will say, too, though, there's a second piece to it a little bit, which comes. So, Marion Foucaud, who co-authored this book with me is French. Originally, she teaches in Berkeley now. but in in French, the word for a computer is ordinateur. Oh. And the reason that it is that word is when in in 1956 or so, the IBM launched the IBM 650, which was its first kind of really mass-produced machine.
Starting point is 00:07:45 It surprised them how much the demand, you know, for it was amongst businesses. And when IBM, France, came to sell it, they had to decide what to call it, like what to call this class of device. And the natural choice would have been calculator, which is the direct translation of computer. But they consulted in a very French way, you know, you have to be careful about what were things are going to call. They consulted with this guy Jacques Perre, who was a professor of Latin at the Sorbonne. on. And he objected. And he said, what about ordinator? He said, it's a, you know, it's a correctly formed word. It's in the dictionary. And he thought, and it, and it's ultimate root is to do with ordination, the word ordination, like a religious sense of a God who brings order to the world.
Starting point is 00:08:37 And he says, but that theological usage is infrequent. So you could call it an ordinator. And yeah, and so that was his, that's what IBM picked. And so the idea of kind of, kind of calculation as an ordering in the ordinality, as an ordering in the kind of just ordinary mathematical sense of first, second, third, fourth, but then also as a device that brings order to the world. That's what we have in mind. I love the idea of Google consulting a Latin professor before, you know, it's a different world. Right. Very much so. So, but of course, we have ranked people and classified them all the time. I mean, you and I are academics. We live in a world where half of our time is spent deciding who's better than, you know, who else. So you're
Starting point is 00:09:26 specifically focusing on how much better we are at it now because exactly of the computer age. Or how much more pervasive it is. Yeah. One of the things we do want to kind of emphasize in the book is that it's not the case that, like, the fact of ranking and ordering people is a sort of fundamental aspect of human social organization. And we do that. Whenever there's differentiation, you implicitly have the chance of some sort of ordering or ranking of classes or categories of people comes out. So that is not new at all. In fact, it's kind of an endemic feature of just how human societies are organized.
Starting point is 00:10:05 And then there's also a long history of kind of devices and methods and techniques that we have for doing this that goes all the way back to. you know, to the very, you know, the beginnings of all the way back to double entry bookkeeping or, you know, that bring an ordering of things to businesses to sort of mundane devices like the filing cabinet or the card index in the 19th century, which really were kind of revolutionary in their way. Yeah. But what's new now is, and what's really sort of transformed not just in sort of scale, but also in scope over the last 50 years or so is that the ability to do this has both become
Starting point is 00:10:51 much more fine-grained and much more widespread. The scope that we can, the degree to which we can sort of apply these ideas and processes is sort of much wider, a whole range of kind of forms of social life that were just not within reach of any kind of measurement, certainly not any kind of real-time measurement has really expanded. And then the degree of kind of granularity of that has also been transformed as well. I will mention for those of you who are just listening over audio that Kieran in the background has an original Apple Macintosh computer here. And is it a working model? Oh, absolutely. It works. Yeah.
Starting point is 00:11:37 So when we talk about the history here, you know, you and I both live through a lot of it anyway. And you know what... Yeah, yeah, no, we're in that sort of, I think, just about in that intermediate generation that is cursed to explain computers both to people older than us and to people younger than us. There are worse curses than that. And so just so the audience gets in mind what we're talking about here, it's not just rankings that you're concerned with in the book. I mean, it's just the very...
Starting point is 00:12:05 It's kind of a classification ability as well, yeah? Yeah, yeah. Yeah, so on those two things are very closely connected, right? That there's two processes. Before you can rank things, you must name them first, right? And so there's a process of classification that takes place, which is sort of identifying categories and deciding which things fall into which categories. So the sort of nominalizing thing that this is an instance of that.
Starting point is 00:12:35 This other thing is an instance of the second thing. So that's sort of, you know, so we say, as we've, say in the book, you know, machines classify because people do in the same ways and they rank because because people do. But there's always this kind of, there's always a very strong tendency then for for nominal classifications, which should be unordered or which, you know, which are not, which are, you know, which are, you know, often on order to turn into rankings and, and, and then positioning people within those things. You know, Plato famously said that one of the jobs of philosophies to carve nature at its joints, right? So we're handing that job over to our computers now in some way. Yeah, I mean, to a large degree.
Starting point is 00:13:21 And certainly kind of the one of the, we're handing it over to them and they're extremely powerful and fast. And the legitimacy that we invest or that these things, these systems often come to have drives in part from this idea that they are in fact, you know, that this is a real, that you're really picking up on something real in the world and that you're doing it with a degree of precision and accuracy that hasn't been, hasn't been possible in the past. And of course, we know, like anybody who's worked with data of any kind in a quantitative form, is going to be well aware of just how difficult it is to kind of cleanly collect information. that truthfully reflects the way things are.
Starting point is 00:14:11 And then with social data in particular, there's all kinds of additional complexities about the degree to which you're imposing your framework. When I, in talks with this stuff, I do have, to go back to the carving nature at the joints thing, I sometimes refer to that idea. And I have a little slide from an American cookbook that I have and a French one showing the very different cuts. of beef that exist in different in France and the United States. And so, you know, even, you know, butchers carve nature of the joints quite differently. So there's heterogeneity, even if ultimately there's still a cow under there.
Starting point is 00:14:51 There are different ways to cut it up. Okay. So can we talk about Defiwear for a second? Because I'm a little obsessed. They have the cutest sunglasses and prescription frames. And honestly, the vibe is like, whatever you're feeling that day, there's a pair for it. Chill day, got you. Going out, got you.
Starting point is 00:15:06 and every purchase gives back, which I love. Go to diffiware.com and define your style. That's diffiware.com. You're welcome. When people turn to telehealth for weight loss, they're looking for real support. That's why more people are choosing orderly meds.com. Orderly meds connects you with real doctors and access to proven GLP1 medications like semaglutide and terseptitide.
Starting point is 00:15:30 No guessing, just a more supportive experience. And all shift directly to your door in discrete packaging. Do your research. Ask questions. visit orderlymeds.com slash podcast for an exclusive offer. That's orderly meds.com slash podcast. Individual results may vary not medical advice. Eligibility required seaside for details. I don't know if you noticed just today, and I think it was in Vox. They had an analysis of the U.S. House of Representatives. And to your point of the data are hard to sometimes get, and therefore,
Starting point is 00:16:03 you can get better results. But also we have the categories that we testify to that we claim we're members of, and then we have the categories that are actually borne out by our actions, right? So in this article, they went through all the voting patterns of different members of Congress and grouped them into eight groups on the basis of affinity of that voting. So on the flip side, you can actually reveal categories that were there all along, but we didn't mention them, yeah? Yeah, and that's one of the main sources of the kind of power and legitimacy of these kinds of classifications and methods of data collection and analysis. Because like I say, for the longest time, organizations of all
Starting point is 00:16:48 kinds, whether it's businesses or in the longer term the state, have been very interested in discovering information about either the customers that they have or the citizens that make up or the people whom they govern. And but it turns out, you know, for a long time, it was extremely difficult to do this in any kind of reasonable, at any kind of reasonable speed. And so you have a census every 10 years, or maybe you collect sort of sample surveys.
Starting point is 00:17:19 And indeed, you know, the idea of statistics, the word stat in there is closely related to the state. As a, you know, it's information about a population. The promise and the, of, of these new methods is that with the expansion of all of these methods of data collection, initially kind of on the desks and then ultimately in your pocket of you're getting a record increasingly of individual and social activity that isn't just dependent the promises. It isn't just about kind of asking people what it is they think or what it is that they,
Starting point is 00:18:01 you know, how it is they would want to be classified. You also get this essentially, the promise of essentially behavioral data about people, which you want to say is kind of more truthful. And so that leads immediately to this idea that there's a, you know, at the level of the classifiers, a lot of legitimacy associated with, look, I'm capturing what you're actually doing. You know, if I ask you how many steps you walked today, you might tell me one number, maybe you're bad at guessing it,
Starting point is 00:18:32 or maybe you prefer to think it was a little higher than it is, but your watch on your wrist knows. And so that behavioral data is both very valuable, and it does kind of capture something that's much more accurate, in some sense about what people are actually doing. But then it also provides this kind of tremendous legitimacy to the classifications that you develop from it. And it introduces the possibility of saying,
Starting point is 00:18:55 well, you know, the things that flow from you being in one of these categories, are really, you know, your own fault or your own virtue, depending on what the, you know, if you're well classified, you experience it as being kind of a virtuous and sort of sense of that, you know, you're correctly, you're correctly classified. And if you're in a, if you're in a sort of poor, if you're in a poorer category, the idea is that then you're to blame for your own, you know, for your own social situation. Well, there's, there's definitely an idea lurking in the background of the book. I mean, maybe you say very explicitly, and I just, sort of glossed over. But we have an idea in the modern liberal world that we forge ourselves,
Starting point is 00:19:39 right, that we create who we are and we have an image of ourselves and maybe we don't always live up to it, but okay, we're trying, you know, good for us. And what you're driving home is that every corporation, you know, Amazon and Apple and Facebook and whatever, ever, has an image of us. Like, they know who we are in maybe a very different way. And it's disconcerting to think both that they have that and that it's not who we think we are. Yeah. And then there's that point where those two things coincide, right? And so, yes, like one distinctive feature of modernity of the idea of existing in the world
Starting point is 00:20:19 that we're in now is the idea that individuals are kind of autonomous agents with their own preferences and rights, who make their own decisions in the world, who are going about sort of choosing to do things and are kind of empowered, active, agentic is the word often that sociologists will use, you know, imbued with this kind of sense of, look, a busy little person going around and, and, you know, making their own choices. And then on the other hand, you have this idea of kind of this, this sea of recorded. information about us yields this sort of set of digital traces that produce this kind of shadow of ourselves, a data double of ourselves, if you like. That's a phrase that Dan Buch is a historian
Starting point is 00:21:09 coined that that kind of represents us truthfully in some sense. And that kind of organizations can know about us. And so our sense of agency or a sense of being a kind of active person in the world is very closely bound up with our feelings of authenticity, like of being true to ourselves, you know, this kind of romantic conception of being, of being true to ourselves. But then the measurement and the representations in numbers and records that exist of us is very closely connected to sort of our need to be authenticated, you know, formally by organ. And those two processes kind of coincide that, you know, the world we're in kind of, on the one hand, you're enjoined to be really yourself in the authenticity sense.
Starting point is 00:22:00 But then also there's organizations are very concerned to know whether you're really who you say you are. That is in the sense of kind of that it's necessary that you be authenticated as you as an identity rather than as somebody, you know, as a somebody impersonating you or and so on. And maybe the scale of this kind of operation makes it hard for people to visualize what's going on. I mean, if I worked at Amazon, I mean, clearly somewhere buried in the bowels of a data center is some list of correlations of all the things I've ever purchased or shopped for or whatever. But could a person working at Amazon sit at a terminal and call up a profile of somebody? It seems impractical. There's a lot of customers out there. There are a lot of customers out there. Yeah.
Starting point is 00:22:49 And that's, I mean, ultimately, they probably could, whether there's. where, you know, somebody can. That's there. I mean, the, the, the, it is true, though, that sort of the, it's not a question. Most of the time, organizations are not specifically interested in you or me. Right. You know, we're not, we're not particularly interesting or important enough. And so, which is one of the reasons perhaps that you're, you know, your Amazon recommendations might be weird or, you know, or governed by other things.
Starting point is 00:23:16 It's not, you know, one promise of all of this stuff is that, that, that, that, that, again, speaking to language of personal authenticity and tailoring, that everything could be personalized to you and that the recommendations that Sean Carroll gets on Amazon would just be perfect. But then it's very common for us to have this experience of like saying, oh, I've been an Amazon customer or a customer of some other similar organization for a couple of decades and they recommend these things to me. And I don't know why I get them. So again, this is the actual kind of the demands of doing this practically are quite strong. Organizations know and very strong. strongly feel that they should be collecting this kind of level of granular data about you.
Starting point is 00:23:58 And they will boast sort of internally or they will organize themselves. We call this kind of the data imperative. Like they know that this is something they should be doing. And there's a whole infrastructure. There's a whole set of occupations of people who tend data lakes and who manage data infrastructures about individuals. And as Matchit Cajlowski has said, you know, the whole, the whole imagery of that, the metaphorical imagery of it, is like a kind of accident waiting to happen.
Starting point is 00:24:28 You know, this data lake is dammed up behind a barrier that could crack at any time or be overflowed and you get a, you know, released into the world. So it's, so on the one hand, it's very difficult in practice to get that kind of granularity and ease of access to data, but a particular person have it be useful. On the other hand, there are the leading edge of this or the best institutionalized versions of these scores. Really do exist and are used all the time. The credit score is the most obvious one in the United States, where you have exactly that kind of a single number that characterizes your behavior in a way that you are sort of morally responsible for, that reflects your actual behavior when it comes to paying your debts or not. and that any shop assistant can call up and decide whether to make, you know, you a store credit offer or something like that. And whose initial usage in relatively restricted circumstances has blossomed out into kind of,
Starting point is 00:25:36 much like the driver's license, you know, becomes effectively a national identity card, a credit score becomes the gateway to having a harder or easier time in areas where, it was never really initially designed to be applied at all. Well, let's, this is, yeah, this says many juicy things to talk about here that we've leapt ahead, but you do open the book with some history, and it's fascinating. You know, in the halcyon early days of computers and the internet and so forth, the expectations of where these capacities would go were very different than where they ended up ending up. Yes, very much so.
Starting point is 00:26:17 I mean, there's this period beginning, you know, the prehistory of this in the 1960s and 70s when computing is, as we know it, is kind of becoming established and just getting off the ground, is this strange fusion on the one hand of what we think of as the more Dr. Strange Love almost elements of, you know, computers come out of the war, of code breaking, of defense systems and, you know, command and control. methods for missiles and all of that kind of stuff. And at the same time, really from the beginning, you also have this kind of like hacker culture amongst engineers who want to tinker and experiment and mess around with. In that sort of familiar kind of scientifically sort of let's see, let's push this and see where it can go, that's quite flat and sort of libertarian in its way,
Starting point is 00:27:11 you know, where people just want to be left alone and mess blue sky research type stuff, just want to be left alone and do their thing. And as computers take their kind of modern form through the hobbyist era of the 1970s into their kind of expansion into business and society at large in the 1980s and 1990s, those two tendencies kind of continue to coexist. And so by the 90s, when the Internet and the World Wide Web in particular becomes kind of starts to, is developed and becomes widely available as a protocol of the web. there is this kind of, that's the sort of high watermark in a lot of ways of excitement about the kind of pure freedom associated with just setting out on your own, setting up your website, you know, these homestead dreams, we call them.
Starting point is 00:28:01 And that language of kind of digital homesteading, Howard Brindgold was a, you know, use that term at the time, people just kind of, this is a place where we can be free of all of the, in effect, of the world of ranking and of the world of local status and of the suffocating kind of what John Perry Barlow calls the weary giants of flesh and steel, right?
Starting point is 00:28:26 They had this image of cyberspace sort of being a kind of free-for-all a new frontier where the dead hand of kind of post-war suburban industrial society would no longer touch you and you can just be yourself. Again, the,
Starting point is 00:28:44 again, the romantic image of a homesteader empowered by technology. And that was really kind of the beginning of, yeah, that's where we started, a very different kind of set of associations having to do with what this new networking technology, what this new, these new protocols would enable. Well, and it's very common that people trying to predict what the impact of a new technology is going to be, get it wildly wrong. And maybe it's just because of wishful thinking or whatever, but looking back on examples of this and with some sociological wisdom in the background, are there systematic ways that people get these futuristic scenarios wrong? Or should we be better at predicting? Is there some equilibrium we're always going to go to? Yeah. I mean, as the kind of conventional wisdom goes correctly, there's, you know, nothing defines an era better than its vision of the future.
Starting point is 00:29:40 And there are moments when, yeah, this sense of kind of a set of possibilities that existed and then were in some sense closed off or that's not how things turned out. It's extremely common. It's extremely common. It is a very common story. And the main thing that happens, I suppose, is people project their own desires about what an ideal world would be onto whatever the sort of social change, often a technological change, but not always, you know, what that seems to enable. And then as it sort of, as it goes on, and things don't quite work out that way, one of the things
Starting point is 00:30:26 that can happen is that the initial, especially for the sort of utopian visions of things, there can be a kind of immense disappointment amongst the utopian vanguard with everyone else and their failure. The rest of the world let us down. Yeah, I think that's a very common feature. Sort of revolutionaries end up with kind of a disappointment verging on contempt for the peasants that they have liberated. And, you know, one of the things that happened in the development of the World Wide Web
Starting point is 00:30:58 was this transition to, from the, the kind of homestead era, people sort of said, well, this is great. I love being online. I love talking to my friends. I love being able to be in touch with people who are like me. I didn't know their worst often, you know, people just like me and lots of them. Then I can, you know, that really was a kind of liberating feature of these kinds of technologies. However, I would, I don't want to run my own website or I would rather not administer my own servers. Or, you know, could you just, I need to find people more quickly and more effectively. Can someone take care of that for me? And there is a, there is a sort of tendency to think, and this is something that's, it's out in the
Starting point is 00:31:41 world, but it's also kind of a feature of kind of social criticism of and theorizing about kind of the internet. There is the tendency to think that the kind of much more suburbanized, centralized, you know, perhaps hierarchical internet that we ended up with was imposed on people very much against their will. It was certainly imposed on some people against their will, the original homesteaders, but a lot of it was very much kind of demand driven and people where people kind of preferred the convenience of somebody else taking care of these things for them in order to get what they wanted, which was often the kind of sheer sociability, but not all of the associated kind of system administration. And they would prefer people to take care of that. And so it is, It's tempting to think that, you know, oh, we could have had nice things, but then the corporations came along and sort of made this world terrible for us. Now, it's not that it's not that there's nothing to that critique, but it is the case that, you know, people do want different things. And one of the things people really wanted was convenience and the ability to just get to the kind of fun social part, which in part, which in part, to the concentration of infrastructure that we kind of now have with a small number of companies
Starting point is 00:33:01 and platforms facilitating just that sort of thing. And there are many cases where, you know, companies try to impose their way of doing things on an individual and failed. And we have this, a lot of failed giants in the first dot-com era and afterwards. So it's not that people are duped, but it's a more complicated process because on the one hand, people, companies are trying to guess what people want, but on the other hand, people then are always tend to kind of overflow or do things with technologies that the, that the, that the, uh, people seeking to kind of run them, um, don't expect a lot of the time. From the writers of parenthood and life as we know
Starting point is 00:33:44 it comes, it's not like that. A new family drama about starting over and second chances. Scott Foley stars as Malcolm, a recently widowed pastor and dad of three. And Aaron Hayes is, Lori, newly divorced with two teens. Their families used to do everything together. Now they're navigating single parenthood and maybe something more. Watch, it's not like that. All episodes streaming May 15th on Prime Video. Well, clearly we're at another moment right now with LLMs and artificial intelligence
Starting point is 00:34:16 where there's a new set of utopians coming in to promise us things. And so I'm just trying to figure out like how do we avoid making the same mistakes again? Clearly one feature of humanity is that there will be a bunch of rapacious capitalists or whatever the version of people who want to accrue power to themselves. And on the other hand, there's going to be a large number of people who will vote for convenience over freedom every time. And so does that help us guess what kind of future AI will bring about? I think that there's a lot of similarities to, I mean, Open AI is its own, I don't know, Open AI, the specific company, but the large language models and artificial intelligence generally are its own, is its own sort of technology with its own distinctive features. And so nothing, things don't, things don't happen exactly the same way. But the way that, the way that things are rolling out, with a lot of this stuff is quite similar to things that have happened, things that have happened before. And so we get sort of, one of the, one of the main ways this tends to happen
Starting point is 00:35:36 as this transition to, from a world of initial technology with seemingly infinite possibilities to one where, you know, there's a smaller group where those possibilities seem to narrow, and then we're stuck with things that we have difficulties with, is that the initial technology really is amazing and delightful and astonishing to people. And I think, again, this is sort of something that's easy to underplay if you're a cranky social critic who's sort of just sick of, that we start with somebody, you know, someone our age
Starting point is 00:36:17 might think of the first time that they used the World Wide Web. or for a time that they saw a webpage load. Personally, in my case, it was as an undergraduate in my friend Owen's physics lab. He was a master's student, and they had a deck alpha running NCSA mosaic, and we downloaded pictures of Mars from the JPL. And like, we didn't have any reason. I didn't have any reason to, I was a social science student. I didn't have any reason to, I didn't need pictures of Mars.
Starting point is 00:36:48 but just the fact that you could do it, that there was this, you could talk to this computer in Pasadena and it would serve up these things to you. You know, that was incredible. And then similarly, you know, a decade later, it's, you know, you have a phone in your pocket that can render a map of your current location
Starting point is 00:37:05 and show you things around. And it's just, you're just holding it. That's amazing. And a decade after that, you take a descendant of that phone out of your pocket and you touch the buttons and you can summon a car to take you wherever you want. want to go. And now it's kind of like, oh, you know, you take that same device out of your pocket
Starting point is 00:37:24 and you ask it a question and it speaks or it can generate sort of text. So, you know, I don't underestimate at all or discount that that degree of kind of delight. Something else will be this in another 10 years, you know, something else will have that effect on us. Now, how does how do those things kind of play out? How does that moment become kind of the infrastructure that we that we end up with, whether it's the web or everybody in the world who can afford a smartphone owning one, or the platformized world of labor for Uber drivers, you know, with all its exploitative dimensions and undertones and, you know, entrenched ratings. And now again, with kind of artificial intelligence. Well, the first thing that happens is that we get given this for free as a gift,
Starting point is 00:38:08 so to speak. The first thing is true. That it's given away to us. And so one of the reasons that it's delightful is that it's sort of given to us as a, and as any sociologist or anthropologist will tell you, gifts set up these expectations of a return. What we give in return is information about ourselves. And we give information about ourselves, our location, you know, or behavior, who are interacting with, what we want to know, the questions that we ask and so on. And it's from there then that the these organizations then seek to take that information and make it profitable or take that knowledge and make the profitable. And at the beginning, and the web, with the web, especially, that first stage with things like Google search. And that was a real revelation.
Starting point is 00:38:56 Like, it took a while for people to figure that out. That they, you know, that the digital traces and the logs of left behind was actually kind of potentially tremendously valuable. And so with Open AI now and similar companies, the world of large language models, yeah, the question is kind of, I would expect the same sort of, the thing that tends to keep happening is the same sort of concentration of service provision amongst, you know, that you just get a couple of competitors, you know, really not, maybe not directly competing. But we, we saw that with, you know, smartphones, like with, you just, you have Apple and the Google Android. Android platform, and that's kind of it. And we see it with these other platforms as well. The thing that's distinctive about the world of artificial intelligence, or one of the things that's distinctive about its most widespread use cases is that they're now
Starting point is 00:39:59 kind of having trained themselves on the free gift of everything that is the World Wide Web and all its content that was available. now they're in the process of kind of emitting, you know, the effluvia of AI-generated output back into that environment. It's not clear to me what's going to happen. Because, again, one of the things that happened with, you know, a lot of the early, a lot of the sort of, you know, the first 20 years of social activity on the web has gradually declined in terms of its kind of public accessibility. And there's still just as much social activity more than ever, really, taking place. broadly speaking online, but much of it has retreated either to with platforms where you can't see unless you're, you know, or whether it's, you know, with things like messaging or or content,
Starting point is 00:40:48 but, you know, down to things as mundane as having a substack rather than a website being in a Discord or a Slack rather than in a web forum or blog comments and so on, you know, and so the, if all that's left in public is the sort of slop of, uh, of, of, of, of, of, of, of, output, that might pose problems for this technology in the future. Maybe, maybe I think we skipped ahead a lot to talk about this data collection and its implications just because we all know that our data is being collected. We've all seen Amazon serve up its recommendations. But you've thought about this a lot more carefully than most of us.
Starting point is 00:41:27 I mean, what is your overview of the ways in which the data is being collected? Some of them are obvious, but probably some of them are less so to the people who aren't thinking about it all the time. Yeah, there's a couple of different dimensions to this. So the, what's happening? There's, there's such a volume of data that's available to companies now, just because of the gradual expansion of kind of all of these ways for monitoring and tracking individuals. That's often kind of presented just in terms of surveillance, let's say, you know, that it's, that and that it's just people spying on you. But I think that sort of tends to underestimate the degree to which kind of social life in general as a whole is actually is taking
Starting point is 00:42:19 place in these environments where you're being kind of monitored. So it's not, it's not quite that kind of, you know, it's not like street cameras, although that's a part of it too, you know, like spying on on a real world of social activity that's taking place and then kind of, you know, collecting data about it. It's more that the social life itself is now kind of, um, taking place mediated through these technologies. And that's tremendously kind of powerful and a kind of qualitatively different, qualitatively different feature of how the world is now. Because there have always been, or for a long time,
Starting point is 00:42:55 there have been kind of specific sort of settings where that kind of, you know, whatever is happening is essentially happening through as a flow of numbers or as a flow of data in things like finance. financial markets, for example, stock trading, but usually for the first, you know, 100 years of technology along these lines, those were tremendously specialized, narrow environments, right? The idea of capturing kind of every conversation or every joke, every sort of interaction seemed both kind of pointless and was impossible. And so that's changed.
Starting point is 00:43:35 So the breadth of data has really sort of expanded. then the degree to which kind of people, that's changed a couple of things. And one is that at the level of individuals, it's changed how people kind of think about themselves and their public visibility or their visibility to others. So there's a whole set of questions along those lines about kind of how we think of ourselves as having an identity online.
Starting point is 00:44:05 And again, I think this stratifies quite a lot by, by age, probably. We know less about this than I would like, actually, that, you know, that, again, there's a kind of naive version of this that says, oh, there's old fuddy ditties and there's digital natives. And but often the digital natives, what makes them kind of native is not their deep understanding of how these technologies work, but more that they're kind of comfortable swimming around in this environment like fish in the sea without thinking too much about water and how it works.
Starting point is 00:44:35 So that's one set of issues. And then the other side, organizations, companies and states have also been sort of transformed by what they're doing or what they seek to do with this. And just to pick one kind of class of example. One thing that's happening a lot with the kind of embedding of software and data collection devices in everything is that it pairs very well with the kind of. this sort of broader logic of financialization, this idea that kind of what we're interested in doing, what businesses are interested in doing is turning kind of every potential transaction into a stream of income and that a rent, as economists would call it, right? And so to think, you know, in practice, what does that mean?
Starting point is 00:45:28 Well, you know, in a simpler way of doing things, if you buy something, the transaction, you buy a refrigerator or a car or, you know, a tractor. And you buy the thing and, and then you're done, right? You, now you own the thing. And maybe, yeah, it doesn't, right? And, and, but, and maybe, you know, maybe there, maybe the first step is to sort of think, well, if we, again, some of these things go back a long way, the company says, well, we could, we could, we could maintain a relationship by selling you a warranty or by giving you a loan, right, to do it. And so, again, these ideas are not new in that sense, right? That we have, because what the company is interested in is sort of some ongoing stream
Starting point is 00:46:18 of income, that it can then turn around to its own shareholders and say, here is the steady, you know, we don't have to, we know that we're going to be getting this every month for the next five years from the customer. With the arrival of data collection, you know, that now there's like a little computer in your car or your fridge or your or your tractor then suddenly this whole range of possibilities gets opened up that connect very nicely with what things like financial markets are interested in again the simplest case is well now if we're if we're lending you know if we've leased the car to or we have a loan to to you Sean and you stop paying your
Starting point is 00:47:00 monthly fees well maybe we can just kind of remotely turn it off And so this is not something that is happening right now, but you see Ford and others of file patents kind of combining a kill switch with data. And you just connect that to the financial records. And it's like, well, you know, you were. And so you could cut off your car in the same way that your cable service could be cut off, something that we just take for granted if you stop paying every month. the next step up from that would be, well, how good a driver are you?
Starting point is 00:47:36 And your car knows much more about that. Now, in the past, to get car insurance, you might get asked a polite series of questions by an insurance agent saying, you know, how much driving do you do? What kind of driving? And then a couple of crude measures of predictors, essentially, of, you know, are you over 25? Are you a man or woman? Which part of the country do you live in? What's the weather like there? You know, that sort of thing. But now, cars are talking to, we'll talk to their manufacturers all the time. And you may have, if you have a relatively late model car,
Starting point is 00:48:19 you may already have been, I don't know, have you ever been scolded by your car for not keeping your hands on the wheel, for example? Or that's a thing that. Not that, but certainly it, you know, if I don't wear my seatbelt or if I'm coming too close to the car in front of me, which is partly helpful, but a little bit annoying sometimes. Yeah, yeah. And so you'll get, and so those things can all become kind of inputs into an individualized price for insurance in your case. So that's the sort of second level, which trans, which itself transforms kind of what
Starting point is 00:48:47 insurance is conventionally, right? Because for insurance to work, you have a pool of people of varying degrees of risk, and then you spread that risk across individuals. But if you have individualized data on people, well, then you can kind of have a different version of an efficient market where you can price discriminate perfectly, ideally, at the limit. And so then it becomes, it's more like, it's bad insurance. It's more like dental insurance, you know, where, where, where, because like health, there's health insurance or in a, you know, in more civilized countries, where you have a full full displacement of, of risk across the population. but in sort of American dental insurance, it's not really insurance. You're just prepaying for something that they know you're going to do.
Starting point is 00:49:32 And so car insurance might become like that, which would transform the insurance market. So that's the sort of second level. But then that's just the beginning with this world of kind of data. Because then I said tractors earlier for a reason, like John Deere has been prepping its shareholders for a while for the idea that, like, look, we sell these combine harvesterers. We sell this fleet of tractors. Sure, we have a kind of a business. with a leasing company and loans and so on. But look, we know now when these farmers are going out and plowing
Starting point is 00:50:04 and when they're planting, we know kind of a whole range of things. Well, that means we could become sort of a provider of market intelligence to people, you know, that we could become a sort of, we could take this information and not just use it to sort of serve our direct customers, but bundle it up and sell it to people who might be interested in it, not just advertisers, but people interested in, you know, in futures markets for various products. And so this tendency to make data collection more and more granular fits really nicely with this tendency for finance to want to make sort of products that are more and more abstracted, layered and
Starting point is 00:50:45 layered up and homogenized so that so that every potentially kind of every manufacturer becomes a software company. And every software company becomes a provider of software as a service. And then every service becomes something that can be sliced up and bundled where
Starting point is 00:51:07 you can look at tranches or categories or classes of users and then sell their information or sell information either about them directly or sell the information they are generating to interested parties. And so it's a
Starting point is 00:51:23 And this is something we see kind of right across, again, everything from your smart fridge. And so in some cases, like in some settings, this seems sort of ridiculous to us now, like the idea of your fridge, for example, knowing what's inside it and first telling you, you need to order more milk that's been in here for two weeks. Your fridge having moral objections to what you're eating. that seems silly. But with the car market, we see this just perhaps beginning to happen where car manufacturers are like, wow, we could really transform our finance branch, which is in many cases the most profitable part of the company. And then there's areas where we already take it for granted, like game consoles, for example,
Starting point is 00:52:16 where, you know, you are, you know, you're signed up. up you have a PlayStation or an Xbox and you buy a piece of software, but in order for the software to run it all, it's a multiplayer game, it's talking to servers, you have a, it's a subscription service, there are seasons for games, and the company is collecting the people running, all kinds of data about you, some of which is used in a way that you like, some of which is explicitly ranked. Like, for example, if you're playing some multiplayer game, they all run. some ELO-like ranking system to make sure that you're matched against people who are kind of competitive with you, but who won't destroy you in games or who won't be too easy for you to defeat.
Starting point is 00:53:00 So in that sense, the rankings are just super useful for you as a way to enjoy your service, but then also provide like a global view of the whole system about who plays the most, what kind of people and so on. So this is already here for certain kinds of products and then it's continually expanding for many others. Is it true that if I have a late model refrigerator that will know what's inside and will it send that info to the refrigerator manufacturer? No, but or at least there are smart fridges. I need to get back to the, I need to look more carefully at specific cases. But yeah, Samsung and others have started to, you can buy fridges that have a little camera in them
Starting point is 00:53:40 and try to identify, you know, and help you with your shopping by kind of paying attention to what you're buying and deciding what it is that you need. One interesting question about those, too, is the extent to which behind the scenes, and I haven't seen anything specific about this particular case, but the thing that occurs me right away is, you know, if you have a fridge that has kind of a monitoring capability, perhaps through a camera, is this fully sort of machine learning or is there somebody in, you know, India or the Philippines who's looking inside your fridge? And as we saw recently with Amazon, right, that with the,
Starting point is 00:54:17 with their just walkout stores and so on where they shut that down. But initially it was there was all this hype about it being AI, but then it just turned out to be a bunch of people. It poorly paid overseas who were kind of tagging everybody to make sure. So that's the kind of thing that happens. Most people don't realize how much of their personal information is being bought and sold every day. Data brokers are making millions pulling details about you from public records and the internet, then packaging and selling it, usually without.
Starting point is 00:54:47 your consent. That's how your information lands in the hands of scammers, spammers, even stalkers. It's why you get endless robocalls and why ads seem to follow you everywhere. That's where ORA comes in. ORA actively removes your data from broker sites and keeps it off. They also instantly alert you if your information shows up in a breach or on the dark web. But ORA goes beyond data protection. With one app, you get a VPN, antivirus, password manager, spam call protection, dark web monitoring, and even up to $5 million in identity theft insurance, all backed by 24-7 U.S.-based fraud support. Other companies might just sell credit monitoring or just a VPN. ORA gives you all of it, together, at the same price competitors charge for just one service.
Starting point is 00:55:36 Start your free trial today at aura.com slash hidden. Protect yourself now at A-U-R-A-com slash hidden. Owning a home is full of surprises. Some wonderful, some? Not so much. And when something breaks, it can feel like the whole day unravels.
Starting point is 00:55:53 That's why homeserve exists. For as little as $4.99 a month, you'll always have someone to call, a trusted professional ready to help, bringing peace of mind to 4.5 million homeowners nationwide. For plans starting at just $4.99 a month, go to homeserve.com. That's homeserv.com.
Starting point is 00:56:08 Not available everywhere. Most plans range between 499 to 1199. a month your first year. Terms apply on covered repairs. I do remember in your in your book, you mentioned this fact that I had seen before. The General Motors is mostly a bank now. They make more money out of their auto loans than they do off their autos. Yeah, right. Exactly. The finance division of, again, the financialization of products generally and of, you know, we think of, extends to companies that we think of as manufacturing hardware of consumer goods, but really where the profit lies is, is in their financing divisions.
Starting point is 00:56:41 And that's true, like, you know, take, I'm sitting in front of an Apple computer, Apple is probably the last, you know, it's the last kind of major Valley company, that Silicon Valley Company that surviving from the 70s that makes, primarily is about making its own hardware, right? That, you know, that it makes a software, but it sells, makes most of its money, you know, from selling, from selling hardware. But it, too, over the, over the last decade in particular, has both, you know, increasingly. has been getting most of its growth from the rise of services of various kinds, subscriptions and deals with Google and others. And then also has been expanding into an Apple credit card, the general expansion into kind of paying for anything. Companies want to get a little piece of that one way or another. If they don't manage it directly, they want to get a cut for providers.
Starting point is 00:57:41 in the customer, but that really is where a lot of the long-term sort of stable profit, a stream of income that you can differentiate by categories of consumer in terms of how much money you can make from them. That's where the profit is. I know you're not mostly self-help book here, but is it of any use at all to turn off cookies and not let Google keep my search history and things like that, or is that just a little window dressing? Well, I think that it's important for people to think about these things. We are in the book mostly concerned with kind of how it is in a big picture way,
Starting point is 00:58:28 how sort of the phenomenon of social order generally is being kind of created and the rise of categories of people are being kind of maintained across institutions. One feature of that is that the tendency to think about how people think about these problems at all is also relentlessly individualizing. And that it comes down to questions. People naturally ask these questions, well, what can I do to protect my own data, to make sure to opt out of these systems? to make sure that things remain private for me and so on. And those are all very reasonable questions. But to the extent to which that becomes the terrain on which most debate about this is happening,
Starting point is 00:59:21 well, then you're kind of losing sight of the broader kind of institutional phenomena. So that like, and this comes out in kind of policy debates in various ways, like in the EU, for example, you know, one of the main, you know, the main kind of with the GDPR regulation a few years ago, their idea was exactly, let's empower individuals to have the choice to accept or reject cookies or tracking in the websites that they visit. And so what we're doing is putting in the hands of individuals this ability to make exactly those kinds of decisions and to sort of, you know, to think of their own kind of internet hygiene or search hygiene in that way. And similarly, if you live in California, you'll see, you know,
Starting point is 01:00:10 or even if you don't, you'll see the, you know, do not sell my information button on many websites. Now what that does, of course, in practice is it leads to people just automatically clicking except all. Or, you know, just the fact that the choice is, yeah, the choice is constantly kind of given to you. Or they install a, you know, we just have the kind of, okay, I have to click the button here and then they click it. So, yeah, at that level, that's the sort of wrong way to think about the broader questions. And then the other thing that happens is that people who are really serious about avoiding all of this stuff can try effectively to eliminate all of this stuff from their lives. And I know people who do this. And, you know, it's not easy.
Starting point is 01:01:03 and one of the consequences of it is that you're in danger of kind of exiling yourself from your own society and your own culture, which is a price. Some people are happy to pay because they have nothing but contempt for it. It's a thing that you can do, but it's not, but it's not kind of without its costs. So trying to become invisible, the logic of all of these systems, this goes back to what I was saying earlier about authenticity and authentication. the logic of all of these systems is to incorporate. In that sense, they're democratic. Like, in that sense, they're expansive and inclusive. It's not about, it's not a world where we're saying there are these people who are not worth paying attention to and we must, we just ignore them.
Starting point is 01:01:48 We deny their existence as social beings, right? It's not that kind of classification system where you just had nothing but, you know, you just ignore their existence. Instead, the idea is to sort of incorporate and then stratify. And to incorporate, you must measure and track. And then you can sort of just re-rank and properly classify the individuals once they're in. And then to be outside of that sort of system then is to be at a kind of double disadvantage because you're not even kind of classifiable as amongst, you know, and you end up kind of, you know, it would be like, there's an irony here.
Starting point is 01:02:28 It's like sort of trying to pay everything, trying to pay for cash, trying to use cash for everything is increasingly difficult. Because you're not incorporated into the banking system. And for many years, for much of the 20th century,
Starting point is 01:02:42 one of the big policy problems that people, was this question of kind of exclusion because people were unbanked. And such people still exist. But in the United States in particular, but there's this massive expansion of the banking system
Starting point is 01:02:55 beginning in the 1970s, that incorporates and that was driven by very laudable kind of ideas about being able to let people into this system that they had previously been excluded from. But what happened, the system that replaced it was one where banks essentially figured out how to make money from poor people through things like late fees and overdraft fees. And so this is a real tension, you know, that you can walk away, perhaps if you have the means. But even that is increasingly difficult because of the being invisible in that way has all kinds of consequences that many people don't want to bear. Well, I do want to talk about the sort of implications of all this for our social orders, since that is after all what the book is about.
Starting point is 01:03:46 I mean, in some sense, if I'm now classified by thousands of different companies in all these invisible tools, me classification schemes. Why do I care? Why does that affect my life? It affects your life chances, as sociologists would say. It affects the the opportunities that are offered to you and what those things will cost, so to speak, right? And so, yeah, so one feature of this whole world is, as you're saying, that it is very, it's very highly differentiated, like what it means your stock, so to speak, of, we call it eigen capital in the book. This It's like, you know, this digital representation of you through data, what it means varies according to the market that we're talking about or the setting that we're talking about. So it's not that like we're not sort of arguing in the book that everybody is just reduced to a number, a single number, and that this determines your entire life.
Starting point is 01:04:47 It's more that, you know, the principle of the basic sort of logic of social order. And the creation of social structure is increasingly mediated by these and carried out through these processes. And so the reason that you care then as a result is that the kind of person socially that you are, that is very closely tied to how you are classified by these institutions. And for some things you say, you may reasonably say, I don't care in the sense of like if this or that company classes me is a good or bad. customer or something like that. But for other institutions where these scores are also, and these methods are also increasingly being used in health care, in the law, the legal system, in education, and in hiring
Starting point is 01:05:39 practices and so on, you may very much care. And people increasingly have kind of come to accustomed themselves, both with varying degrees of, you know, voluntary assent to being subject to this kind of data collection and classification as a condition of entry or membership in society, broadly speaking, but in specific cases. And so then that range, you know, so the, so the range of kind of reasons to care come, come start directly from how much will this cost me right now, you know, if I, if will I, will I be charged an additional fee because I've failed a credit check or failed to meet a threshold in some check to get a phone and sold, to get internet service, to sign a rental
Starting point is 01:06:32 agreement and so on, right? That kind of thing really does matter for a kind of stratification and where people end up in life. All the way through to sort of, you know, what if I feel like I'm misclassified or how can I, you know, if an institution is seeing me in a way that I strongly disagree with what resources are at my disposal to fight that or to, and is it just a matter of kind of the only option is to exit the system and thus pay the price of that? Or are there ways that I can, you know, are there ways that I can kind of change my classification? And those things are, Those are hard questions because the very kind of basis or logic of a lot of this stuff is nominally. Even if the systems don't really work this way, even if they're laden with error or they're badly implemented as statistical measures or that they reflect bias in all kinds of terrible ways, the kind of cultural logic of them is very much that you're getting what you deserve.
Starting point is 01:07:36 because it's your behavior, your decisions. You know, it's not just, it's those are the things. Look, what happens is that those get parsed as choices that you made, right, as decisions that you took. And so in one sense, kind of all of the things that sociologists and social scientists generally conventionally think of as social structure, where you came from, what your opportunities were, growing up, like what you're, what is constraining you in the world, you know, people's opinions of you and so. on, those all tend to get stuffed through, if you like, the behavioral channel. They get recorded as choices. And then you get judged on the basis of those choices you apparently made, even if at the time you may have felt, well, I didn't really have an option here.
Starting point is 01:08:21 I had to do this. Or this was a constraint that I faced that really wasn't of my own doing. Or on the flip side, the same thing applies in reverse to people who benefit from these things where they, you know, the idea of like being born on third base thinking you hit a triple, you know, that you take upon yourself all of those virtues. You think of you, you take up all those advantages become sort of experienced by you as personal virtues of similar choices, you know, that you made beginning with your excellent choice of parents. Just what you deserve. Yeah. And yeah, I mean, you emphasize in the book how even if you thought of all this classification and
Starting point is 01:08:59 ranking systems as purely objective and quantified. it bleeds over into normative questions. You do get judged as better or worse, like it or not. Yeah, definitely. Yeah, there's the, and there's, even if they get, there's very, there were, and even, even if you think of them as, as, you know, classification schemes that are not intrinsically, that are not trying to rank you, so to speak, that if it's just, that you're just trying to classify, there are very few cases of sort of nominal classifications, on-order classifications
Starting point is 01:09:30 that people don't try to, to then turn into rankings. People, I mean, in part because. I mean, people, you might ask like, why is it that that happens? Again, where there's differentiation, there's stratification in human societies. But then also people find these, like, it's a two-sided process. You know, if you're being judged by these systems, if you're being classified by them, that can be a very unpleasant experience if you're on the sharp end of them. It can be very gratifying if you're, you know, if you're well classified.
Starting point is 01:10:01 But on the other side, if you're looking to make a decision, if you're trying to organize something, these technologies are just tremendously powerful because they just are as heuristics. They simplify decision-making immensely and they make it possible to do things. And so people demand in that sense, the ability to make these kinds of decision to rely on these rankings or to rely on these scores
Starting point is 01:10:25 because they just cut through, they really are extremely powerful methods. In that sense, it's just that then we would also not be sub, we would prefer not to be subject to them ourselves. a lot of the time. And a lot of the social struggle that goes on around these things is exactly who is it that's predominantly, you know, taking advantage of these measures. And then who is it that gets to avoid being subject to them at key moments in their lives? You know, in a recent solo podcast, I sort of offhandedly speculated about how a lot of the modern condition was
Starting point is 01:10:58 affected by the fact that because of the connectivity of the world, we're connected everywhere. So the instructors we're dealing with are very, very big, right? It's not like our local coffee shop. It's an international chain. And they have all this data that they can turn into action very, very quickly. The efficiency of extraction of our wealth, et cetera, becomes super high. And so I speculated that this just makes us sad because we can't ever feel like we're getting a good deal. Like we're paying as much as we would possibly be willing to pay for everything.
Starting point is 01:11:35 we do and we can't get any human response from the systems we're stuck in. I don't know. This is not even a question, but like, you know, is that kind of what's going on? I think that's an excellent point. I think it comes out of different ways. One is that, you know, insofar as these systems do reach their limit of efficiency in that sense, the result economically is exactly what you describe, which is, which is in its way a perfectly efficient market, just not the, just not the kind that, it's not the traditional
Starting point is 01:12:05 kind where supply and demand grope their way towards a kind of balance and there's a single price that clears the market. It's a perfectly price discriminated market where everybody pays exactly what they're willing to pay or in the in the and and so that means then yeah, that that sense of kind of, hey, I got what the economists would call consumer surplus, like the sense that, hey, I got a good deal here because I really would have paid more than this. You know, if I had to for this for this thing can can evaporate. And yeah, it's a that's really something that that feeling is quite real. And it's also, it comes out in a more social way too, I think, another way it makes you sad,
Starting point is 01:12:49 is that that freedom, in the book we call this interstitial liberties, that there's a kind of freedom that comes from the institutions that organize our lives being sort of relatively poorly connected to one another. that they're not really able to transfer information efficiently or to communicate with each other, that they get stuck with, you know, in the older times, like, you know, that there's a file over here that needs to, you know, that's out of data that needs to be sent in the post or, you know, there's bureaucracies mesh poorly. And so the freedom that comes with that, that kind of freedom, this interstitial liberty that kind of bubbles up out of the cracks between organizations, was the freedom to move somewhere else and not have anybody know who you were or be able to find out, you know, to start a new
Starting point is 01:13:35 life somewhere, you know, with a clean slate or something, or just to move through society without this sense of that there's the possibility that everything about you relevantly could be known easily. And as these systems have sort of expanded, the benefits that you get supposedly are the ones that have to do with kind of an experience tailored to you. and that, you know, personally. But like, well, and you think, oh, that would be nice. But that's a bit like being asked, you know, if I could go back and live in any time in history, what would I think? People think of themselves, well, I would be the king, right?
Starting point is 01:14:13 Of course it would be great. And so maybe what's tailored to you, what the system thinks you deserve may not be what you think you deserve. And so you get a sort of benefit. But then you also lose this freedom kind of that came with the friction. that previously existed between institutions, that people, yeah, you had more opportunities in that sense because there was so much more of, there were gaps, there were cracks that you could sort of live in
Starting point is 01:14:47 in a way that's increasingly difficult now. So sadly, we're winding up on a relatively downbeat note here. I'm wondering, you know, projecting. What's that joke that, you know, you should not on a positive note. I don't have a positive note. Would you take two negative notes? But, you know, can we project into the future?
Starting point is 01:15:10 I mean, everything that you're describing seems to me to be, yeah, everything, these things are definitely happening, but I can imagine them happening even way more. So I'm guessing that none of this is going to go away. Yeah. So, so the, so it is, there is a, it is a little, uh, pestilence. I would say, though, that one of the key, one of the main, you know, commitments in the book or one of the main sort of feelings that we have in the book and that we think that that's kind of come out empirically over and over again is that people, just because a system is pervasive,
Starting point is 01:15:50 right, just because the way that life is organized is everywhere now, it doesn't mean it's totalizing in the sense that like it completely dominates and, and fully dictates every aspect of everyone's existence. Right. So a thing can be, like the world we're describing, we think is real in the sense that it really is kind of expanding and expanding in its scope and scale in the way that we describe. But it's also true that any human system,
Starting point is 01:16:22 any sort of set of social institutions, is intrinsically sort of people, people tend to overflow the boundaries of the systems built, you know, to enclose them or that we build to enclose ourselves. And because social life is messy, things happen kind of at random. There's noise in the system things break. So there's always this possibility. It's inevitable, really, that things just don't go according to plan. Things sort of spin out.
Starting point is 01:16:53 And when they do, it isn't always a bad thing. You know, and the very things that kind of helped create this whole system were exactly that. It was sort of people creatively overusing early web forum, you know, early web discussion forums suddenly become kind of communities that people were discovered each other. Now, you know, sometimes those communities were wonderful. We might judge normatively and others. It turns out that, oh, look, you know, all the white supremacists can find the exit, you know, can meet up as well.
Starting point is 01:17:22 So it's not, it really is a truly messy process in the sense that it's not. kind of there isn't a kind of nice moral story about how everybody is wonderful deep down or anything like that. But it is the case that like these systems, they're not, they don't exist forever. And so there's both kind of good old solid kind of policy. We can kind of architect these a little bit in ways that can push them in one direction or another. But there's also just the sheer fact of kind of human sociality and the randomness, you know, intrinsic and messiness of human social existence that tends to kind of overflow whatever boundaries get put on it sooner or later. What happens after that? What's next? I don't believe in the idea that it's necessarily better,
Starting point is 01:18:07 but it's not inevitable that we're stuck. We're never stuck forever in a particular way of organizing things. New things come along. I guess that's a good slightly positive note. Good. Thank you for at least trying there. I appreciate the effort. You know, look, I will note that I've noticed that on YouTube, the ads that I get served up are just terrible. They're just like, Todry, no relationship to me. And I clicked, like, trying to ban an ad. And it said, well, you've turned off your search history so we can't target your ads. And I'm like, yeah, well. That's exactly the kind of, that's one of the ways, like, that's, that's an exact, there's a very good example of, of like, the price you pay for, for, for want, for not wanting to be incorporated, right? Because, uh, and the price you pay for
Starting point is 01:18:51 not wanting to be incorporated is, is that you get the worst. They're like, they're like, okay, we'll have to serve you up the lowest common denominator. And, and, and so it's like on, you know, I don't, I'm not on Twitter anymore, but, you know, anytime I go back there now, and it's like, oh, it's just like liver king, you know, these weird, weirdos who are, and it's the same sort of thing. It's like, well, I turned off all of my, you know, information. You don't, you don't give. This is this we call the Mosian bargain, right? You don't, you don't give to the system. And so it doesn't give back to you. And so yeah, so you have to then, to the extent that you're still watching YouTube, you have to suffer through these terrible ads because
Starting point is 01:19:28 you didn't give back in the way that it wanted you to. It's a first world problem, but it's a problem that I care about. So that's what I have to deal with. Here in Healy, thanks so much for being on the Minescape podcast. Thank you, John.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.