Theories of Everything with Curt Jaimungal - There is No Wave Function | Jacob Barandes

Episode Date: November 13, 2024

In today’s episode, Jacob, a physicist specializing in quantum mechanics, explores groundbreaking ideas on measurement, the role of probabilistic laws, and the foundational principles of quantum the...ory. With a focus on interdisciplinary approaches, Jacob offers unique insights into the nature of particles, fields, and the evolution of quantum mechanics. New Substack! Follow my personal writings and EARLY ACCESS episodes here: https://curtjaimungal.substack.com SPONSOR (THE ECONOMIST): As a listener of TOE you can get a special 20% off discount to The Economist and all it has to offer! Visit https://www.economist.com/toe LINKS MENTIONED: - Wigner’s paper ‘Remarks on the Mind-Body Question’: https://www.informationphilosopher.com/solutions/scientists/wigner/Wigner_Remarks.pdf - Jacob’s lecture on Hilbert Spaces: https://www.youtube.com/watch?v=OmaSAG4J6nw&ab_channel=OxfordPhilosophyofPhysics - John von Neumann’s book on ‘Mathematical Foundations of Quantum Mechanics’: https://amzn.to/48OkeVj - The 1905 Papers (Albert Einstein): https://guides.loc.gov/einstein-annus-mirabilis/1905-papers - Dividing Quantum Channels (paper): https://arxiv.org/pdf/math-ph/0611057 - Sean Carroll on TOE: https://www.youtube.com/watch?v=9AoRxtYZrZo - Scott Aaronson and Leonard Susskind’s paper on ‘Quantum Necromancy’: https://arxiv.org/pdf/2009.07450 - Scott Aaronson on TOE: https://www.youtube.com/watch?v=1ZpGCQoL2Rk - Leonard Susskind on TOE: https://www.youtube.com/watch?v=2p_Hlm6aCok - Ekkolapto’s website: https://www.ekkolapto.org/ TIMESTAMPS: 00:00 - Introduction 01:26 - Jacob's Background 07:32 - Pursuing Theoretical Physics 10:28 - Is Consciousness Linked to Quantum Mechanics? 16:07 - Why the Wave Function Might Not Be Real 20:12 - The Schrödinger Equation Explained 23:04 - Higher Dimensions in Quantum Physics 30:11 - Heisenberg’s Matrix Mechanics 35:08 - Schrödinger’s Wave Function and Its Implications 39:57 - Dirac and von Neumann's Quantum Axioms 45:09 - The Problem with Hilbert Spaces 50:02 - Wigner's Friend Paradox 55:06 - Challenges in Defining Measurement in Quantum Mechanics 01:00:17 - Trying to Simplify Quantum for Students 01:03:35 - Bridging Quantum Mechanics with Stochastic Processes 01:05:05 - Discovering Indivisible Stochastic Processes 01:12:03 - Interference and Coherence Explained 01:16:06 - Redefining Measurement and Decoherence 01:18:01 - The Future of Quantum Theory 1:24:09 - Foundationalism and Quantum Theory 1:25:04 - Why Use Indivisible Stochastic Laws? 1:26:10 - The Quantum-Classical Transition 1:27:30 - Classical vs Quantum Probabilities 1:28:36 - Hilbert Space and the Convenience of Amplitudes 1:30:01 - No Special Role for Observers 1:33:40 - Emergence of the Wave Function 1:38:27 - Physicists' Reluctance to Change Foundations 1:43:04 - Resolving Quantum Mechanics' Inconsistencies 1:50:46 - Practical Applications of Indivisible Stochastic Processes 1:57:53 - Understanding Particles in the Indivisible Stochastic Model 2:00:48 - Is There a Fundamental Ontology? 2:07:02 - Advice for Students Entering Physics 2:09:32 - Encouragement for Interdisciplinary Research 2:12:22 - Outro TOE'S TOP LINKS: - Support TOE on Patreon: https://patreon.com/curtjaimungal (early access to ad-free audio episodes!) - Listen to TOE on Spotify: https://open.spotify.com/show/4gL14b92xAErofYQA7bU4e - Become a YouTube Member Here: https://www.youtube.com/channel/UCdWIQh9DGG6uhJk8eyIFl1w/join - Join TOE's Newsletter 'TOEmail' at https://www.curtjaimungal.org Other Links: - Twitter: https://twitter.com/TOEwithCurt - Discord Invite: https://discord.com/invite/kBcnfNVwqs - iTunes: https://podcasts.apple.com/ca/podcast/better-left-unsaid-with-curt-jaimungal/id1521758802 - Subreddit r/TheoriesOfEverything: https://reddit.com/r/theoriesofeverything #science #sciencepodcast #physics Learn more about your ad choices. Visit megaphone.fm/adchoices

Transcript
Discussion (0)
Starting point is 00:00:00 Red 1. We're coming at you. Is the movie event of the holiday season. Santa Claus has been kidnapped? You're gonna help us find him. You can't trust this guy. He's on the list. He's a naughty lister.
Starting point is 00:00:10 Naughty lister? Dwayne Johnson. We got snowmen! Chris Evans. I might just go back to the car. Let's save Christmas. I'm not gonna say that. Say it.
Starting point is 00:00:22 All right. Let's save Christmas. There it is. Only in theaters Friday. I didn't know it was impossible. So I brought these theories closer and closer together, expecting that there would be a moment when I would need to make some kind of jump to get from one theory, classical physics, to the other theory, quantum physics. And the strangest thing happened.
Starting point is 00:00:44 The two cliff faces merged. And the strangest thing happened. The two cliff faces merged. And there was just no chasm anymore. Today I have a special treat. I traveled to Harvard University to meet in-person Jacob Barandes, the co-director of graduate studies in physics and someone making waves at the intersection of fundamental physics and philosophy. In his unassuming office, he's been working on a revolutionary framework that finally explains quantum mechanics. His radical proposal suggests that there is no fundamental wave function,
Starting point is 00:01:18 Hilbert spaces aren't real, and there's no mysterious quantum realm. It's just a mathematical convenience, it's an appurtenance of the theory, and there's no mysterious quantum realm. It's just a mathematical convenience. It's an appurtenance of the theory. But there is no object in physical reality it's describing. In this episode, we go in-depth into the picture that resolves the measurement problem, eliminates the need for multiple worlds, and finally gives a clear view as to what's actually happening at nature's smallest scales. However, this clarity does come with a price.
Starting point is 00:01:49 The question is, are physicists ready to accept a quantum mechanics without magic? Professor Jacob Berendis, welcome to Theories of Everything. I've been following you for some time, following you online in a non-creepy manner. And we were speaking off air about physics. However, you're also the co-director of the graduate studies here of physics, and you have an interesting background as to how you came into physics. So why don't we start off there? Why don't we start from the beginning? From the beginning. My first intellectual passion was for philosophy of mind. When I was five, I was sitting in one of those little assembly rooms they had in schools, you know, like it was my elementary school. And one of the teachers was droning on about something,
Starting point is 00:02:46 I don't remember exactly what they were talking about, but I remember sitting on this soft carpet and there was a piano with, you know, the feet of the piano looked like lion's paws. And I suddenly became aware of my existence in a very, very explicit, clear way. And I was very confused. And I tried to express my state of confusion
Starting point is 00:03:07 to one of the other children sitting next to me. And I failed miserably at being able to explain what I was feeling in the moment. And so this left a sort of a mark on me. And from that moment, I was very interested in questions about, you know, what is the nature of our existence? What does it mean to be conscious? So philosophy of mind is really where things got started for me. But of course, I had no language with which to express any of these thoughts.
Starting point is 00:03:38 I liked science documentaries. I grew up in New York City, and my parents would take me to the Museum of Natural History in New York City, which is really a wonderful, magical place. And anyone who goes to New York City should really visit it. It's amazing. So I got really interested in science. I got interested in math. And I just thought if you're interested in science and math and you're interested in foundational questions,
Starting point is 00:04:07 then that means you should go into physics, right? That's where I thought math and these foundational questions, it's where they come together. So I went through school, I got to high school, I took physics for the first time in an academic way in school. I loved it, it was in an academic way in school. I loved it. It was my favorite class in high school. I still have all my old binders from that time.
Starting point is 00:04:30 It was the one class where I was actually excited to go and do the homework, which was great. My teacher, Doug Bartel, was just phenomenal. He was just totally amazing. Around that time, I also started making trips back into New York City. We'd moved out of the city by that point, about an hour north.
Starting point is 00:04:52 And so I would jump on the train and go in the city on the weekends. And I would take science classes in the city. Columbia University has a program called the Science Honors Program. At the time, it was run by Alan Blair, just an amazing human being who was a professor of physics there and also ran this special program,
Starting point is 00:05:10 the Science Honors Program. And these were classes you could go to, there was no homework or grades or tests, you just show up on Saturday mornings and you would learn all kinds of amazing things. It was an amazing program. And I would also work at the Museum of Evangelical History. So I started interning there when I was in high school. And I started working in the astrophysics
Starting point is 00:05:31 department. I didn't, I was not an expert in astrophysics in high school, but I was very curious about it. And I was doing a lot of computer programming at the time. And they, you know, were interested in having me work on some of the projects that they were doing. They were working on computer graphics visualizations of the galaxy. I worked on a project called the Digital Galaxy Project, if I remember the name correctly. And it was really my first opportunity to work with scientists. I really hadn't, I didn't know any scientists. We didn't have any scientists in my family.
Starting point is 00:06:06 My father's a physician. But, you know, research scientists, I'd never met anybody like that. I didn't know academics or professors or anything like that. So this was, you know, these two experiences were very important for me. And together with my physics class, you know, I decided I wanted to study science and maybe physics. But my love for philosophy of mind was still very strong. So when I went to college, I decided I was going to try to study the brain.
Starting point is 00:06:34 I loved computers, and so the idea was I would somehow find a way to bring together my interest in computers and neuroscience in some way. In order to go in that direction, I had to take some basic science classes, including physics. I had to take math classes, and I really fell in love with these classes. I started taking biology in my sophomore year, and I enjoyed it, but not as much. And I have immense respect for people who work in biology, but it just wasn't for me. Yeah.
Starting point is 00:07:04 So- For me, I just want to know if but it just wasn't for me. Yeah. So... For me, I just want to know if the reason is the same for you. For me, it's just there's a multiplicity of terms, and I feel like it's more memorization than derivation. Yeah, I do sometimes feel that way. I mean, I want to make very clear that I'm not a biologist, and I don't want to make any presumptions about the way that biologists think about their subject. I know there's an inner logic to biology.
Starting point is 00:07:28 Oh, I just mean at the first year level, at least from what I experienced. As you get older or as you get more seasoned in research, it's probably different. I had that experience when I took the first semester of biology. It was microbiology and it was very logical. And then the second semester was anatomy and that was much more memorization. And that, I had the same experience that you're describing. It just wasn't really for me. You know, but it was hard to convince myself
Starting point is 00:07:53 that I should go into physics because, you know, there were all these very bright young people going into physics and going into mathematics. I was interested in the theoretical side, the mathematical side of physics. And I just didn't feel like I was good enough to keep up with people. But around sophomore year of college,
Starting point is 00:08:10 I had conversations with some really amazing people, some of my fellow college students, and basically I decided it matters much more that I do what I'm excited about than to wanna be the best at something. So I'm just gonna do it anyway. And so I just started taking lots of physics and math classes and it was fantastic.
Starting point is 00:08:28 I had an amazing experience. And some of the philosophy courses we were required to take at the time just didn't really call to me. There was a heavy emphasis on ancient Greek philosophy, on early modern philosophy. Now, I appreciated those subjects, but it wasn't as exciting to me as what I was doing in physics, at least at the time.
Starting point is 00:08:54 Now, I should say that as the years went on and I began exploring other areas of philosophy that weren't part of the standard curriculum in college, analytic philosophy, philosophy of science, logic, foundations of mathematics, philosophy of physics. My views on philosophy changed completely. But, you know, at the time, I wasn't, I didn't really
Starting point is 00:09:14 get a chance to see much of that, and I didn't see it growing up. And so I figured, okay, I'm gonna throw my lot in with physics. So I finished my undergraduate degree, and then went on to graduate school. And I started a PhD, actually here at at Harvard in theoretical physics. And as I was progressing in that degree, you know, I started to think back about some of these old philosophical questions that I had. I did my doctoral work in high energy theoretical
Starting point is 00:09:40 physics. And, you know, I think we did really meaningful work, but I was really much more excited about philosophical questions. And by the time I finished my PhD, I knew that was the direction I wanted to go in. So I continued on in the department. I'm a lecturer here in the department, and I also co-direct the graduate program, as I think we talked about. So, you know, I mix teaching physics and research and advising students, and it's been a really rewarding experience. The students here are amazing. They're idealistic and they're brilliant and they're deep.
Starting point is 00:10:21 And I've met really the most amazing people a person could ever ask to meet here. I've met lifelong friends here. I mean, it's been just an incredible experience being here. And I've learned a lot. Much more, I think, than any of them have learned for me. But that's how someone who mainly works in philosophy, philosophy of physics,
Starting point is 00:10:40 finds himself embedded into physics departments. So I have an associated faculty point with the philosophy department, and I take turns teaching classes in physics and also over there in philosophy. Yeah, but my research is primarily the intersection of philosophy and physics. So what happened to the philosophy of mind?
Starting point is 00:10:58 That's a good question. I'm still really interested in philosophy of mind. I just don't think that my set of tools that... So I think, you know, we all come into this world with a distinct profile of strengths and weaknesses. I'm extremely interested in philosophy of mind, but I don't think that my distinct profile of strengths and weaknesses is optimized
Starting point is 00:11:21 for working in philosophy of mind. So I read about it, I'm deeply interested in it, but I feel like I'm more well adapted to questions of the intersection of physics and philosophy. So that's where I've spent my time and my focus. Earlier you said you didn't want to pursue something just to be the best at it, you want to follow your interests, but here you're saying, well, my interests still lie in philosophy of mind, but I'm not the sharpest tool in the shed when it comes to that. That's not my skill set.
Starting point is 00:11:46 How do you reconcile those two? That's well put. Yeah. So, I mean, we all change as we grow and get older, right? Yeah. So, I think for me, it was a matter of finding a balance. It's less important to me, and this is, you know, I talk with students about this also, right? It's less important, you know, I talk with students about this also, right?
Starting point is 00:12:05 It's less important, you know, what you want to be. It's less important about, you know, being big or famous or important. And to me, what's most important is doing work that's meaningful, that I feel like is meaningful, that a person feels like is meaningful, work that we feel is meaningful, but also we feel like we're making progress on. So it's not so much that I don't want to work in philosophy of mind because I think it wouldn't make me famous.
Starting point is 00:12:34 My lack of motivation to work in philosophy of mind, at least now, and that could change, is because at least right now, I don't feel like this is where I would be most productive. It's where I feel like, I wouldn't feel like I would be doing work that I felt as proud of as the work I'm doing in philosophy of physics and philosophy of science. So that's primarily why I focus on those areas now.
Starting point is 00:12:54 I'd like to get you to justify there is no wave function soon. However, I want to know if there is a connection between the philosophy of mind and quantum mechanics first Mmm. Yes. This is a very interesting question And actually this will bring us to a very important paper that I'm hoping we could talk about from the early 1960s It was a paper by Eugene Wigner I believe the paper was called on the mind body question. I could have the title slightly wrong But Wigner introduced a thought experiment that I think in some ways connected to his view that there was something connecting consciousness and collapse of wave functions.
Starting point is 00:13:37 This thought experiment actually dates back earlier. It's not entirely clear to me who originated this thought experiment. Because it first shows up in Hugh Everett's extended thesis. Hugh Everett was a graduate student at Princeton and was at Princeton at the same time, overlapped with Eugene Wigner. And Hugh Everett originated the Many Worlds Interpretation of Quantum Mechanics. And he wrote this very long thesis. It's 137 pages, I guess maybe that's not long in an absolute sense.
Starting point is 00:14:09 In 1956, 1957, he ultimately didn't publish it. His advisor strongly pushed him to publish a shorter, different thesis. But you can find a copy of this extended thesis and he opens it up with the same thought experiment. So we know this thought experiment was introduced earlier than Wigner by at least, I guess, seven years before Wigner's paper or something like that. But that wasn't published, Wigner's paper was published
Starting point is 00:14:38 and so it's most widely attributed to him. Wigner had this thought experiment that I'm gonna talk about in a little more detail if you'd like, because I think it gives a good motivation for why one might think that there's a problem with the way that we formulate quantum mechanics at the level of its textbook axioms. So I'll come back to it. But I'll just say that this thought experiment apparently was connected with Vigner's idea that somehow consciousness was related to collapse of wave functions. And I think this creates a potential connection between philosophy of mind and quantum mechanics.
Starting point is 00:15:09 But there are other connections. In the many worlds interpretation, the formulation of quantum mechanics that Hugh Everett introduced in the mid fifties, one does run into some basic questions about consciousness and human identity in a universe in which a giant universal wave function is splintering into parallel realities, each of which contain copies of yourself. How do we make sense of this kind of a picture
Starting point is 00:15:40 and make it connect with how we think about basic problems in philosophy of mind. I don't claim to have an answer to that question. It's an ongoing mystery, I think. So there are, I think, some interesting connections between philosophy of mind and quantum mechanics. And I think my general attitude has been, anytime you're unable to answer a question about quantum mechanics, because you've connected it in some way to the philosophy of mind and in particular to an unanswered and potentially unanswerable problem about the philosophy of mind, I get very worried. Okay, let's talk about the wave function because when we're speaking about the collapse of the wave function, the collapse of something, what is this wave function and why do you
Starting point is 00:16:22 believe that there is none? That's a great question. So, let me say a little bit about some history. I think some history here might be helpful to ground things. But before I do the history, let me first answer your question. I'll give the short answer and then we'll talk a little bit of history because otherwise we might get lost in the weeds. There's this popular story about quantum mechanics that a lot of students coming into the fields have heard.
Starting point is 00:16:48 The first primary object in quantum mechanics is the wave function. It's this mysterious undulating object. It's a little bit unusual. It's kind of like the electric fields sort of, except that its values are complex value. They're complex numbers. They're like ordinary real numbers plus a number times the square root of minus one.
Starting point is 00:17:17 And somehow they're connected with probabilities in some way. And somehow the point of quantum mechanics is wave functions. They're the central player in the story. And how you think about quantum mechanics begins with how you think about wave functions, right? They're the protagonist of this story. There are, I think, some good reasons to be a bit skeptical of that picture. And I don't think that there really is much, there would be much controversy about saying, I think, you know, when you learn about quantum mechanics
Starting point is 00:17:55 and you begin to see that there's this much bigger picture, you know, you begin to see that the wave function in this sort of story is a little bit of an oversimplification. I think if you pressed someone who works in physics pretty far, they would admit actually this picture is a little bit, it's a little bit too quick and there's a deeper picture beneath it. And so I think there's one view in what I'm saying here, your question, which is to take that,
Starting point is 00:18:20 those concerns and take them to their logical conclusions. Ask ourselves, okay, what does this theory really consist of? Is it really about wave functions at all? And for that matter, are wave functions things that describe objects that are really out there in the world? And this is where one lives in kind of a liminal space between physics and philosophy when you ask questions like that, on one hand, it's about physics,
Starting point is 00:18:42 it's about what's the right way to think about, what's the right way to think about, what's the right way to formulate, what may be our best, most successful scientific theory, certainly when it comes to numerical accuracy and precision. And on the other hand, what's really out there? What's out there in the world? What exists, right?
Starting point is 00:18:57 This is this word ontology that metaphysicians use. Ontology is the study of what really exists. And to ask, does the wave function describe something that physically exists? That's a question. To explain a little bit about how we've arrived here, I could say a little bit about the history, but let me just pause and ask, do you have follow-up questions about this? I want to make, you know, be careful to make sure we all have time to... Sure, sure.
Starting point is 00:19:23 So when you say that there's the standard picture of the wave function, you said, okay, what people are taught is that there's the wave function and it's connected to complex numbers and that it's also connected to probability somehow. Is that the picture that you're referring to? Are you referring to the picture that the wave function represents something in physical space and is of something? Yeah. So, when I say that, what I mean is,
Starting point is 00:19:45 when people say the wave function, when physicists speak about the wave function, it's the wave function of something, the wave function of an electron, the wave function of a so-and-so. So what is precisely this picture that you're about to shatter? Yeah, so this is an excellent question.
Starting point is 00:20:00 I think, you know, the issue here is that it's a little of both, right? The wave function plays a functional role in quantum mechanics. That is, it does certain things for you in the theory. We study its change with time. There's this famous equation called the Schrodinger equation, which roughly says that when a system is left to itself, it's not being disturbed. It's not exchanging information with any other systems. Then it has a wave function that changes with time in a smooth way.
Starting point is 00:20:39 And this smooth process is described by a differential equation, which is roughly speaking an equation that just tells you what the wave function is at each infinitesimally next moment given what it was at the previous moment. And this equation is known as the Schrodinger equation. So we plug in an initial wave function, we use the Schrodinger equation to figure out what the wave function will, how it will behave as time progresses. And then there are rules for taking the wave function and calculating predictions.
Starting point is 00:21:08 So that's uncontroversial. And I certainly agree with that picture that we should be using wave functions for that purpose. But I think it's easy to let that picture, it's easy to let that picture lead one to think that wave functions are describing physical objects out in the world. And, you know, when I think students arrive in a quantum mechanics class for the first time, without having studied the theory, they may think that, okay, every particle's got some wave function,
Starting point is 00:21:37 the wave functions are kind of like, they're kind of like waves in, you know, empty space is kind of like waves in, and you know, empty space is kind of like the ocean, and all the particles are kind of like small little waves moving around in the ocean. And that's actually not the picture that we get even from the textbook theory of quantum mechanics. In the textbook theory, a wave function is the assignment of a complex number to every possible configuration of your system. If you're talking about a single particle, nothing else, then every possible configuration is every possible location the particle can be in. Each location is labeled by three numbers.
Starting point is 00:22:18 It's x, y, and z coordinates, if you want. And so the wave function takes in those three coordinates and assigns it a complex number, and then we're supposed to do a mathematical operation of that complex number, and out comes a probability, more precisely a probability density, but a probability per unit volume that a measurement will find the particle at that spot. So the wave function can be thought of as the assignment of a special complex number to every point in three-dimensional physical space, where you do this operation, it's called mod-squaring, you do this operation, and then it tells you the probability, roughly speaking, with which a measurement will find a particle at that location.
Starting point is 00:22:54 So it's very easy to think that a wave function is like a field, like the electric field in three-dimensional space. But if you have two particles instead of one, then the possibility space is much more complicated. We call this possibility space configuration space because each possible configuration of a two particle system requires six numbers, not three. You need to know X, Y, and Z for the first particle and you need to know X, Y, and Z for the second particle. So the wave function assigns a complex number to a point in a six dimensional space.
Starting point is 00:23:26 Six dimensions because you need six numbers to specify its points. And that means a two particle wave function is a function we say whose domain is a six dimensional space. Six dimensional space is not physical three dimensional space. If you've got three particles, it's a nine dimensional space. If you've got ten particles, it's a nine-dimensional space. If you've got 10 particles, it's a 30-dimensional space. And actually, our universe does not have a well-defined number of particles at all. Our leading physical model for the universe,
Starting point is 00:23:56 at least for the non-gravitational parts of the universe, is the Standard Model, which is based on a set of models known as quantum field theories. And in quantum field theories, particles are emergent excitations of these sort of delocalized entities called quantum fields. And the number of particles can change from moment to moment. It's not always well defined. So it's not even clear how to even think about wave functions
Starting point is 00:24:23 that live in anything like physical space in the universe as we know it. So I don't mean to say that we're teaching our students wrong. We're not. I mean, students will learn this as they go on in their physics trajectories. But I think a lot of people on the outside or new students who haven't yet started their own journey in physics have a certain idea about what wave functions are like that's actually quite different from the way we use them in practice.
Starting point is 00:24:47 I don't know if that clarifies what you were asking about. Okay, so you have a lecture about how Hilbert spaces are also not real. I'd like you to talk about that. Now, it's my understanding that you more precisely said Hilbert spaces are redundant in the same way that gauge symmetries are redundant, or the gauge transformations are redundant. So at this point, if it's all right, let me do a little bit of history, if it's okay.
Starting point is 00:25:11 So where does quantum theory begin? Lightning, like grand tour of quantum theory, there are these actual physical objects called black bodies. These actual physical objects called black bodies. They are chambers that are heated and, you know, a little hole is poked in them. I mean, you don't really poke a hole in them. It's more complicated. But this is, I'm very much a theorist and my picture of experimental physics is, it should be better.
Starting point is 00:25:43 And I apologize in advance to anyone who's an experimentalist listening to me, but these were actual systems. People actually built these things. They were these chambers, they would heat them up, and then they would have a little hole in the chamber through which they could actually, they could see radiation coming out of them,
Starting point is 00:25:58 and they could put that radiation through experimental devices that could show them how intense the radiation was as a function of wavelength. Right, we all know that different wavelengths of light correspond to different colors in the visible range and if you go outside the visible range, you have very long wavelengths that are infrared or microwave radiation or radio waves
Starting point is 00:26:23 and at the very short wavelengths, you've got X-rays and so forth, gamma rays going all the way at ultraviolet, X-rays, gamma rays going all the way out to very short wavelengths. And you could just ask yourself, if I plot how strong the radiation is as a function of wavelength,
Starting point is 00:26:43 what kind of pattern would I expect to see? And the pattern that was revealed in experiments was difficult to explain on first principles theoretical grounds. A very important physicist, Max Planck, in 1900, found a way to generate a theoretical prediction of what this black body radiation curve should look like and it agreed with experiment.
Starting point is 00:27:09 But in order to get there, he had to kind of hack his formulas. He had introduced a fudge factor. He had to assume that radiation in this chamber could only occur in quantized amounts. That is, there were different wavelengths you could produce, but each wavelength could only be excited in discrete steps. This led to the quantum hypothesis. This was his quantum hypothesis. And there was a sort of parameter
Starting point is 00:27:39 that told you how big you wanted to make these steps. Today, we would call it a regulator. And this parameter, we now call it H, little h. We call it Planck's constant. Planck introduced it. And then I think at one point his idea was he wanted to introduce an intermediate step in the calculation and once he calculated everything,
Starting point is 00:27:58 sends this clearly in his mind, unphysical parameter to zero. But whenever he tried to send it to zero, he would get the wrong results. He realized this parameter was not zero, it was very small. It was today, it has a value, you know, that's of order 10 to the negative 34,
Starting point is 00:28:16 10 to the negative 33 in conventional units. And he couldn't get rid of it. And so he had, people had to accept that there was this basic discreteness in nature he couldn't explain. And then for the next 22, 23 years, the period from 1900 to 1922, 1923, physicists working on these questions were living in a time that today we call the old quantum theory, a paradigm we call the old quantum theory, a paradigm we call the old quantum theory. The old quantum theory was based on a mixture of physical pictures of particles
Starting point is 00:28:52 moving around in space, in orbits, like in atoms, and then a collection of ad hoc formulas and rules that people didn't fully understand that seemed to capture some of the observations that were coming out of experiment. But it was a very murky time. There wasn't anything like an underlying theory from which this whole picture emerged. And the formulas weren't perfect. They didn't work exactly right. In 1913, Bohr proposed, Niels Bohr proposed his famous model of the hydrogen atom.
Starting point is 00:29:26 This is a model in which you've got the nucleus and for the hydrogen atom it's just a proton, positively charged proton in the middle and an electron going around. And by making use of these sort of heuristic formulas that were characteristic of the time, Bohr argued that the electron could only be in certain definite orbits. And when it transitioned between them, its energy changed in discrete steps. And whenever its energy changed, it would either absorb or emit radiation in discrete amounts. And with this, he was able to account for the particular colors of radiation that we would see emitted from excited hydrogen atoms or that were absorbed by hydrogen atoms
Starting point is 00:30:05 The so-called line spectra and we also found that other atoms had line spectra as well Famously helium was discovered because we looked at the spectral lines from the Sun and after accounting for all the spectral lines We knew about there were still some more that we didn't account for and so people conjectured There was a new element They called it helium from Helios the Sun. And eventually we found helium on earth, but it was first discovered in the sun. So this was obviously a very important thing. And Bohr ended up winning the Nobel Prize in 1922
Starting point is 00:30:32 for this Bohr model. But by around 1922, certainly at least by then, people were becoming very skeptical because people couldn't take these clear pictures of particles moving in definite ways, particles interacting with fields like electric and magnetic field, which were well understood by this point. They couldn't take this world picture, this ontology, this picture of what was physically out there.
Starting point is 00:30:59 They couldn't find laws that when combined with this picture gave you the right predictions. They gave you an empirically adequate, empirical meaning subject to experiment, empirically adequate, a theory that was able to account for the things we were seeing and make predictions that were regularly confirmed. Niels Bohr gave a bunch of lectures in 1922. Heisenberg, Werner Heisenberg attends one of these lectures, at least one of them. And the story goes, and I'm not sure quite how much of the story is apocryphal or how much really happened, but the story goes that Heisenberg objected at one point to this lecture. Now Heisenberg at this point was 20 years old, maybe 21.
Starting point is 00:31:47 Niels Bohr was a Nobel Prize winning physicist, widely regarded as the quantum whisperer, someone who just innately, intuitively understood quantum mechanics in a way that no one else did. And here was Heisenberg challenging Bohr. People I think probably could have been expected to have thought that Bohr would be upset at this. But the story goes that after the talk, Heisenberg took a long walk with Bohr, a many hours walk,
Starting point is 00:32:12 and it had a huge impact on how Heisenberg thought about nature. The story, the legend goes that Bohr revealed to Heisenberg that, as Bohr put it, he was not convinced there were particles or orbits after all. You start seeing comments by people like Sommerfeld. Arnold Sommerfeld was actually Heisenberg's doctoral advisor in Munich, where Heisenberg was, and then people like Wolfgang Pauli, many of the people sort of at the foundations
Starting point is 00:32:42 of this developing theory were increasingly skeptical that this world picture could survive. And then in 1925, Heisenberg, who was visiting the premier institution in mathematics and theoretical physics at the time, Gerttingen, where people like David Hilbert were, Max Born was there, Felix Klein, top mathematicians and physicists. Heisenberg was there visiting, he was visiting Max Born's group, Max Born and his student, Pascal Jordan.
Starting point is 00:33:16 And he was thinking about all these questions and he was very confused about all of it. There were all these new, more complicated formulas that people were writing down that were connecting energy levels and transitions and atoms to spectra. And he develops this very terrible case of hay fever. In the spring of 1925, he goes out to Heligoland, which is this island where the Pall novels are much lower.
Starting point is 00:33:40 And he comes back with this totally bizarre draft of a paper. And he gives this paper to Max Born and to Jordan, and then he goes on a vacation again. He goes on some vacation. He's exhausted from all of his intellectual exertions. And this paper begins with these incredibly, these remarkable statements, statements that a philosopher of science
Starting point is 00:34:08 would immediately recognize as indicating some kind of paradigm shift. Heisenberg says at the beginning, we shouldn't be thinking about orbits anymore or particles. We should rephrase our physics, our theories, entirely in terms of quantities that can in principle be measured. And so he formulates this different way to think about quantum mechanics in terms of abstract objects that Max Born identifies as our matrices.
Starting point is 00:34:42 People who are listening to this may have heard of a matrix. Matrices and the subject that they belong to, linear algebra, that was not a standard part of the physics curriculum at this time. Heisenberg actually independently discovered matrices in this work and their mathematical operations. And Born recognized what Heisenberg was doing. And then together they wrote a couple of papers in which they introduced this thing called matrix mechanics. In matrix mechanics, there's no picture anymore.
Starting point is 00:35:13 There's no picture of atoms, of electrons, of particles going around atoms. There's just this abstract mathematical apparatus for predicting energy levels of things. Schrodinger comes along a few months later and through a series of theoretical arguments that I will not be able to do justice to here that connect with what's called Hamlet-Jacobi theory, which is a beautiful area of classical physics, Heisenberg proposes a different way to think about quantum mechanics.
Starting point is 00:35:40 He introduces his wave function. It's where it shows up in these papers. Schrödinger introduces his wave function. This is in early 1926. In some papers, both in German and in English, he wrote in both. He called this an undulatory theory of quantum mechanics, which is a beautiful word, right? Undulatory theory.
Starting point is 00:35:57 It's a lovely, lovely term. And he introduces his wave function. And at the time time he treats it, he regards it as a mechanical object. He knows right away that it lives in configuration space. He says this in these early papers, but he even says, maybe this is what reality is. Maybe reality is some giant mechanical wave
Starting point is 00:36:19 undulating in configuration space and through some mechanism that we don't fully understand, this undulating wave in this high dimensional abstract space somehow projects facts down into three dimensional reality, facts about where electrons are. He doesn't have the full picture here, but this is what he basically describes, and he's able to use this wave function as an indirect method for predicting energy levels. Max Born comes along very shortly thereafter and proposes that wave functions are not mechanical objects. They are mathematical tools. The reason they're complex valued is because they're not really
Starting point is 00:36:59 physical things. They're things that we operate on using these sort of mathematical operations to generate probabilities. The wave functions, when you take the complex numbers that they describe and you do this operation to them, what comes out is probabilities. That a wave function should be understood as a mathematical mechanism for generating probabilities. By 1928, Schrodinger is already recanting his view. He gives a lecture in 1928, his fourth lecture on wave mechanics, in which he says he used to think that wave functions were physical objects. He even presages in some ways
Starting point is 00:37:30 the many worlds interpretation. He says they're an object where every single thing that the system could be doing is really playing out in this giant wave function. But he no longer thinks that. He's accepted what seems to be the new idea.
Starting point is 00:37:45 And then within the next couple of years, 1930, Paul Dirac writes a textbook in which he summarizes all of the quantum mechanics that was known at the time, and he sews together Schrodinger's wave functions with Heisenberg and Born and Jordan's matrix mechanics, and he realizes they're all part of this deeper reality. There's this mathematical construction. It's a kind of a space called the Hilbert space, which is kind of a vector space, but it's a vector space with complex numbers in it. And when you look at the vector space in one way, you see wave functions. If you look at the vector space in another way, you see matrices.
Starting point is 00:38:21 You see what Heisenberg was doing. They're all parts of this mathematical structure called the Hilbert space. And then two years later, John von Neumann, the great mathematician, he writes a book, Mathematical Foundations of Quantum Mechanics, in which he formalizes this theory in mathematical terms. And that's basically what we've had ever since. Today, when people refer to the Dirac von Neumann axioms, or the textbook axioms of quantum mechanics, refer to the Dirac-von-Neumann axioms or the textbook axioms of quantum mechanics, they mean this prescription for generating predictions about what we'll see in experiments, empirical predictions. And this framework is based on Hilbert spaces.
Starting point is 00:39:01 Very roughly speaking, the first axiom says that every quantum system has this abstract space called a Hilbert space, which is not a configuration space, it's a different kind of a thing altogether, and that this state in some sense of a quantum system is represented by certain kinds of objects in this Hilbert space. State vectors, in the simplest case, are density operators, somewhat more complicatedly. The second axiom is that when left to itself, the system evolves according to, roughly speaking, the Schrodinger equation, more generally unitary evolution. And then there are three more axioms that talk about when a measurement is performed in the system, what you're likely to see.
Starting point is 00:39:36 These are the so-called measurement axioms. And one of them is about what kind of mathematical objects represent the things we can measure. These are called observables. One of them is about how to generate probabilities of what you'll see when you do measurements. That's called the Born Rule. And then the final one is that after a measurement, the state vector of the quantum state collapses.
Starting point is 00:39:54 This is the way we introduce quantum mechanics to students in textbooks now. If you go to my shelf and look at any of the textbooks on quantum mechanics, they will present something like these five axioms. Different people will sort them differently. They may not say there's five, they may present something like these five axioms. Different people will sort them differently. They may not say there's five, they may say there's four or six or some other number,
Starting point is 00:40:10 but I like to carve them up as five, right? So we know we have these axioms. We know that they're very good at giving us a prescription for generating empirical predictions. But what do they tell us about what's really going on in nature? Are they saying that the seat of reality really is some abstract Hilbert space, some vector space of possibly very high or infinite dimensions over the complex numbers, and that the universe is some object in this space trolling around according to some rule? There are some reasons to be skeptical of this.
Starting point is 00:40:47 One is that we can reformulate the axioms of quantum theory in a very different language. So people who work in various other areas of quantum physics, in mathematical physics, sometimes prefer to formulate quantum mechanics in terms of what are called seester algebras. C-star algebras are not things you find on the beach. They're not that kind of c-star, but they're abstract sets of mathematical entities that codify how systems evolve in quantum mechanics, how to generate measurement predictions
Starting point is 00:41:25 in a way that doesn't start with Hilbert spaces. When you take that alternative point of view, you get a very general mathematical framework from which the Hilbert space picture can emerge in certain, well, you can almost always pull out a Hilbert space picture in these stories. Sometimes you get a unique Hilbert space, sometimes you get a proliferation of different Hilbert spaces, and there's all kinds of deep questions about what that means.
Starting point is 00:41:52 But when I began learning about the C-straw algebraic formulation of quantum mechanics, it opened my mind, as I think it does a lot of people, to the idea that maybe the Dirac-von Neumann axioms, the ones we hear about in the textbooks, phrased primevally in terms of Hilbert spaces may not be the end of the story and that Hilbert spaces may not be the most fundamental way to think about the structure of quantum mechanics. I think one can go much farther and maybe we'll talk a little bit about how one can go farther than that, but once you already begin to see that there are mathematically equivalent ways to formulate quantum mechanics that don't start with Hilbert spaces,
Starting point is 00:42:25 it makes you become somewhat skeptical that the Hilbert space picture is fundamental and that the objects in the Hilbert space picture, state vectors that become wave functions when seen in a certain way, that these are fundamental objects. Well, what is it about the C-star approach that allows you to say that the Hilbert spaces that can come from the C-star approach implies that the Hilbert spaces are more illusory? Is it that the C-star algebras allow you to calculate something that the Hilbert picture doesn't, but yet allows you to calculate all that the Hilbert picture does? So does it subsume it? So that's an excellent question. In the standard approach to quantum mechanics, the first of the three measurement axioms says that every observable thing you might want to look at is represented by a kind of a matrix, more technically a self-adjoint operator on the Hilbert space.
Starting point is 00:43:15 It's just, it's kind of like an abstract mathematical entity that you can add other such entities and multiply them together. It behaves kind of like a number, kind of like a variable X in algebra, but a little weirder, like they don't always commute with each other. They're kind of strange objects, but we have a mathematical set of tools to take these and generate empirical predictions.
Starting point is 00:43:39 When you start with the textbook axioms, you begin with the Hilbert space, and then these operators are things that come out of the Hilbert space. And then these operators are things that come out of the Hilbert space. In a C-astro algebra approach, you go the other way around. You begin with an abstract specification of the observables, which are represented by these abstract mathematical symbols.
Starting point is 00:43:59 And the symbols have all kinds of mathematical properties, rules for how you add them together, multiply them, just like I said, but they don't begin as objects that live in Hilbert spaces. They have their own existence, their own identity. And there's even, like, a funny way that people who work in this field sometimes talk about it, that they'll say, are you a Hilbert space conservative?
Starting point is 00:44:19 Meaning you take the Hilbert space to be the starting point. Or are you an algebraic imperialist? Do you take the algebraic objects to be the starting point, or are you an algebraic imperialist? Do you take the algebraic objects to be the basic ingredients? When you start with these basic algebraic ingredients, they form a special kind of mathematical structure called a C star algebra. The C stands for closed,
Starting point is 00:44:36 which just means that there's like no holes in the algebra. It's all filled in all the way. And the star just refers to the operation of, it's a complex conjugation, but on these objects, roughly speaking. And there's some other properties you require these to have, but very rudimentary properties.
Starting point is 00:44:51 And then what you can show is that there is a way to construct a Hilbert space out of these algebraic objects. And once you've done that, then they become the matrices or operators in that Hilbert space. But once you see this construction, it's called the Gelfand-Neymarck-Siegel construction. It's a beautiful theorem. Once you see it done, you begin to wonder just how fundamental Hilbert spaces really are.
Starting point is 00:45:14 Especially because some of these C-star Algebras do not generate a unique Hilbert space. And now you have this question of exactly which Hilbert space you're supposed to use. And that's where the Hilbert space redundancy comes from. In a way, yeah. So, you know, for simple systems, if you've got one particle or three particles or 10 particles, it turns out you basically get a unique Hilbert space. So you really can think of either of them as being fundamental. But when you consider systems that have infinitely many moving parts, so a system of so many
Starting point is 00:45:42 particles that will model it as if it has infinitely many particles, we do this in thermodynamics, or a quantum field where there's like variables at every point in all of space. For these kinds of systems, you don't necessarily get a Unic-Hilbert space out. And then there's this question of which is more fundamental. And that's an ongoing controversy right now. It's called the problem of unitarily inequivalent representations of C-star algebras. And it's an ongoing mystery at the foundations of mathematical quantum mechanics. Earlier we were talking about Heisenberg and how he started with observables and Schrodinger
Starting point is 00:46:16 didn't. And now you're talking about taking those observables seriously and forming an algebra of just them called the C-star algebra. But then you also said that you can take representations of the observables which become matrices. And Heisenberg was dealing with the matrices. Exactly. Okay. Yeah.
Starting point is 00:46:32 Your picture is exactly correct. So now this isn't what I'm working on right now. But when you begin to realize that you can reformulate the rules of quantum theory in a different way, it kind of opens your mind up to other possibilities. I want to know what your mind has been opened up to. Yeah. Where is your mind these days on quantum mechanics? That's an excellent question.
Starting point is 00:46:50 So let me go back to Wigner's thought experiment again, because I think this is a good hook for where I end up and where I think a lot of people end up. So what was this thought experiment about? In a way, I mean, it's a thought experiment that a lot of people in physics and certainly philosophy of physics are familiar with. It's a real good workhorse in quantum foundations. But I think there's still a lot of lessons to learn from it. And people have extended this thought experiment in lots of different, there's the so-called extended Wigner's Friends and Areos that a lot of people are working on.
Starting point is 00:47:22 But I think the original version of it is actually really, really nice. And like I said, phrased all the way back in 1956 in Hugh Everett's original thesis. But it's a very simple question. The axioms say that we have a Hilbert space and we represent the state of the system as some object in this Hilbert space. Questions we can ask observables are represented by these symbols. We can generate probabilities, and then after a measurement, we collapse. Why do we collapse? What's the purpose of collapse? Collapse is to ensure robustness of measurement results.
Starting point is 00:47:54 After you do the measurement, you're guaranteed to get the same result again. That's what collapse accomplishes. It ensures that once you've gotten a definite result, if you measure right again before you've given the system any chance to evolve further, you're guaranteed with almost 100% probability to get the same result. Now, the problem of course is that, well, what is a measurement? What kinds of physical processes count as measurements? One view is, we don't need to worry about this.
Starting point is 00:48:22 One view is, all scientific theories are ultimately instrumentalist enterprises, meaning that they exist solely to allow us to connect preparations, setups of measurements to predictions of measurement outcomes or measurement results. That's all a scientific theory is meant to do. Doing anything else, painting pictures of reality is all just there for color.
Starting point is 00:48:45 It's like a fable. It's not necessary. It's philosophy. It's metaphysics. It's not important for physics to do that. And the theory does that. The theory says that we do a measurement. Here's what comes out. The theory is doing what it's supposed to do. What more could you ask of it?
Starting point is 00:49:03 The theory says when we do a measurement, we do this thing, we run this prescription, we collapse the quantum state of the system, and then we proceed. It all works just fine. What's your problem? The Vigner's Friend Thought experiment considers two observers.
Starting point is 00:49:18 One is Vigner in the outside world, enjoying a nice sunny day, maybe a nice beautiful autumn day like today, and Wigner's friend who is inside a perfectly sealed box. Now, people may wonder in quantum mechanics, can you really seal anything in a box? Can't things tunnel out? Well, particles can tunnel out of certain kinds
Starting point is 00:49:41 of enclosures, but if you make the box thick enough, impenetrable enough, in some highly idealized sense, then you can keep everything inside the box, at least for the duration of the experiment. Wigner's friend is inside this box along with some quantum system, some system that is in a superposition of two possibilities, a particle that is spin up and blended with spin down
Starting point is 00:50:04 in some superposition, let's say Vigners friend Engages in some interaction that you might call a measurement on this superposed quantum system inside this box Vigner on the outside of the sealed box does not do a measurement does not in any way learn what has happened Now we've got two observers and now we have a question Do we activate the collapse postulate or do we not activate the collapse postulate? We have two observers, we have to now take a stand.
Starting point is 00:50:33 We have to say whether we activate it or not. And there are only a few possibilities. One possibility is yes, we activate it. We activate this measurement axiom, The quantum state of the system collapses. Even though Wigner on the outside has not seen anything, it just collapses. For everybody, it just collapses. But now we have a question.
Starting point is 00:50:56 Wigner's on the outside, why should Wigner think it collapsed? Because Wigner's friend did a measurement? But how do we know that the thing Wigner's friend did a measurement? But how do we know that the thing Wigner's friend did qualified as a measurement? Wigner's friend is just some physical system in the box. If Wigner's friend were replaced with an electron that somehow interacted with the other particle, we wouldn't have called that a measurement. If Wigner's friend is replaced with a water bear, you know, a tardigrade, one of those microscopic,
Starting point is 00:51:28 very resilient organisms that are very hard to see with your naked eye, would that have done a measurement? Like now we just have a physics question. At what point do we cross the line into yes measurement or no not measurement? Now, there's this thing called decoherence that one often hears in these sorts of discussions. Oh, when a big system interacts with the quantum system, there's this thing called decoherence.
Starting point is 00:51:52 Decoherence changes the quantum state of the system being observed, but decoherence does not collapse anything. It doesn't single out one result. And you can actually show that there's no way to take the non-collapse axioms of quantum theory and get a definite result out, to get one result singled out from all the others. So the question is, what do we do here? In principle, we need to supply a rigorous definition of what kinds of processes are measurements and what kind are not, and this is called the measurement problem. We don't have such a rigorous definition, and we haven't for 100 years.
Starting point is 00:52:30 Maybe one day someone will come along and say, this is what a measurement is, and this is not what a measurement is, but at this point we don't have that statement. And without it, we just have this ambiguity. This is the famous measurement problem. That's one possibility. The next possibility is to say, there is a definite outcome of the experiment, but somehow it happens without a collapse.
Starting point is 00:52:50 Or collapse is perspective-based, perspectival. Wigner's friend sees the collapse, but Wigner on the outside doesn't. But if you take that horn of this dilemma, trilemma, quadrilemma, you take this path, then what you're saying is that Wigner on the outside has some quantum state he uses to describe the system, and this quantum state is incomplete.
Starting point is 00:53:14 It doesn't know the definite result that happened in the experiment. And if you're accepting that the wave function is incomplete, you're accepting that there are additional or hidden variables beyond the wave function, which again is not consistent with the textbook formulation of quantum theory, at least according to the usual axioms. The third possibility is you replace measurement with something else, some kind of dynamical process by which things just naturally collapse when they're big enough. And there's a whole collection of approaches to quantum foundations
Starting point is 00:53:40 called dynamical stochastic collapse approaches that do this. The wave function or quantum state is this thing, and for individual particles, it persists a very long time before collapsing. But when you put enough particles together, if any one of them collapses, the whole thing comes crashing down, and this explains why very big objects naturally collapse very quickly. That's option three. Those approaches are very interesting.
Starting point is 00:54:04 Some of them have been tested experimentally. They involve a lot of new parameters and you have to guess equations and we don't really have a well-motivated way to understand which ones to use. The fourth possibility is that there just isn't an outcome. No one gets a definite measurement. Either there's no outcome at all,
Starting point is 00:54:28 which doesn't really seem to make sense, or all the outcomes happen in some sense. And this is what Hugh Everett argued in his thesis, when he considered this problem. There's no collapse, we get rid of the collapse axiom, and Wigner's friend splits into two parallel copies, each of whom sees a different outcome. One sees spin up, one sees spin down, and these are inside the box.
Starting point is 00:54:48 Wigner on the outside also doesn't register a definite outcome. If the box opens up, then Wigner sees the definite outcome, and Wigner splits into two copies. And the universe kind of unzips as the copies propagate and branches or the wave function of the universe splinters into multiple possibilities. This is the many worlds interpretation and it's an ongoing source of dispute.
Starting point is 00:55:09 There were a lot of questions about how to make sense of basic questions about identity and philosophy of mind in the universe like that. It's not clear how to make sense of probability in the universe like that. There's ongoing debates about how to make that work. That's basically what we're left with.
Starting point is 00:55:23 That's what this vigorous and thought experiment leaves you with. You have to make a decision. That's basically what we're left with. That's what this Vigner's Fan Thought experiment leaves you with. You have to make a decision. I guess there's a fifth possibility, which is just quantum mechanics is wrong. But until we have good reason to think it's just wrong, we probably have to operate under the assumption that we need to make the theory work better.
Starting point is 00:55:39 So this, I think, is a good motivation for taking seriously that there's something wrong with the axioms of quantum mechanics. We need to do something about them. It's not just that they're instrumentalist, but they're either ambiguous or incomplete or inconsistent in some way and we need to fix them. Where does that leave me and where do I come in?
Starting point is 00:55:57 One way to understand what I'm trying to do is going back to 1922, just when people were ready to abandon the old pictures of particles and fields and actual things out there, doing things, behaving. And just as people were about to give up on finding laws, acting on those ingredients that would give you an empirically adequate theory,
Starting point is 00:56:22 maybe it's premature to give up. Maybe we need to think a little more generally about what form laws can take. So by 1922, people already understood that you could have laws that were chancy, chancy, probabilistic, laws that didn't tell you in a definite deterministic way what was gonna happen, but laws that simply told you probabilistically
Starting point is 00:56:47 what would happen. We knew about these. Einstein certainly knew about these kinds of models. One of his great papers in 1905 was on Brownian motion. This helped provide solid evidence for the existence of atoms, even allowed you to figure out how big the atoms were. And this is a model based on what's called
Starting point is 00:57:06 a stochastic process, stochastic from the Greek word stochasticos, which means to aim or guess. These are models where the laws predict probabilistic behavior. So people knew about these things. Markov had introduced the Markov matrix by the early knots, 1906 or something like that.
Starting point is 00:57:27 So these ideas were in the air and people were thinking about, well, quantum mechanics behaves in an unpredictable way. Maybe that unpredictability could be captured in probabilistic laws, but people couldn't come up with the right set of probabilistic laws at the time. couldn't come up with the right set of probabilistic laws at the time. Over the years, people did try to come back to this question. In fact, in Hugh Everett's thesis, he talks about an effort by a physicist named Fritz Bopp that replaced the usual quantum mechanical formalism with probabilistic laws, with particles moving around according to probabilistic laws. And Everett actually said this was a promising direction. He wasn't gonna study it in his thesis,
Starting point is 00:58:12 but this was worth paying attention to. Several other people worked on these proposals, Imre Fenyes in like the 1950s, most famously Edward Nelson in the 1960s. But the models were very complicated. To get the same predictions that you get from the textbook theory of quantum mechanics, you had to, this is the one political thing I'll say, gerrymander. You had to gerrymander, I mean this in metaphorically the same sense, you had to gerrymander the laws. You had to start with
Starting point is 00:58:42 what we knew was supposed to be predicted and then work backward and design these incredibly complicated stochastic laws in order to get the same predictions. So it just felt very unmotivated. The spirit was a very interesting spirit. Let's just have particles bouncing around or fields, whatever, evolving. Without a Hilbert space, without wave functions, let's just directly give them rules that are probabilistic and in such a way that those probabilities agree
Starting point is 00:59:09 with the probabilities we see for measurement outcomes in our experiments. But getting the idea to work was hard. It wasn't clear that we had the right kinds of laws to do it and the laws to make them work even in the simplest cases required a lot of fine tuning and gerrymandering. And when you look at, for example,
Starting point is 00:59:26 Nelson's stochastic mechanics, you know, his laws are super complicated. And you actually have to first find the wave function from the Schrodinger equation, then you plug it into these laws, and laws involve rates that go forward and back, incredibly complicated. There were rival approaches.
Starting point is 00:59:43 So, Louis de Bois introduced a pilot wave theory in the 1920s that was independently discovered by David Bohm. And these theories were based originally on hidden variables, particles, that were piloted around by the wave function, in some sense. When you try to extend these models beyond systems of non-relativistic particles, but to like relativistic systems and fields,
Starting point is 01:00:06 it gets very complicated and you end up having to deduce probabilities and stochastic laws again. So there seems to be this understanding that ultimately, to describe most kinds of quantum systems we'll need something like laws that are inherently probabilistic. But none of the probabilistic laws that people knew about seemed to work well. They either didn't work or required so much fine tuning
Starting point is 01:00:28 that they just seemed unmotivated. In 2022, I was trying to teach a class and I had a problem. We were getting to the point in the class where I was trying to introduce a little bit of quantum mechanics. And I was trying to decide how to do it. And I taught this class a few times. Which class?
Starting point is 01:00:48 It's called Introduction to Theoretical Physics. It's Physics 19 here at Harvard. And we cover a lot of topics in the foundations of theoretical physics in this class. Throughout the class, we're introducing some concepts from quantum mechanics, but this is sort of toward the end of the class, and I'm trying to give them a nice self-contained preview of quantum mechanics. But these are students who are mostly very new to physics. Many of them are just beginning to learn college level mathematics.
Starting point is 01:01:16 So I can't start by talking about Hilbert spaces or C star algebras or the GNS theorem or any of those things. I need to find a more friendly way to get into quantum mechanics. And every year I would just tear apart my curriculum and try again. I was never satisfied with how I was doing it. Sometimes I would say maybe we'll just start with wave functions and sometimes I would say maybe we should start with matrices. I just, I couldn't come up with a way that I wanted to do it. And in the fall of 2022, I remembered back to a couple of projects I'd worked on as an undergraduate and even in graduate school where I needed to use the theory of stochastic processes
Starting point is 01:01:58 in order to, you know, in undergrad, it was like a special extra homework assignment for a linear algebra class. In grad school I actually used it for simulations. And, you know, the theory of Markov chains and stochastic processes, it bears some very vague resemblances to quantum mechanics. It's got probabilistic laws. You represent the probabilities for a system with a vector. Evolution in time is represented with matrices. Now, they're all a little bit different. The probabilities don't involve complex numbers.
Starting point is 01:02:36 The matrices are what are called stochastic matrices. But there are these like resemblances. And so I sat down and I thought to myself, maybe I can find some way to bring these two theories together. The theory of stochastic processes on the one hand and the theory of quantum mechanics on the other hand. I had this sort of image in my mind of like walking along the edge of a chasm. On one side you had sort of the classical world,
Starting point is 01:03:06 classical stochastic processes, probabilistic processes. On the other side, you had quantum mechanics. And there was this huge gulf between them. And I was looking for a place where maybe the cliffs came closer together and where it was easier to hop across from one to the other. So I began modifying the mathematics of the theory of stochastic processes and
Starting point is 01:03:26 quantum mechanics to try to bring these two pictures closer and closer together. I was doing this without really knowing very much about this earlier work that had been done. The work of Bopp and Fenyes and Nelson. If I'd read all those papers I would have given up because I would have decided it was impossible. But sometimes you can only do something if you don't know it's impossible. I did know it was impossible. So I brought these theories closer and closer together expecting that there would be a moment when I would need to make some kind of jump to get from one theory, classical physics, to the other theory, quantum physics. And the strangest thing happened.
Starting point is 01:04:06 The two cliff faces merged and there was just no, no chasm anymore. Uh, for those who are familiar with second order phase transitions in statistical mechanics, it was like I had reached a point of a second order phrase transition on one side. You have the, um, you know the two phases of some substance, like water, right? And then you go past a point and the phases merge and there's only one super phase, right?
Starting point is 01:04:31 There's no distinction between like liquid and gas anymore. Right? So, and I didn't understand what had happened. I was very confused. So I began looking in literature to see if other people had done what I had done and no one had done what I had done. No one had, I guess, thought it was worthwhile
Starting point is 01:04:49 to try to do this thing that I was doing. But I began to read some of the literature on stochastic processes and Nelson's work and I was confused. Why had they not succeeded when this seemed to work? And it was about October of 2022, I know because I went to the office of one of my colleagues, the great Logan McCarty,
Starting point is 01:05:09 who directs science education here at Harvard. He's a quantum chemist. He knows quantum mechanics backward and forward. And I went and I talked to him and I went to his, he had a whiteboard and I began like writing out everything I was doing. Because at that point I'd realized that the secret sauce, the thing that made this work was I had implicitly given up an assumption I didn't even know that I was supposed to make or that anyone had made.
Starting point is 01:05:37 When people model stochastic processes, they usually assume that the process is a Markov process. Named after Markov, like Markov, the Russian mathematician who introduced Markov matrices. A Markov process is a process where, if you wanna know what's going to happen to your system, all you need to know is what's going on right now. And then the laws tell you at least probabilistically what will happen next.
Starting point is 01:06:01 It's memoryless. Memoryless, exactly. It's memoryless. Now, Brown. It's memoryless. Memoryless, exactly. It's memoryless. Now, Brownian motion is memoryless. That was Einstein's stochastic model for atoms. And the generalizations of Brownian motion, Wiener processes, and many of the familiar processes that we have heard of, random walks, Poisson processes,
Starting point is 01:06:21 these are all Markov processes. Nelson's work, a Markov process, they are all Markov processes. Nelson's work, a Markov process, they're all memoryless processes. Now, I was vaguely aware that there existed a subject called non-Markovian stochastic processes. And I went and I looked in textbooks to see if anyone had done what I was doing. And usually at the end of the textbook,
Starting point is 01:06:43 the textbook would say something like, and that's it for the theory of stochastic processes. There is a larger subject called the theory of non-Markovian stochastic processes, but this is too complicated, it is beyond the scope of this book. So it was very hard to find any books on non-Markovian processes.
Starting point is 01:06:56 And I went into the literature and I discovered some people were trying to develop tools for handling non-Markovian processes. There's some that can be turned into Markov processes with a change of variables. They become what are called hidden Markov processes. And some of them, if they're just sufficiently non-Markovian, are just super hard to deal with.
Starting point is 01:07:15 And so it just feels like the Wild West. There's just this discipline going beyond the Markov approximation that a lot of people didn't really, you know, felt a little uncomfortable exploring. It wasn't clear how much we needed them. I mean, Markov chains are really good at modeling the world around us. Do we really need to spend so much time worrying
Starting point is 01:07:32 about non-Markovian processes? And what I realized was that I had inadvertently introduced a kind of a non-Markovian process without realizing it. As I plumbed this more, I discovered that what I was working with wasn't even a non-Markovian process in the most familiar sense. It was an entirely,
Starting point is 01:07:52 it was a more general kind of a process that first shows up in the research literature in 2006. It's called an indivisible process. Indivisible processes are in some ways the most general kinds of rules, dynamical laws, generally probabilistic, that fail to have that Markov property. They're more general than what we usually think of as non-Markovian processes. I guess there's more than one way to be non-Markovian, and people had a very particular idea of what they meant as non-Markovian processes. I guess there's more than one way to be non-Markovian,
Starting point is 01:08:26 and people had a very particular idea of what they meant by non-Markovian. This is like even more non-Markovian than a non-Markovian process. These processes first showed up when people were trying to understand the kinds of dynamical rules that describe Hilbert space objects.
Starting point is 01:08:42 So not what I had in mind. They were already in the Hilbert space picture trying to describe how objects in the Hilbert space picture could evolve in time. And for them, an indivisible process was just a law that could tell you how your process would evolve from one time to another, but couldn't be divided up into smaller times.
Starting point is 01:09:02 So you have a law that tells you how to get from zero to the final time, but the theory just doesn't give you laws for the intermediate times. That's it. That's the indivisibility. Certainly not laws that can be iterated and concatenated into a bigger law. And if you think about it, this is certainly more general than divisible laws. I mean, because there's this bigger category where we don't have some of the properties we might want a lot to have divisibility. Newtonian mechanics is divisible. You evolve a system from an initial time to some intermediate time.
Starting point is 01:09:32 And then you can stop, look at the system state right now. And then if you want, you can use Newton's laws to tell you what will happen next. Nice and divisible. The Maxwell equations that describe the evolution of electric magnetic fields are divisible. And quantum mechanics, as usually formulated in terms of the Schrodinger equation, beautifully divisible. The Schrodinger equation tells you how the quantum state will evolve, and you can evolve it however far you want, and then read off the quantum state in some way, and then predict where it will go next.
Starting point is 01:09:58 Is another way of saying divisibility as a continuous time parameter? That's a good question, not necessarily. Because you could imagine an indivisible process where you're allowed to go from the initial time to any time you want, so time is smooth. But once you pick one of those times, you don't have a law that will tell you how to get from that time to later times.
Starting point is 01:10:21 So time is not necessarily discrete here, it's an excellent question. But what you lack is the ability to break time up into smaller intervals. Yeah. So we just don't have much experience with these kinds of laws until this paper comes out in 2006. It's called Dividing Quantum Channels by Ignacio Chirac and Michael Wolff. Ultimately, it was published in 2008 in Communications and Mathematical Physics.
Starting point is 01:10:43 And people play around with these. You know, the paper gets a lot of citations. It's not until 2021 that a couple of folks introduced the idea of a classical process that could be indivisible. Like just a process where the system has some configuration and it's changing its behaving in some probabilistic way, but the way it's behaving probabilistically is indivisible.
Starting point is 01:11:10 That shows up in a figure on like page 15 of this beautiful review article by Mills and Modi, where they mention the idea that you could have a process like this. I didn't know it existed. I came up with the term indivisible independently by Mills and Modi, where they mention the idea that you could have a process like this. I didn't know it existed. I came up with the term indivisible independently because I didn't want to use irreducible, which is used in so many ways in physics.
Starting point is 01:11:33 I didn't want to use... I basically just was looking for a word that would give you, evoke the right idea. And it turned out they used the exact same terminology. So this was a year before I did it. They did not connect it to quantum mechanics. They were just mentioning, oh, it's a possibility you could in theory have a classical process with probabilistic behavior where the laws are not rich enough. They're too sparse.
Starting point is 01:11:56 They won't tell you how to go from any time to any other time. You can only evolve from certain times to other times. The process in general doesn't divide. What I had inadvertently done was discovered these indivisible stochastic processes and shown that there was just a change of mathematical representation that would take such a system with classical like configurations, could be a system of particles,
Starting point is 01:12:22 could be a system of fields, whatever we're trying to model. And if it has indivisible stochastic laws, then through this mathematical representation, this, this correspondence, you get a Hilbert space picture. Super interesting. Yeah. And all the weirdnesses of the Hilbert space picture, superposition of states, interference effects, these are all related to what are called coherences,
Starting point is 01:12:46 phases, right, all these things are connected to superposition interference and coherences. These could be understood now, they could be given a meaning. So in textbook quantum theory, these things don't have meanings. They're just pieces of mathematics that show up in the formalism. We don't understand what they mean. We know that interference shows up in experiments. We know that these things called phases or coherences or superpositions, we see these show up in all over the place. But they don't directly have like a physical meaning.
Starting point is 01:13:18 We don't know what they represent and what they really mean. What I was able to show is that in going from this very physically concrete picture of objects, of a clear ontology, probabilistically evolving in this indivisible way, in going from that picture to a picture with a nice Schrodinger equation where the evolution is divisible, it's a nice differential equation, very familiar mathematics, in going to that picture
Starting point is 01:13:48 that looks divisible you have to give something up. That indivisibility doesn't disappear, it becomes all those weird phases, interference effects and coherences. That's how they manifest in this picture. It's like there's no free lunch. If you want a picture that's mathematically convenient and simpler, a picture where you can evolve a system any amount of time you want, pause, re-evolve, a nice divisible dynamical picture, you have to pay the price. And the price is that all that indivisibility becomes these weird phases. In some very loose sense. If you want to think roughly speaking of these indivisible processes as being like processes with memory,
Starting point is 01:14:35 all those interferences and phases, those are the memory encoded in this strange way. And that's the picture. That's fantastic. Yeah. So in this picture, there's no fundamental role for a wave function. I mean, you just have objects bouncing around according to laws that are more general than laws of Newtonian mechanics, or even the laws of a Markov process. And if you want to model a measurement, you just model another system that interacts with your first system, give the whole thing a nice simple set of stochastic, indivisible stochastic dynamics. And what you'll find is that the measuring device
Starting point is 01:15:08 will stochastically evolve into one of its final readout configurations with exactly the correct probability that we would expect from the Born Rule. But there's no wave function, there's no collapsing. It's just some big stochastic process happening. So what's doing the choosing of what interval to make that time? You said that you can choose any interval, but then you can't choose a subinterval. Right. This is an excellent question. So in order to get an indivisible stochastic process started, you need a time at which you can begin, right? And then the process tells you probabilistically where the system will end up
Starting point is 01:15:48 at really any smooth choice of later time. But is there just one special time where things can get started? The answer is no. What you can show is that when you have a system interacting with some larger system, so not left to itself, interacting with some larger system, what not left to itself, interacting with some larger system.
Starting point is 01:16:07 What you find is that if this larger system is exchanging information with your original system, as would happen if you've got like a measuring device reading out the configuration of your system, then when it does this, you just let the stochastic process tell you what happens. There's no axiom here. You let it evolve and what you discover is that you get a division event. The evolution divides at that moment, seen from the point of view of the smaller system.
Starting point is 01:16:35 And now there's a new time at which the evolution breaks and you can start now again from that new time. So in the stochastic process, it's not that there are no times where you can divide. There are times at which you can break up the evolution, but the times aren't given to you at the beginning. They're not fundamental. They arise from mutual interactions between systems. Now, when you ask, what does this look like from the Hilbert space point of view in the standard textbook this look like from the Hilbert space point of view in the standard textbook quantum
Starting point is 01:17:08 mechanical picture, the Hilbert space point of view, what do those division events look like? They look just like decoherence. So decoherence, again, is when a big system interacts with maybe a smaller system, the environment comes in, interacts with the system, exchanges information, and we get these changes to the quantum state of the other system,
Starting point is 01:17:24 changes that don't single out one answer, but do change it in some way. Those changes kill off the coherence effects, they kill off interference effects. From the point of view of the indivisible stochastic process, they just look like the generation of a new moment, a new division event, an event where the evolution can be started again. And this happens at the end of measurements. And this is a physical process in this picture. And it coincides with what you would call a measurement. But it's generated by the laws of this picture themselves.
Starting point is 01:17:56 Okay, I'm confused. So division events, is that just another relabeling of what a measurement is? Good question. So in a way, sort of, if you give me a second system that I model explicitly, so let me phrase it in a different way. In the textbook axioms of quantum theory, measuring devices are treated as outside the formalism. Right, they're kind of in the background. They're kind of like the person behind formalism, right? They're not, they're kind of in the background.
Starting point is 01:18:26 They're kind of like the person behind the curtain, right? We do a measurement and we just sort of change the quantum state of the system being measured, but we don't usually explicitly put the measuring device into the description itself. If you try to do that, if you try to put the measuring device into the description, what you find after a measurement is that the measuring device and its possible readout configurations become entangled with the possible configurations of the system being measured.
Starting point is 01:18:56 There's this entanglement that happens. And the question is, well, then what? Now they're entangled, what do I do? What you're supposed to do is collapse down to one of those entangled branches. That's the collapse. Now, if there's a bigger environment that comes in, and the bigger environment looks at the measuring device, then it gets entangled with the measuring device, and there's this operation, this sort of formal operation
Starting point is 01:19:22 where you can kind of ignore the environment. And you see that there's a suppression of all the interference effects, but still no singling out of one outcome. You have to at some point pull the, you know, the fifth axiom, you know, activate it, and collapse down to one thing at some point. In this indivisible picture, you can bring in that measuring device, you bring it in, you let the overall system evolve stochastically, and what you find is that, and bring it in
Starting point is 01:19:49 an environment, the environment comes in, you can treat them all as actual systems. None of them are outside the formalism, they're all modeled as systems in the formalism. And what you find is when you let these systems evolve, the system being measured and the measuring device probabilistically evolve toward the configurations that we would expect from the collapse axiom. And because of the environment, you can show that the measuring device and the subject system,
Starting point is 01:20:19 they experience a division event at almost exactly the moment of the interaction that we would call a measurement. And this division event means that you can now restart the laws and start them from this moment. This division event is not postulated, it's not an axiom. It's something that just shows up from the usual rules of probability theory when you actually model the systems explicitly.
Starting point is 01:20:47 So in a way, it is a measurement, but it doesn't require a conscious being. It doesn't require a human. Any system that has a robustly large number of moving parts, we call them degrees of freedom, in contact with a nice big environment with a big number of degrees of freedom, will to an extremely high level of precision, produce measurement results that probabilistically coincide with what we would expect from textbook quantum theory and will generate a moment at which the stochastic dynamics of the system being measured in the measuring device can be restarted and have their own dynamics.
Starting point is 01:21:31 So, yes, in a way it's a measurement, but it lets us get inside the measurement. It lets us see the measurement actually happen, and it gives us a way to understand why measurements do this thing, rather than merely positing that they collapse wave functions. So do you require three different systems to be stated? So the environment, the measure, and the measured? Yes, that's right. And we require that in standard quantum
Starting point is 01:21:59 measurement theory anyway, the usual textbook theory, the environment as well. Environment is needed. Yeah. Yep. Because the usual argument is that the environment is well? The environment is needed, yeah. Yep, because the usual argument is that the environment is what generates the decoherence of the measuring device and the system being measured. But when you say the environment, I mean, in any realistic measuring device, you have, you know, the part of the measuring device
Starting point is 01:22:17 that's actually directly engaged in the measurement, but then you have the rest of the measuring device. I mean, it's a big object, it's in a box, it's got dials, it's got other experimental things on it. I'm sorry, this is me not being a very good experimentalist again. But that's, yeah. So there's almost invariably always an environment. So you firstly describe the environment, the measure,
Starting point is 01:22:41 and the measured classically, and then you do some, your version of a quantizing procedure? Yeah. So you model them classically in the sense that they have classical-like configurations. The measuring device is some system, some physical object that can be in different possible configurations. Among those, we include at some level of coarse graining. We include, you know, the system is empty.
Starting point is 01:23:09 It doesn't yet show a reading. The system shows spin up on the dial. The system shows spin down on the dial, you know, like. But these are concrete configurations made of particular configurations of the constituent atoms, whatever you want. So that is to say that their configurations, their ontology, their physical existence
Starting point is 01:23:28 is visualized in a roughly classical way. The quantum part is that the laws they satisfy are not deterministic differential equations like Newton's law or a Newton's laws or the Maxwell's laws of electromagnetism. The laws we give them are these indivisible stochastic laws, which we don't usually see in classical systems. The claim is that when you give these systems these more general kinds of laws,
Starting point is 01:23:54 that's enough to make them behave like quantum systems. So what is it that's jittering around or being random here? Good question. So all these systems have configurations and these configurations are evolving according to stochastic laws. That is to say that the configurations are changing with time in a probabilistic way.
Starting point is 01:24:17 Now, why are they changing in a probabilistic way? I don't know. These are the axioms, right? At some point you have a physical theory, you have to propose some axioms. I mean, there's a posture in how we think about basic questions in philosophy called foundationalism. You have to begin with something. The standard textbook version of quantum theory, which works fantastically well, and I'm certainly not making any claims
Starting point is 01:24:48 that any of the predictions it makes are wrong. They're all spot on. Those axioms are axioms. And they're very strange. We posit Ilbert spaces and state vectors or density operators and the Schrodinger equation and self-adjoint operators and all the collapse postulate. And we postulate them because with these axioms,
Starting point is 01:25:11 we get the right predictions empirically. This picture I'm presenting has axioms too. The axioms are simpler. Every system just has a set of possible configurations, classical like configurations. And the laws are these indivisible stochastic laws. That's it.
Starting point is 01:25:32 Now if you want to ask why the laws are indivisible stochastic, I don't know. The best I could say is that when we try to explain things, there is a case to be made that you want to start with the least constrained possibilities, the most general possibilities, and then argue that in some circumstances, you get more constrained possibilities. Indivisible stochastic laws are just about the most general kinds of laws you could imagine.
Starting point is 01:26:04 Probably you could go farther than that. I don't want to say that they are definitely the most general kinds of laws you could imagine. Probably you could go farther than that. I don't want to say that they are definitely the most general, but they're certainly more general than Markov laws. They're more general than the usual way we think about non-Markovian laws. They're more general than deterministic laws, differential equation type laws. So to me, it makes sense that you would, you would begin with the most general kind of law and then you would begin with the most general kind of law, and then you would explain why in certain special circumstances we would expect to see a Markov process, why
Starting point is 01:26:31 in certain circumstances we would expect to see deterministic second-order differential equation kind of a law. And that's the job of understanding the quantum classical transition, understanding the so-called classical limit. How do we get from the laws of quantum mechanics to laws that look like Newtonian mechanical laws or that look like classical Markov processes? And those arguments carry through
Starting point is 01:26:51 just as well in this picture. So we don't start with deterministic laws, we don't start with a Markov chain or anything like that, we start with these much more general laws. And then by adapting the usual arguments people usually make in trying to get to the classical limit, the classical regime, we see why in certain circumstances we get big classical looking systems whose laws look deterministic or at least look like they're Markov probabilistic laws.
Starting point is 01:27:17 And to me, that's the right direction of explanation. You start with the more general, the least constrained kinds of laws and you move to the more constrained kinds of laws, and you move to the more constrained ones. So I guess I would say it's not that I feel like I need to explain why particles or objects behave probabilistically. Probabilist behavior is the default. It's what happens if we don't have a good reason to think the laws need to be deterministic. And then the goal is to show why in some circumstances we get predictably deterministic behavior.
Starting point is 01:27:47 But the truth is I don't have a deeper explanation for why we expect the particles to be jiggling around probabilistically. That's what it means to have an indivisible stochastic law, really a stochastic law in general. And your probabilities, are they classical probabilities or are they quantum amplitudes? It's a great question. They're classical probabilities and that's kind of key.
Starting point is 01:28:10 So this underlying picture, the claim that every quantum system in its beating heart is really some system with configurations. If it's a particle, we're talking about where the particle could be. If it's a field, we're talking about what are the different intensities the field could have in space? If it's a system of abstract bits like in a computer, it's some configuration of zeros and ones This is what I mean when I say a classical like ontology or a classic like configuration space and The probabilistic laws are assigning ordinary probabilities to these things. They're saying that the system begins in some configuration, and then the indivisible stochastic
Starting point is 01:28:49 law takes the form of laws that probabilistically tell you where it will end up. And those are just ordinary probabilities. They're real numbers between zero and one. They sum to one. There are no complex numbers at all in this picture at this point. But if you want to describe the same process in a more mathematically convenient way, I mean, indivisible processes are really
Starting point is 01:29:09 a little bit inconvenient to work with, especially if your system is complicated, because we don't have this ability to divide up the laws. It's very difficult maybe to use it directly. So instead we use this mathematical change of representation to the Hilbert space picture. We translate all of the ingredients in this underlying process into this Hilbert space picture. In the Hilbert space picture, we translate all of the ingredients in this underlying process into this Hilbert space picture.
Starting point is 01:29:26 In the Hilbert space picture, we have nice differential equation type laws, the Schrodinger equation, we've got complex numbers that show up. And then the probabilities that you have in the indivisible stochastic theory become what we call mod squares of complex numbers. The complex numbers that you mod square to get probabilities are called amplitudes. So it's only in going the Hilbert space picture that we have the need for amplitudes. And the amplitudes do all kinds of funny things. They interfere with each other.
Starting point is 01:29:54 If you want to write down a process where a system could go one way or the other, you're supposed to consider all the possibilities and then add all the amplitudes together and there's interference, right? But that's all happening in this sort of mathematical representation, this Hilbert space side. And the claim is, that's not telling you what's physically happening in the system. That's just very convenient mathematics. And again, it makes all the right predictions, right?
Starting point is 01:30:17 The idea here is you get back the usual textbook axioms of quantum theory, but now you understand where they come from. And now they're not inconsistent anymore because at a fundamental level, there's no special role of the theory. But now you understand where they come from and now they're not inconsistent anymore because at a fundamental level there's no special role of the observer, there's no special role for measurements. All the processes that we think of in quantum mechanics are just ordinary processes. They just look weird and exotic when you see them on the Hilbert space side. Have you encountered any resistance from people who like their quantum mechanics mystical?
Starting point is 01:30:46 Yes. Explain. Well, I mean, quantum mechanics is so exciting. Actually, let me rephrase that. Not that they like their quantum mechanics mystical. Have you encountered any resistance from people who like their quantum mechanics mystified? Mystified. Yeah, they like it shaken, not stirred, right? I mean, a little bit. Yeah, I think it's...
Starting point is 01:31:20 So there's a sense in which this picture is deflationary. It deflates. It takes exotic statements, oh, the cat is alive and it's dead. And it deflates them and says, actually, it's really one or the other. And we merely represent it mathematically with a state that looks like it's a superposition of live and dead, because it gives us divisible evolution we can use. It's easier to study mathematically, but it's not the reality. It deflates that, yeah.
Starting point is 01:31:42 Just to be clear, deflationary is the philosopher's term for saying there's nothing to see here, folks. Just calm down. Yeah. It's basically that. It just like sucking the air out of a balloon, right? It brings it down to Earth, which is basically what this does. It makes quantum mechanics, I think,
Starting point is 01:31:59 in some ways much more boring. And, you know, as I was working on this, I kind of felt that because when young people go into physics and they begin learning about quantum mechanics, it's super exciting to think that you're gonna be able to understand what's going on when the cat, Schrodinger's cat is alive and dead
Starting point is 01:32:16 and particles can go through both holes in the interference experiment at once and it interferes with itself and everything is entangled with everything else, and maybe when we think about things, humans are special, we collapse things. This boring-ifies quantum mechanics. It says that at some level quantum systems might,
Starting point is 01:32:39 if this all works out right, might just be kind of prosaic. There's no wave function to Hilbert space. There's just objects, atoms, chairs, whatever, and they're just evolving just in a indeterministic way, a very indeterministic way. Well, still probabilistic. We can still assign probabilities to things because you could imagine laws that are so badly indeterministic that we can't even assign probabilities to them. But we can at least assign probabilities to them.
Starting point is 01:33:06 But then a lot of the magic is gone, right? There's no special world for humans. In some sense, I mean, what is it? The history of science has pushed humans farther and farther out of the center of the story. You know, first we were the center of the universe. Then we weren't. Then maybe we were the center of all observations
Starting point is 01:33:25 and quantum mechanics and this takes us out of that altogether. There's nothing particularly special about human observation or the human mind. And I guess with AI development, we might soon not even be the smartest people on the planet, the smartest organisms or entities on the planet. So I don't know, I mean, I can only speak for myself. I have felt a little sad to think that there's a way to think about quantum mechanics where
Starting point is 01:33:48 there's no wave function. Nothing is splintering into multiple realities. Sorry, you mean there's no fundamental wave function that is emergent? Fundamental wave function. Good. It's emergent, yeah. So wave functions play the role of... So there's a way to take Newtonian physics and introduce kinetic energy, which is an
Starting point is 01:34:06 energy associated with things moving, and potential energy, which is an energy associated with configurations of things. And you can take these two quantities, they're a bit more abstract than like particles and forces and stuff, but you can imagine kinetic energy and potential energy. And you subtract them from each other, which is kind of a weird thing to do. Usually we think that the total energy is the sum of these things. energy and potential energy, and you subtract them from each other, which is kind of a weird thing to do. Usually, we think that the total energy is the sum of these things. You can subtract them, and then you can integrate this thing over time, and you get a mathematical
Starting point is 01:34:32 construction called an action, the action functional. We're actually covering this in my class right now. The thing you're integrating, kinetic minus potential energy, is called the Lagrangian. At least in the simplest cases, it's kinetic minus potential energy. And you can use this to encode the laws of your system. You can use this to describe how the system will behave. But you could ask, what is the action? Like is it a physical object?
Starting point is 01:34:59 You can make the action evolve in time. You get what's called Hamilton's principle function. It obeys a partial differential equation. And I didn't mention it, but this is the beginning of Hamilton-Jacobi theory. And it was by studying the time evolving action, the Hamilton's principle function, and its differential equation that led Schrodinger to discover the Schrodinger equation.
Starting point is 01:35:17 It was a beautiful extrapolation from the partial differential equation satisfied by this action. So this action as a function of time or Hamilton's principle function is a lot like the wave function of quantum mechanics. So much so, like I said, that it inspired Schrodinger to develop the wave function. In some sense, Schrodinger's wave function was like an exponentiated version
Starting point is 01:35:36 of this Hamilton's principle function. So now you can ask, what is the meaning of Hamilton's principle function? Is there an object out in the world evolving according to this partial differential equation, the Hamilton-Jacobi equation, the equation satisfied by this principle function, this integrated kinetic minus potential energy? I think most physicists would say no. They would say that it's just a mathematical convenience.
Starting point is 01:36:04 It's an appurtenance of the theory. We can use it to generate predictions. We can use it to make predictions. And that's wonderful. It's beautiful mathematics. But there is no object in physical reality it's describing. And what I'm saying is the wave function is basically just like that. It's in the same conceptual or metaphysical category as Hamilton principle functions.
Starting point is 01:36:26 Sure, it's in the mathematics, it's convenient, but there is no physical object that it is describing. And because there's no physical object, there's nothing branching, there's nothing splintering into branches. So you would never even think that there could be many worlds or anything like that. There's just nothing in the ontology of the picture
Starting point is 01:36:47 as I've presented it that would play the role of branching realities. So things like many worlds don't even get off the ground in this picture. So I think that's kind of what I mean when I say that there's no wave function. I mean it in that somewhat precise sense. I don't mean that we shouldn't use wave functions
Starting point is 01:37:04 in the mathematics or use them to make predictions, but we should be a little more modest in how we talk about them. Have you spoken to Sean Carroll about this? That's an interesting question. Not yet, but at some point we'll chat, hopefully. Yeah. I say it's an interesting question
Starting point is 01:37:24 because I have not done a lot of traveling in the last year or so, so our paths really haven't crossed. But I'd love to have a chat about it at some point. Well, any Everettians or many worlds, people? A little bit. A little bit. But I think, you know, you talked about mysticism, you talked about how people like their physics. The truth is that people get really good
Starting point is 01:37:48 at doing physics in a certain way. And we develop intuitions. When you learn to play an instrument, learn to play the piano, right? You learn to play chess. You learn gourmet cooking. And you do this over many years. And if you've got the right combination of motivation and talent and skill and the right environment and the right mentors, the right combination of all these factors, you end up becoming very proficient at it.
Starting point is 01:38:16 And you can do wonderful things. You can play beautiful pieces of music. You can make just fantastic cuisine. You can become a pieces of music. You can make just fantastic cuisine. You can become a grandmaster in chess. And if someone comes along and says, I think you should do this differently. You should go back to the starting board, right?
Starting point is 01:38:35 You should sit on the piano bench like this, and you should hold your hands like this, or you should play chess, and the pieces should start off in a different position, and we should change all the rules, right? The chess pieces should move differently. You're position and we should change all the rules. The chess pieces should move differently. You're gonna render a person back to square one.
Starting point is 01:38:50 And you could imagine why someone probably wouldn't wanna do that. And it's not for any negative reason. It's just that they've optimized themselves to do really good work. And to ask them to go back to the drawing board and start again is a huge ask And so I would basically say anyone who's been doing quantum mechanics in a certain way their whole career
Starting point is 01:39:12 Who's developed all kinds of intuition? They just have a good feeling for what to do with wave functions and stuff You know, I could imagine someone, you know in that position being reluctant to want to go back and rethink all the foundations from the beginning, especially if most of their career, what they've heard is the foundations are fine, quantum mechanics is just a device for generating predictions. Why should I go back and even think about any of this stuff? So I don't think that, I certainly am not critical about any of that attitude, but what I have certainly found is that people who are newer to physics, students tend to be much more interested in talking about a project like this. But there are absolutely exceptions among professors as well.
Starting point is 01:39:53 I'm going to have some wonderful colleagues who've been incredibly receptive and open-minded and we've talked about this project a lot and I've gotten a lot of really good input from people. So, you know, but so I think it's a combination of intuition building and also, what calls us to do quantum mechanics? I mean, quantum mechanics is such an exotic theory.
Starting point is 01:40:14 And to think that you're gonna spend your time imagining the world is some wave function or state vector or some abstract object living in a high dimensional configuration space or in somewhat modern sense in a high dimensional Hilbert space. Hilbert spaces are beautiful. The mathematics is incredibly elegant and it has a certain kind of spiciness to it. But you've got complex numbers floating around, we don't know why, you know, at least the way that we usually talk about it. I can imagine being romanced by that. I was. I feel like that's what brought me into quantum mechanics.
Starting point is 01:40:58 So I can definitely see why some people would like to keep that. And I think among all people who take that romantic view about quantum mechanics, I don't think anyone takes a more romantic view than Everettians, people who work in the many worlds interpretation. Because their picture of the world isn't just exotic, it's profound, right? The idea that every time a quantum event takes place, the universe splits into, in the cartoon picture it's like two or three branches, but in the sort of more sophisticated, more fine grained version of the Everett approach, it's an uncountable profusion of branches. I mean, it's mind-blowing and amazing and it forces you to confront some very deep questions in metaphysics, in philosophy of mind. It's just so rich with inquiry. I can imagine people working in that field would like to hang on to it. I can imagine people working in that field would like to hang on to it. So I'll give you two examples because I can relate to this to being inveterate and obstinate.
Starting point is 01:41:50 So when I was learning about the categorification of quantum mechanics, I'm reading papers like, okay, here's another way you can think of quantum theory as a daggersymmetric, monoidal category. And I'm looking at him thinking, okay, but so what? I still have that so what? But I think a part of it is that I'm used to doing quantum mechanics in an alternate manner. Right. Now my dad, he has his desk set up in such a way that if you move one paper, he'll get
Starting point is 01:42:17 upset with you even if it's just out of the way. He has it all in his mind. I had to install Windows XP a couple years ago. Windows XP on his computer because he's familiar with Windows XP and wants to use DOS and can't run QBasic on Windows 10 without some emulator or virtual machine. So my dad is like what you're classifying as the or what you're characterizing as some people who are used to quantum mechanics in the old way. At least when it just comes from not their dislike of it for being deflationary, but their dislike of it from being different.
Starting point is 01:42:55 Now the question could be, well, Jacob, what does it provide me? What does your approach give? Why should I learn it? You've just said that it seems like regular quantum mechanics. Okay, cool. Perhaps to you it's a more beautiful version, maybe to someone else it's more convoluted. But whatever, what does it give you? What's the upshot? It's a great question.
Starting point is 01:43:17 So the first upshot is it patches up the axioms. The axioms had this ambiguity or inconsistency or incompleteness to them. They had this mystery about what a measurement is that seems to play a role in the axioms had this ambiguity or inconsistency or incompleteness to them. They had this mystery about what a measurement is that seems to play a role in the axioms but isn't defined by the axioms. And you run into problematic thought experiments like Wigner's Friend experiment. And the Wigner's Friend thought experiment is, it's not exactly the same thing as the problem of black hole information loss by any stretch, but there are some resemblances, right? There's this big problem in quantum gravity black holes appear to radiate according to you know work going back to Stephen Hawking
Starting point is 01:43:53 and there's this tension between evaporation of black holes quantum mechanically and Unitary or Schrodinger evolution which is information conserving in some quantum mechanical sense and the fact that black holes Supposedly can't allow information to escape. There's this tension between all of these things That's the kind of tension we're seeing with thought experiments like the Vigners friend thought experiment and it's not like the black hole evaporation Problem is more accessible Experimentally, I mean to go out and actually do experiments on black hole evaporation You'd have to set up 10,000 identically prepared black holes,
Starting point is 01:44:25 which we don't have to do, wait many times the age of the universe for all of them to evaporate, ensure they all evaporate inside of a completely sealed chamber with perfect detection mechanisms to collect all the Hawking radiation that comes out, with sensitivity enough that we can detect, you know, incredibly tiny, tiny entanglement effects, right? And then subject all the data to a level of analysis
Starting point is 01:44:45 that we think may be computationally impractical. I mean, this is not a practical problem, at least as far as we know yet, that could change, but as far as we know, it's not a practical problem. Yet this is considered a serious area of research, whereas the inconsistencies in quantum mechanics are not considered as serious for some reason. I don't quite understand, there's some sociology there.
Starting point is 01:45:04 What I would tell quantum physicists is, one advantage of this approach is that it resolves some of those inconsistencies, which in itself may be a good thing. It does it in a way that doesn't require that we model only one kind of quantum system. One of the disadvantages of like Bohm's pilot wave theory is it works really well for very
Starting point is 01:45:27 simple kinds of systems consisting of finitely many fixed numbers of non-relativistic particles but has resisted being neatly generalized beyond that. So it's nice to have a model that's a little more model independent and simpler than the Bohmian approach. And it doesn't run into many of the confounding metaphysical mysteries that one has to deal with with Everettian quantum mechanics. We're not making zillions of copies of us in this picture. So it provides, I would argue, one, and maybe at this point,
Starting point is 01:45:59 maybe the only attractive, in my opinion, way to resolve these inconsistencies with quantum mechanics, although your mileage may vary and I don't want to speak for everybody by any stretch, that to me is already something. The second thing is it provides a picture. Quantum mechanics, when I teach quantum mechanics to students, they're expecting me to talk about waves moving in 3D space and when I show them the axioms, a lot of them are very disappointed. They're like, but where's the picture?
Starting point is 01:46:24 And isn't it like there's an electron and it emits a photon? And I'm like, well, the textbook axioms don't really talk about an electron here emitting a photon there. According to the axioms, that's just added for color. We draw pictures of electrons emitting photons just to help tell the story. But none of this is actually legitimated by the axioms of quantum mechanics. There is just also the problem that there are a lot of phenomena out happening in the world that aren't measurements. You know, when early gases are mixing in the primordial universe, when stars far away are
Starting point is 01:46:56 colliding, when, you know, a piece of aluminum sits on the surface of Mars and doesn't collapse under its own weight, when birds forage, when humans fall in love. These don't appear to be measurements. And yet, the axioms of quantum theory only make predictions about measurement outcomes, probabilities of measurement outcomes, and averages of measurement outcomes weighted by measurement outcome probabilities, and that's it. That's a very narrow category of phenomena. How do we get from that narrow category of phenomena to the wider category of all the other things that we think are happening in nature?
Starting point is 01:47:32 Or are we just going to say that our talk of all those other things, of birds foraging and early gases mixing, is just for color, is just storytelling? So this allows quantum mechanics to be a theory of all the much larger category of phenomena Rather than just this narrow category of measurements. I call this the category problem of textbook quantum theory But ultimately I think physicists are going to be interested in applications practical applications So are you told well we would hope but but yeah, but I'm my experience physicists, you know, they want to know What can we do with this? I think there's some things you could do with this.
Starting point is 01:48:08 One is, indivisible stochastic processes, at least classical indivisible stochastic processes, are currently three years old. This is an area of dynamical systems theory that is completely unexplored. It's like opening up a sketch pad that's full and turning the page and finding like a totally blank new page. How often does that happen in mathematics or science that you turn a page and you open the door to some completely new area of inquiry? I don't know a lot about the mathematics of indivisible stochastic processes because nobody does yet. I think that's just interesting. I think it would be very interesting for people to think about these kinds of
Starting point is 01:48:55 systems and work out their properties. It may be that the best way to study an indivisible stochastic system is to write down a Hilbert space for it and basically do quantum mechanics. Just like sometimes the easiest way to study Newtonian system is to write down Lagrangian for it and do Lagrangian mechanics. But it may be that we can understand things about these systems on their own merits. It may be that when you don't start from Hilbert space, but instead start with these different axioms, you can point to new ways to generalize quantum mechanics that would have been impossible to imagine before. If you're starting with a Hilbert space, that limits your imagination about what else you can do. If instead you don't start with a Hilbert space, you start with a more general kind of probabilistic system like I was talking about in this picture,
Starting point is 01:49:38 this indivisible stochastic process, maybe there are deformations you can do to the assumptions, changes you can make to it to generalize these systems in ways that do not give you a Hilbert space. You can generalize these systems and get something else that doesn't give you a Hilbert space and that you never could have gotten to if you'd started from Hilbert spaces. And maybe we need a generalization like this in order to make progress
Starting point is 01:50:02 on foundational questions in say quantum gravity. So I think that's another potential area of use. And then another area is if there's this correspondence between Hilbert space representations of quantum systems and classical looking probabilistic systems, especially beyond the Markov approximation, this might suggest that there are efficient ways to simulate non-Markovian classical stochastic systems using quantum computers. So one open question is, if we had a quantum computer today, what would we use it for? There are already a number of known
Starting point is 01:50:45 algorithms. There's no proof that the algorithms are stronger than what you could ever do with a classical system, but it's widely believed that many of the things you could do with these quantum algorithms are far more efficient than you could ever do with classical algorithms. But it's not like every question you'd want to do on a classical computer can be done more efficiently or more quickly in a quantum computer. So figuring out what are the kinds of things that a quantum computer would help us do more efficiently is a really open question. And when you set up a correspondence between quantum systems and a large class of stochastic systems, you open the door that there are some problems that may be difficult to simulate classically that are easier to simulate quantum mechanically. I don't quite know what those are yet.
Starting point is 01:51:36 That's an area of research that I'm working on right now. But I'm talking to people who work in the theory of quantum simulations of classical stochastic processes, and we're trying to determine maybe there are ways to use this correspondence to provide more efficient ways to simulate these systems and provide a new application for quantum computers. So now there's also the possibility that in some circumstances, indivisible stochastic systems might actually behave differently from quantum systems, at least textbook quantum systems.
Starting point is 01:52:08 There are maybe slightly different predictions for a Wigner's Friend thought experiment. Unfortunately, doing the Wigner's Friend thought experiment is probably out of our experimental capacity for the next thousand years, who knows. But there are some cases in which you wanna model the quantum system and you need to throw in additional assumptions in order to actually make predictions, assumptions that
Starting point is 01:52:26 go beyond the textbook axioms. For example, if you want to model a very, very complicated quantum system, you may have to add certain additional axioms about, you know, what are typical initial states for the system, what kind of typical evolution would we expect. These go beyond the textbook axioms and it's possible that when you start with different axioms you would actually modify some of those assumptions. And so for some classes of very complicated quantum system, it's possible you when you start with different axioms, you would actually modify some of those assumptions And so for some classes a very complicated quantum system It's possible you could get slightly different predictions, but these are all highly conjectural claims
Starting point is 01:52:51 A lot more work needs to be done to determine if Or when any of these could pan out so I want to be very clear We're only the very beginning here, but even to have this correspondence at all I think opens up a lot of doors and there's nothing more exciting to me in science or philosophy than having open doors. Well, this is certainly cutting edge. Like cutting edge as in it's been developed in the past couple years and also it may have wide application soon and may actually be on the right track. Does it provide any insight into QFT, which depends on a Fox space, which depends on Hilbert
Starting point is 01:53:29 spaces? Yeah, so it's an excellent question. So quantum field theories are situated within the axioms of textbook quantum mechanics. So those axioms I mentioned, Hilbert spaces and showed all that stuff. Quantum field is a particular kind of a system that lives within the framework defined by those axioms. What makes quantum fields, well there's many things that make them complicated. One thing that makes them complicated is they have infinitely many moving parts. Unlike a system of like five particles, they have infinitely many moving parts. We see
Starting point is 01:54:00 these are systems with infinitely many degrees of freedom. And this causes all kinds of mathematical complications. When working with a quantum field theory, like regular, everyday physicists using quantum field theories today, often you have to regulate the theory. I mentioned Planck introducing Planck's constant to regulate. So the regulators we use temporarily make many of these infinite things finite so we can do the calculation. And then what we do is we try to send the regulator to infinity, and usually we can do that, then it goes away, and we believe we have a good solid prediction that doesn't depend on the regulator. Unlike Planck's constant, the regulator goes away,
Starting point is 01:54:37 and we believe that we have a robust result that holds in the continuum infinite limit. And there's a whole beautiful intricate story called renormalization and effective field theory. That's all about how to do that in a mathematically consistent way, reasonably consistent way and generate good predictions. I'm not gonna have time to go into all of that. But at the end of the day, right,
Starting point is 01:54:57 this is still just a quantum system, a very complicated quantum system. And to the extent that you can generate the axioms for any quantum system, you can generate them for quantum fields starting from an indivisible stochastic process. According to this picture, a quantum field is a collection of entities, delocalized, spread out in space, with configurations. And these configurations evolve in this indivisibly stochastic way that can be modeled in Hilbert space language. So in a sense, it's just like any other kind of a system. You are still going to run into the same mathematical complications, maybe new ones, from the fact that we have infinitely many
Starting point is 01:55:34 and you have to do mathematical tricks to make these things tractable. But yeah, so the answer is quantum fields fit into this framework, but it's inherently going to be very complicated because quantum fields are super complicated. And do you reproduce the exact postulates of quantum mechanics or do you have some deviations that there's an experimental way of testing whether the stochastic approach is the more underlying correct one? It's a good question. So at the level of the correspondence, there's just a mapping that takes you from the ingredients of the invisible stochastic theory
Starting point is 01:56:11 into the corresponding Hilbert space description of its quantum Hilbert space representation. There are in principle deviations because collapse doesn't fundamentally happen in this picture. However, the deviations are going to be pretty much the same as for any no-collapse formulation of quantum mechanics. So, Bohmian mechanics, the pilot wave theory of de Broglie and Bohm with particles being guided around by wave functions, Everettian quantum mechanics, you know, the many worlds interpretation, these are all no-collapse interpretations. Collapse is not fundamentally happening. There's no collapse axiom. And so, you know, the many worlds interpretation. These are all no collapse interpretations. Collapse is not fundamentally happening. There's no collapse axiom. And so you're going to get tiny discrepancies in the predictions of these theories as compared
Starting point is 01:56:54 with textbook quantum theory. And I can make this super explicit. Go back to Wigner's friend. According to textbook quantum theory, Wigner's friend on the inside does a measurement, collapses the quantum system inside the box. That system has collapsed. It's collapsed for everybody. It's collapsed for Wigner's friend on the inside does a measurement, collapses the quantum system inside the box. That system is collapsed, it's collapsed for everybody, it's collapsed for Wigner's friend in the box, it's collapsed for Wigner outside the box, it's just collapsed. In a no collapse approach, like many worlds or Bohmian mechanics or my approach, there isn't really a collapse
Starting point is 01:57:19 that's happened. And what this means is that the wave function Wigner is using on the outside, the quantum state is a non-collapsed quantum state. It contains those superposition interference phase effects that have not been erased. They haven't been erased because there's not been a collapse. So in principle, Wigner on the outside with a sufficiently powerful measurement apparatus could detect those small discrepancies, which would be discrepant from textbook quantum mechanics. But detecting them would be extremely hard.
Starting point is 01:57:55 So there's a paper from a few years ago that Scott Aronson and Lenny Suskind, and I believe one other author published in which they they prove what people call the quantum necromancy theorem which is just to say that if you could if Wigner could design an experimental apparatus sophisticated and sensitive enough to detect those tiny little discrepancies between the no collapsecollapse interpretation and textbook quantum theory, then that apparatus with some relatively simple modifications could take a long dead cat and bring it back to life.
Starting point is 01:58:39 Which we usually regard as a thermodynamically impossible feat, right? That's why they call it necromancy, like magically bringing the dead back to life. It would be akin to unscrambling an egg, right? Like taking a scrambled egg and turning it back into the original egg. I mean, this is beyond really any technological capacity we could imagine.
Starting point is 01:58:59 So yes, it makes somewhat different predictions, but only as far as other no-collapse interpretations make those same slightly discrepant predictions. And unfortunately, those discrepant predictions are so minuscule that they would be extremely hard to measure. Easier to measure probably than the black hole information problem could be measured. But kind of the same level of like extremely tiny suppressed effects.
Starting point is 01:59:28 Okay, before we end, I want to know what is a particle in your view? Also, is your view called an interpretation? Is it a theory? Is it a correspondence? What would you call it? Why don't we settle that right now? I don't have a good answer to that question. I think you could call it whatever you want. Um, one could think of it as a physical theory.
Starting point is 01:59:53 It has variables and ingredients in it, and those ingredients have laws. So it's a physical theory. It's a physical theory that makes the same predictions as textbook quantum theory in all realistic scenarios as far as I know. You can think of it as an interpretation of quantum theory in the sense that if you start with the formalism of quantum mechanics and ask how do we interpret the things, what do the things mean, this provides a platform for actually talking about what's really out
Starting point is 02:00:17 there in nature possibly. I should say it's not a unique picture. A given quantum system may represent many different indivisible stochastic processes just like a Lagrangian or better yet a Hamiltonian formulation of classical physics can describe many different Newtonian systems. There's not a one-to-one relationship between these pictures. You could think of it as a formulation because it's a new mathematical framework. I think what you couldn't call it is a prescription, a recipe, because
Starting point is 02:00:47 it's more than just a list of steps to follow. It's more than just an algorithm the way the textbook axioms of quantum theory are just an algorithm to follow. It actually tells a story of things happening. So I don't know if that answers your question, but did you want to follow up on that or do you want me to talk about particles? Yeah. What's a particle? What's a particle?
Starting point is 02:01:08 So, classically, of course, a particle is a point-like entity characterized by a mass of some kind, could be zero mass. I guess it's a tachyon, it could have some weird imaginary mass. It's characterized by spatial degrees of freedom, meaning it has a location in some notion of physical space, usually x, y, z coordinates when I think of it that way. It will generally have something like different locations, different moments in time, which we
Starting point is 02:01:37 could think of as being like a trajectory. And, you know, if it's a truly point-like particle, then it has no internal structure, it has no volume. Nonetheless, it can carry certain other quantities, it can have other attributes like electric charge, which are related to how it interacts with fields and other kinds of particles. It can have an intrinsic form of angular momentum. So just as you can have kinetic energy, but kinetic energy can kind of be frozen in and become kind of rest energy, like an internal energy of a particle.
Starting point is 02:02:15 Angular momentum is a kind of emotional kind of momentum, a kind of rotating momentum, but you could also have a frozen in kind that's called intrinsic spin. Particles can carry that intrinsic spin that can be converted into other forms of angular momentum, just like rest that can be converted into other forms of angular momentum, just like rest mass can be converted into other forms of energy. So these are what a particle is.
Starting point is 02:02:31 It's a thing with this collection of possible properties. In quantum mechanics, at least since Wigner's work on representation theory, particles have been understood as the simplest kinds of quantum systems that have a well-defined nature or behavior under space-time transformations. So if you ask what's the simplest kind of quantum system with a Hilbert space that is as small as possible,
Starting point is 02:02:59 doesn't include anything extraneous, but for which when we move around in space or turn around or change inertial reference frame, change frame of motion, we just get a new element of the same Hilbert space. We don't get something new, but it's like minimal, it's irreducible. Then you have a math problem. What are the irreducible unitary, which just means they're represented by, you know, certain kinds of operators in the Hilbert space, representation of the space-time asymmetry group,
Starting point is 02:03:26 the point-cre group, the abstract representation of moving around in space, changing frame of motion, rotating, and that's a math problem, you can classify it, and what you find is there are distinct kinds of Hilbert spaces with these properties, and they are characterized by mass and by spin and by charges, and they have motional degrees of freedom and so forth.
Starting point is 02:03:46 That's usually how we think about particles in quantum mechanics. And that's all we can say in quantum mechanics because all we've got are Hilbert spaces in the textbook formulation. If you're going to describe a system of particles, you just got a Hilbert space. And so all we can do is talk about what that Hilbert space, what a structure is and its structure for particle is related to these transformations of space time. In the picture I'm proposing, particles go back to the classic like picture. A particle is a point like object in space, in three dimensional physical space. If we think that space is that physical space is three-dimensional, with various properties or dispositions interacting with other particles.
Starting point is 02:04:33 Dispositions? Yeah, that is, when you interact with a particle, it may be disposed to give you certain results on your measuring device is all I mean. So if you measure its position, you'll read off what its position is, but if you measure some more complicated feature, then what you get on the measuring device will be some more complicated result of the interaction with the particle. So it has a disposition to produce certain kinds of behavior.
Starting point is 02:04:53 In metaphysical speak, we would say that certain properties are categorical. They just explicitly exist as they are, and others are dispositional. That is, you look at them and what you're seeing is really like how the particle will be disposed to show you what it's gonna do But the end of the day particles are much more like they are the classical picture just point-like entities with some properties with different positions through time
Starting point is 02:05:17 So that's all particle is according to this picture and I should say that I'm not saying that particles are the fundamental ontology of nature I don't know what the fundamental ontology is But so far in your theory, what is the fundamental ontology? We go back to the old classical way of doing things that if you want to model a given system You propose a certain ontology for it You have to say what you think the configurations are if you want to model particles It's going to be arrangements of particles if you want to model particles, it's going to be arrangements of particles. If you want to model field, it's going to be, you know, delocalized field intensities distributed throughout space.
Starting point is 02:05:47 If you want to model strings, if you want to model bits on a computer register, you pick the right ontology for the right kind of a system, and then you model it. It's possible there is some truly fundamental ontology of all of nature. I don't know what that is. I think to some people, especially people working in Everettian quantum theory, the idea that the fundamental ontology is state vectors or wave functions in a Hilbert space is very appealing.
Starting point is 02:06:15 It would mean we already know what the fundamental grounding of all of reality is. A Hilbert space. There's some Hilbert space and there's an object or objects in a Hilbert space. And that is the fundamental ontology of everything. I'm not saying that. Hilbert spaces are not fundamental in this picture. We go back to really having to be kind of metaphysically humble.
Starting point is 02:06:38 We know about some systems. Some systems appear to be particles, some appear to be fields. Maybe particles are emergent from fields and we don't need particles as a separate category. Maybe fields are fundamental, maybe they're not. I think it's premature to try to guess at what the fundamental ontology is just yet. And in this picture, you don't have to. You just pick whatever ontology you need for the model you want to talk about.
Starting point is 02:07:00 Particles, fields, registers on a computer, and then you proceed from there. Maybe one day we'll discover that there is one model with one ontology from which we can get all the other models. That would be a very exciting day, but I don't think that we can guess what that is today. And I don't think that we can just take that to be Hilbert spaces and be done. I think that's premature.
Starting point is 02:07:23 There's so much more I want to talk to you about. We didn't talk about causation either. There's a whole other connection to causation. Reichenbach's Common Cause. Right, we didn't talk about Reichenbach's Common Cause Principle. This is the other reason I think that this work is potentially interesting because it has some connections to causation that I'm very excited about. And yeah, I think we should explore that next time. Yeah, maybe we should we should talk again.
Starting point is 02:07:52 Yes. Yeah. Professor, it was wonderful to see you in person. I've been following you for again, following politely, diplomatically, whatever. You understand for quite some time now. And why don't we end I know you're about to rush off to see your students, why don't we end with your advice to students? Oh.
Starting point is 02:08:11 Actually, two, your advice to students who are watching and researchers who are watching. I'll just use my standby advice, which I think has been really helpful to me. And people have told this to me and maybe I'll share this. We all come at the work we do with a distinct profile of strengths and weaknesses, like I just said. Every person is, you know, our particular set of strengths and weaknesses is like a point in a very high dimensional configuration space or parameter space. So we're not rankable. You can't order people. We're not an ordered set. It's very easy for students going into science to think that they lie on a linear ranking system. There are people who are better or smarter than they are.
Starting point is 02:09:01 And if they're not as smart as those people, they can't make contributions, they can't do good work. And in my experience, having worked with so many students over the years, but also having read a lot of history, history of science, we discover is that it really is true that we're all points in some very high dimensional parameter space, we're not rankable. And figuring out how your unique profile of strengths and weaknesses can be brought to bear to make progress on work that you find meaningful.
Starting point is 02:09:30 That's figuring how to do that is part of what it is to go into an area of scholarly work and grow and learn and develop. So I would say don't worry too much about where you think you fall in the ranking and focus more on figuring out how to bring your unique profile to the table and how to use it to make progress on things you find meaningful. That's probably my best piece of advice. And for researchers who are watching, not advice, but any message that you'd like to, well, you can give advice as well.
Starting point is 02:10:04 Interdisciplinarity is wonderful. We should have more focus and spend more money on the places where disciplines intersect. I work at the intersection of physics and math and philosophy and I guess now, you know, statistics, you know, dynamicals, there's so many different fields that sort of meet where I'm currently working. And I think this is not novel to say, but I think some of the most exciting work happening in scholarship generally, and certainly in science or philosophy in particular, is happening at interdisciplinary boundaries. So I would say that maybe not for the researchers,
Starting point is 02:10:50 but for the people who pay researchers. Yeah, spending a little more time thinking about how to promote work at the boundaries of disciplines where there's real cross-pollination between disciplines I think would bear a lot of fruit for progress in all of our work. I agree. Last night, one of the reasons I'm here in addition to see you was at MIT, there was an event by Addy right here yesterday last night called Ecolopto, which was about neuroscience, cognition, biology, physics, language.
Starting point is 02:11:19 Yeah, it was a combination of basically every sort of major field in STEM and the arts, you know, where they intersect and can be used to create something that's actually useful. But you have to be rigorous about it. You can't just, you know. So that was fun. Anyhow, thank you. It's been a pleasure. And I know that you're itching to get going. And I appreciate that your students have been kept waiting for this. This is wonderful. I appreciate your time. Thank you for inviting me. This is wonderful. I appreciate your time. Thank you for inviting me. This is wonderful. I really appreciate the invitation and all the work you've been doing on this
Starting point is 02:11:49 amazing podcast series. It's amazing work talking to the public and talking to, you know, people who are working in all these different fields about their work and clarifying complicated topics for everybody, I think is amazing work. Thank you. And next time the interview we'll do will be more technical. We may even use the blackboard. We'll see. We'll see. Anyway it was a delight. Thank you so much for the invitation. Thank you.
Starting point is 02:12:14 New update. Start at a sub stack. Writings on there are currently about language and ill-defined concepts as well as some other mathematical details. Much more being written there. This is content that isn't anywhere else. It's not on theories of everything, it's not on Patreon. Also full transcripts will be placed there at some point in the future. Several people ask me, hey Kurt you've spoken to so many people in the fields of theoretical physics, philosophy and consciousness. What are your thoughts? While I remain impartial in interviews, this substack is a way to peer into my present deliberations on these topics. Also, thank you to our partner, The Economist.
Starting point is 02:12:55 Firstly, thank you for watching, thank you for listening. If you haven't subscribed or clicked that like button, now is the time to do so. Why? Because each subscribe, each like helps YouTube push this content to more people like yourself, plus it helps out Kurt directly, aka me. I also found out last year that external links count plenty toward the algorithm, which means that whenever you share on Twitter, say on Facebook or even on Reddit, etc. It shows YouTube, hey, people are talking about this content outside of YouTube, which in turn greatly aids the distribution on YouTube.
Starting point is 02:13:32 Thirdly, there's a remarkably active Discord and subreddit for theories of everything, where people explicate toes, they disagree respectfully about theories, and build as a community our own toe. Links to both are in the description. Fourthly, you should know this podcast is on iTunes, it's on Spotify, it's on all of the audio platforms. All you have to do is type in theories of everything and you'll find it. Personally, I gained from rewatching lectures and podcasts. I also read in the comments that hey, toe listeners also gain from replaying. So how about instead you re-listen on those platforms
Starting point is 02:14:05 like iTunes, Spotify, Google Podcasts, whichever podcast catcher you use. And finally, if you'd like to support more conversations like this, more content like this, then do consider visiting patreon.com slash Kurt Jaimungal and donating with whatever you like. There's also PayPal, there's also crypto, there's also just joining on YouTube. Again, keep in mind, it's support from the sponsors and you that allow me to work on toe full time. You also get early access to ad free episodes, whether it's audio or video, it's audio in the case of Patreon, video in the case of YouTube.
Starting point is 02:14:37 For instance, this episode that you're listening to right now was released a few days earlier. Every dollar helps far more than you think. Either way, your viewership is generosity enough. Thank you so much.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.