Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 41 | Steven Strogatz on Synchronization, Networks, and the Emergence of Complex Behavior
Episode Date: April 8, 2019One of the most important insights in the history of science is the fact that complex behavior can arise from the undirected movements of small, simple systems. Despite the fact that we know this, we'...re still working to truly understand it — to uncover the mechanisms by which, and conditions under which, complexity can emerge from simplicity. (Coincidentally, a new feature in Quanta on this precise topic came out while this episode was being edited.) Steven Strogatz is a leading researcher in this field, a pioneer both in the subject of synchronization and in that of small-world networks. He's also an avid writer and wide-ranging thinker, so we also talk about problems with the way we educate young scientists, and the importance of calculus, the subject of his new book. Support Mindscape on Patreon or Paypal. Steven Strogatz received his Ph.D. in applied mathematics from Harvard, and is currently the Jacob Gould Schurman Professor of Applied Mathematics at Cornell. His work has ranged over a wide variety of topics in mathematical biology, nonlinear dynamics, networks, and complex systems. He is the author of a number of books, including SYNC, The Joy of x, and most recently Infinite Powers. His awards include teaching prizes at MIT and Cornell, as well as major prizes from the Joint Policy Board for Mathematics, the American Association for the Advancement of Science, the Mathematical Association of America, and the Lewis Thomas Prize. Web site Cornell web page Google scholar page Amazon author page Wikipedia TED talk on synchronization Twitter
Transcript
Discussion (0)
This June, the world comes to Los Angeles.
Kick off FIFA World Cup 2026 at the FIFA Fan Festival at the iconic Los Angeles Memorial Coliseum.
Watch matches live on Giant Scream.
Feel every goal with thousands of fans.
And celebrate with music, culture, and flavors from around the world.
Join us June 11th through 14th opening weekend as the tournament kicks off in Los Angeles.
Tickets are just $10 in kids under 12 for free.
Get yours now at Los Angeles, FWC26.com.
Your social media feed delivers plenty of advice.
But it doesn't know you.
It doesn't ask questions.
It doesn't give physical exams or order tests.
Doctors do.
At the American Medical Association,
we believe the best care starts with a real conversation
with someone who understands the science and your unique health.
So stay curious.
Ask questions.
But when it's time to make decisions,
make them with a doctor.
Learn more at AMA Health versus hype.org.
That's AMAHealthVShype.org.
Hello everyone and welcome to the Mindscape podcast.
I'm your host, Sean Carroll.
In today's episode, we're going to tackle a perennial big question in the natural sciences,
trying to understand the sense in which the world is complicated.
Now, I mean this in a very particular way.
I mean, there's a way the world could be, which is completely chaotic, right?
Like things just happening at random.
There's no order or structure anywhere.
There's another way the world could be, which is completely rigid and orderly, right?
The actual world is somewhere in between these two things.
There's sort of poles of chaos and order, and we balance ourselves in between.
That's one feature, but the other is no one planned it, right?
There's not a central designer that says this is how things should be.
The universe somehow organizes itself.
And when I say the universe, especially, of course, here on Earth in the biosphere.
So today's guest is actually a mathematician.
Stephen Strogetz has become very well known for his popular book.
on mathematics. But he's equally successful as a researcher. As I mentioned in the podcast,
he's the author of a paper that has well over 30,000 citations, which makes a regular physicist
like me very jealous. And one of the founders of both the field of studying synchronization,
spontaneous synchronization of different physical systems. And then out of that study came the
study of networks and in particular small world networks, the way that many systems like the human
brain or the internet are organized, where it is neither just you talk to your nearest neighbors
nor you talk to everybody, but again, somewhere in between. How does this sort of mixture
of chaos and order naturally come about through the working out of math and its equations?
So Steve is a wonderful communicator and a real pioneer in this field, so I think you're going to
enjoy this conversation.
Let's go.
Hi, my name is Lisa, and I'm a licensed psychotherapist, which means my work doesn't magically
end when the session does.
There are notes to write, appointments to manage, billing, insurance follow-ups, and somehow
all that admin used to creep into my nights and weekends.
That's why I switched to simple practice.
Simple practice is an all-in-one electronic health record built specifically for therapists
with HIPAA compliant tools and high trust certification.
So I don't have to worry about juggling systems or cutting corners just to keep things running.
scheduling, documentation, billing, insurance, client communications, even automated appointment reminders,
it all lives in one place. And if you're starting or growing a practice, Simple Practice also offers
a credentialing service that helps simplify insurance enrollment, which can be a huge lift when you're starting to scale.
Right now, Simple Practice is celebrating Mental Health Provider Day with an exclusive offer. Up to 70% off for one year.
Yes, up to 70% off for one year. But hurry, offer ends May 15th at Simple Practice.
Thank you.com. Simplepractice.com.
When Toyota builds an electric vehicle, we don't start with a blank slate.
We start with everything we know.
The BZ brings Toyota's proven engineering to electric.
With impressive range, intuitive technology, and Toyota reliability,
BZ reflects decades of experience, reimagined for what's next.
The BZ isn't just electric. It's Toyota Electric.
We make it easy.
Toyota, let's go places.
Steven Strokeats, welcome to the Mindscape podcast.
Thanks very much, Sean.
I mean, you are very well known as a popularizer of math,
but also you're extremely well known as a doer of math.
I tend to think of the math you do as almost kind of physics.
It's not the pure math that is proving esoteric things.
You're really hands dirty there in the real world.
I mean, how did you come to think of yourself as an applied mathematician?
That's not something that most people grow up wanting to be.
That's a good point.
And I didn't even know it existed.
When I was in college, I thought I wanted to be a math major.
And they had a WizKid linear algebra class for the people who had done very well in math in high school.
So I found myself in there and I got crushed in my first semester of college.
Got the worst grade that I ever got in college in that course.
And it was, you know, it was the kind of course that is supposed to be.
be a, like to weed out the people who don't have the right stuff to be a pure mathematician.
They were trying to decide who, who's going to be the mathematician of the future.
And otherwise people, because a lot of kids in high school think they're pretty good in math.
And the idea was correct them very early on.
I have to say, to this day, I still resent that course because they put a really quite weak
teacher in there.
And so it was a real sink or swim experience for all of us.
and I definitely was taking in a lot of water.
This would be a big deviation from the plan of the podcast, but that's okay.
I mean, actually, I'll say that my best podcasts have involved deviations from the plan.
But let me just remark that we live in a culture in physics and in math of this weed them out, sink or swim.
Let's ask them to do impossible things and see who suffers the least.
And I personally think that that is not really the way to make the best scientists or mathematicians.
Me, well, of course, I agree with you.
You know, as a weed or a would-be weed, almost weeded out.
I mean, I think we lose a lot of talent with that kind of approach.
And there's no need to be that discouraging.
So, yeah, I mean, I do kind of want to go along on this thread.
Yeah.
Because I think it's something a lot of people have experienced,
this feeling of having once loved some subject and then getting discouraged in college.
And it's not necessarily a bad thing.
You know, as long as it turns out, okay, you go in something.
other direction. So in my case, I thought, well, maybe I really meant to do physics. And so
to respond to your earlier question, I took a lot of physics too, which was always a great
interest of mine. I love the idea. I love the idea that physics was where you went by after
being weeded out, because that is not how physicists think of themselves. Come on. I'm not saying
I'm not saying that. I just always thought math was my thing because I didn't feel like I had,
certainly I was a disaster in the lab. I knew that already from high school. And I,
I felt like I could, my physical intuition never seemed especially great.
I don't know, especially like free body diagrams, things pushing on, even action and
reaction.
I always found that very mysterious.
Well, it is.
Don't feel bad.
Yeah, but the math part of it, once it was converted to equations, then I felt very secure.
So I thought that was my natural strength.
But then I started to think otherwise after this one very proof-oriented course.
And I had never really had any experience with trying to do rigorous math proofs at that point in my life.
So anyway, I enjoyed the physics course, especially enjoyed sophomore, or sorry, it was the spring semester of my freshman year.
We took a course, we, I think, because of these other kids that were in the same cohort out of the electricity and magnetism book by Purcell.
So I know that you would know that book, and maybe some of your listeners will know that book.
that's one of the most beautifully written textbooks in any subject, I would say.
I think, do you agree with that?
Yeah, no, we didn't use it when I was undergraduate, but I know it since then.
It's very, very good.
I mean, what was so interesting to me about it was that it didn't just tell you, for instance,
that the force between two charges is going to be along the line between the charges.
Let's suppose it's the electrostatic force.
Just how much does a proton pull on an electrical?
You know, that's going to be some force.
In high school, I had learned this thing, Kulom's law, that the force would go along
that line between that.
But what was so interesting to me in Purcell is that he said, that follows from the
symmetry of space.
That's not just a property of this force.
That's a property about space.
Because if you imagine those two particles by themselves in an empty universe, otherwise empty,
there would be assuming that space is the same in all directions, there is no other preferred
direction than this line between them. So it has to be along that line. And whether you believe that
argument or not, I just was entranced by the idea that you could make an argument like that.
Yeah, you can see how this would light up the mathematician inside you.
So anyway, I've taken a big long detour from your original question. But the point was that I
always liked math, but I did like the math of the real world, or at least the sort of semi-real
world that we study in classes like physics class. Not the real real world.
where I had to, you know, catch my clothes on fire or make sparks in the lab or something.
I mean, I studied cosmology and quantum mechanics.
So I can't make any claims to be too involved with the real, real world.
But applied math is an interesting field, right?
I mean, I guess pure math is the alternative.
It's really about proofs, right?
You know, here's some things.
We're going to prove some things.
There's also physicists' math, which is this wonderful growing field where we see,
things we think are true and we give some arguments for them, but we don't actually prove
things. And I think applied math, I have the feeling is somehow in between those polls.
Well, it means many different things to many different people. So some see applied math as,
I mean, just to be clear, since we haven't really said about these things, there are these two,
roughly speaking, two flavors of math. So there's math that looks inward at itself, which is what I think
of as pure math. And there's math that looks outward at the world, at the world very broadly
construed. It could be oceanography. It could be the universe. It could be biology. Whatever. But it's a
math in the service of something else. Or sometimes it's math inspired by something else.
You know, like something beautiful that happens in physics can be then the beginning of a new
mathematical theory. And some people would still call that pure math, but I would think of that as
part of applied math or maybe close to what you just called the physicist math.
Do you actually in your daily, in your work in your papers, are you typically proving a theorem?
Or, you know, I notice that one of the wonderful things about your work is that very often you sort of figure out what the answer to the question is by doing some computer simulations.
That's true. Yeah, I'm a no-holds-barred style.
I've really, you know, I've definitely been called a physicist by many of my mathematician friends that they see me as using the spirit of physics.
And I do, from the physics culture that I absorbed, I learned that it's, you know, that you should try lots of different things.
You can guess.
You can use intuition.
You can use physical reasoning.
You could use computers.
You could do all kinds of different.
Sometimes a proof is great if you can do a proof.
But it's not the only game in town.
Whereas in pure math, that is the end all and be all is to prove theorems.
I never, never know.
So I'm definitely not one of those.
for me, it's, um, there's all kinds of ways of getting evidence and trying to understand what's
true. I'm definitely interested in the truth about the equations or the mathematical models that I
study. But, um, I sort of actually feel a lot of infinity, affinity with, um, artists, I must say.
This could take us in an interesting direction. I, you have, yeah, I mean, from some of your
writing, although we never met. I get the feeling you'll resonate with this. But I, I'm really interested
in something that maybe you could call like mathematical impressionism.
That is, instead of making a photorealistic painting of the world or the mathematical equivalent,
I like to get inspired by something in nature or in the world.
And then do something that's much simpler, that's the essence of what's out there,
sort of like the way the impressionist painters didn't try to capture the details.
They weren't interested in that.
They were trying to, with either their dots or their bold strokes,
convey the heart of whatever that was.
And so I like my models to be, for instance,
there was one paper that I did with my colleague,
Rennie Morolo, mathematician at Boston College,
where we were thinking about a certain problem,
but it reminded us of fireflies that all flash in sync,
all flashing on and off together.
And what we did was not an accurate model of real fireflies.
I would never claim that,
and we were careful in the discussion at the end of the paper
to explain why.
fireflies were quite different from what we were pretending in this paper, yet there were somehow
like the essence of what the fireflies were doing.
Yeah, and that's that, I mean, to a physicist, that just makes perfect sense.
I mean, it's obviously there's math involved, but the idea of distilling down some complicated
thing to the simplest possible description that captures something vital about it is what we do
for living in our own minds.
So I've always liked that attitude in physics, and I do feel it has a lot in common with
an artistic impulse.
Yeah.
Let's just be clear.
It's not like this is something that everyone would agree with.
There are quite a few applied mathematicians who say, that's not good enough.
You should really try to make a model that is testable, and the ultimate arbiter is reality.
Like, if your model doesn't do the right things in experiments or doesn't match observations,
even qualitatively, then you've gone too far.
You know, then you've lost the essence.
So I mean, I sort of believe that.
I agree that if you've gone too far, of course, you have lost the essence.
But the truth is, if I'm really being honest about it, I care more about math than nature.
Okay, that's a big dirty thing to say.
No, go ahead.
You're in a math department.
It's okay.
Well, that's right.
And that's why I'm not a physicist.
Because I think a physicist ultimately does care about getting the science right.
And there's this evil part of me that says, if it's beautiful,
but a little bit wrong.
I'm okay with that.
It's still beautiful, yeah.
Difference between fine artists and a photojournalist, absolutely, right?
Or an illustrator.
Well, maybe so.
I mean, there's an old quote from the flattering conversation for comparison from your perspective, right?
I'm the illustrator.
You're the fine artist.
Well, it's just a matter of what people are interested in.
So I think as long as you're honest about what you're trying to do, then I think it should be okay.
It's just where you pretend that's,
something is realistic and it's not, then you're going to get in trouble.
And, you know, the example you used is perfect because I wanted to segue into this whole
question of, you know, get to an example of what you've been working on for your whole life,
I suppose.
I guess as applied mathematician themes come back and forth rather than just working on one
big problem for your whole life, but the fireflies are the example that you used in
your book, Sink, to introduce the reader to this wonderful thing that appears all.
over nature in very different forms where you have independent agents doing something and yet they
naturally fall into synchronization. Was that Firefly paper that you alluded to there, the first
example of when you thought about that phenomenon? It's certainly one of our very earliest. I say
our because again, that person I mentioned earlier, Rennie Morolo, I did a lot of this work with him.
He was, and still is probably my best friend. And we did a lot of this when we were just starting
our career. So I was a postdoc. He was a new assistant professor.
But anyway, yeah, it was very early.
That was in the early 1990s.
And to me, it's part of a larger theme, a cosmic theme, about order emerging out of disorder.
I always found that spooky, almost theological, you know, because in physics, in the simplest case, like, say, in thermodynamics classes, we learn that things tend to disorder if you have a closed system with no energy coming in or getting out.
We do.
You know, then the second law tells us that system's going to just come to equilibrium and it'll be disordered.
Sort of maximally, it'll, as we, you know, in the jargon, the entropy will keep increasing.
So, but yet we see fantastically organized structures all around us.
We see civilization.
We see, you know, biology organizing itself into ecosystems and living things, cells.
I mean, there's, it's an, there's this fantastic fight between the forces that want,
not want, but you know, that make the universe tend to greater disorder and yet we see all
kinds of what looks like spontaneous order all around us. So that's still somewhat mysterious
from a physics perspective, although it's not to say we're contradicting the second law. That's
not possible. That's a correct law more or less. I mean, we could talk about that, but let's not
leave, let's not go there. When Toyota builds an electric vehicle, we don't start with a blank
slight. We start with everything we know. The BZ
brings Toyota's proven engineering to electric. With impressive range, intuitive technology,
and Toyota reliability, BZ reflects decades of experience, reimagined for what's next. The BZ isn't
just electric. It's Toyota Electric. We make it easy. Toyota, let's go places. Hi, my name is Lisa,
and I'm a licensed psychotherapist, which means my work doesn't magically end when the session does.
There are notes to write, appointments to manage, billing, insurance follow-ups, and somehow
all that admin used to creep into my nights and weekends.
That's why I switched to simple practice.
Simple practice is an all-in-one electronic health record built specifically for therapists
with HIPAA compliant tools and high trust certification.
So I don't have to worry about juggling systems or cutting corners just to keep things running.
Scheduling, documentation, billing, insurance, client communications, even automated
appointment reminders.
It all lives in one place.
And if you're starting or growing a practice, Simple Practice also offers a credentialing service that helps simplify insurance enrollment, which can be a huge lift when you're starting to scale.
Right now, Simple Practice is celebrating Mental Health Provider Day with an exclusive offer. Up to 70% off for one year. Yes, up to 70% off for one year. But hurry, offer ends May 15th at Simplepractice.com. Simplepractice.com.
No, actually, this is one of my pet peeves. You have not.
said to any of my pet peeves, but there's a pet peeve I have about how people talk about the
second law where they say what everyone says, which is that in a closed system, you tend
to disorder. And then they stop. And then they say, but look, at these open systems, you get order.
But they can't help but telling themselves, you know, the order appears in this open
system despite the second law. Yeah, no, no. There's no despite. Yeah, exactly. There's no despite.
It's like saying the moon orbits the earth despite the force of gravity.
because you think that gravity pulls things together and the moon doesn't fall.
So it's obviously despite the force of gravity.
But so I just react against that.
And you didn't do it.
You're not guilty of it.
But I think that there's a lot of work yet to be done in figuring out how open systems do organize themselves and how entropy is actually part of the reason why that happens.
That's right.
That's exactly.
That's being opposed by it.
Sure.
We're on the same page with that.
I mean, that's the challenge of non-equilibrium thermodynamics that it has to somehow be consistent.
with what we already know to be true from the equilibrium or close to equilibrium case.
And yet the math and the conceptualization, the physics part of it, they're just very
difficult.
And that's some of the most exciting research going on right now in non-equilibrium statistical physics.
And apparently fireflies are an example of this?
No, you know, I don't approach it from a physics perspective because, first of all, I never
took stat Mac statistical mechanics. I never went that far in physics. So I don't really know what I'm
talking about here. But I did work at it from the perspective of someone interested in differential
equations, which allow us to describe systems that change in time or in space or both. And, you know,
so something like fireflies, you can make a little abstract version of them where you think of, well,
what's going on with a firefly? If you have a single firefly that you're keeping alive in a jar,
you know, that you've captured out in your backyard, then it will flash and then its flash has stopped
and then it's sort of dark for a while. And then it somehow is building up its readiness to flash until
it reaches some, we don't know really what's going on. But there's probably something happening in
its nervous system where it's got a little timer, some little circuit neural. I mean, think literally. It's not known
exactly how the flash rhythm works.
Yeah, that's interesting.
I was going to ask, because we really, I don't know, obviously, but it's still not even
known, you think?
Well, I mean, we know something about the chemistry of what the substance is that, you know,
sort of ignites and flashes.
We know about the enzymes that degrade it.
But loosely speaking, it's a bit analogous to something we all learn in the first year of
physics where there's a charge between two, you know, on capacitor plates that's building
up.
It's like in the jargon, an RC circuit or a relaxation oscillator.
Something is building up toward a threshold.
And when it reaches that threshold, and you get a sudden discharge,
which in this case would be the firefly flashing or in the case of the RC circuit
would be the capacitor dumping its charge and then starting to build up again as it charges up.
So we at Reni Murillo and I made this little model of effectively lots of little relaxation oscillators
building up discharging.
And every time somebody discharges, it kicks everybody else up a little bit closer to their
firing threshold.
Right.
So sometimes they get excited or something like that.
Yeah, that's right.
And that part we know is correct qualitatively that fireflies not only flash, but they see the
flashes of others and adjust the timing of their flash rhythm in response to the flash of others.
We know that from experiments where you can use a pen flashlight to be like an artificial
firefly.
And if you periodically flash your flashing flashlight at this firefly, for instance, you can play tricks on it.
You could flash a little faster than its normal rhythm.
And then you'll see that firefly sort of scurrying to keep up, not literally moving its feet,
but it flashes a little bit faster to stay in sync with your abnormally fast flashlight up to limits.
I mean, if you drive it more than like 20% faster than it wants to go, it can't keep up.
And then it falls out of sync.
This is not helping the reputation of mad scientists and sadistic experimenters on the animal kingdom.
They do a lot of worse things than this.
Well, anyway, so we do know that there are interaction rules that can be measured through the kind of experiments I just measured.
And so the hypothesis was always that what's happening in a congregation of fireflies is they're all both flashing and receiving flashes from others and adjusting in accordance with some rules.
And so then the big math problem is, and it's something that transcends biology.
They're not trained to solve a question like this.
If every firefly is individually obeying the rules that you can measure, then is it the case that
synchrony will emerge automatically every time in such a population?
And that turns out to be quite a hard math problem because of the discontinuities in it.
That, you know, I said when there's a flash, then, first of all, the flash is like a
sudden impulse, just a quick on and then quick off. And then also we imagine that the,
to continue that capacitor analogy, that the discharge is very fast. So the firefly like sort of,
so to speak, instantly goes back to its baseline before it starts charging up again. And so when you
have jumps, yeah, when you have jumps in any kind of system that you're trying to describe
with math, unfortunately, the apparatus that we use in math assumes everything is smooth and
continuous and doesn't jump around discontinuously.
So what you say, yeah, when you say the apparatus, I mean, these are all human constructions,
right?
Like the math we're used to doing is comfortable with this.
So this is why you get paid the big bucks to sort of generalize that way of thinking a
little bit.
Yeah, thank you.
I didn't mean a apparatus in a laboratory.
I meant the mental tools that we use specifically.
I'm avoiding using the word calculus, but that's really what I want to say.
That calculus is predicated on the idea that things can change.
but they only change smoothly.
They don't jump, you know, discontinuously from one place to another.
Whereas these fireflies sort of act like they do, at least it would be sudden flashes
and the sudden response to flashes.
And so what made the problem hard and why it was a research problem for us was that, you know,
how do you accommodate something that is, on the one hand, continuously charging up towards
its threshold, but then at the same time, it can suddenly flash and suddenly discharge and go back.
So it was this mixture of continuity and discontinuity that made the math abnormal and weird and challenging.
And this is all started by, you know, in a very scientific way in the sense that we saw the fireflies doing this.
This had been known for a long time that fireflies got into sync somehow.
And I guess as a human being, your first guess is that, well, there's a boss firefly.
There's a peer leader that is telling them what to do.
There's a conductor for the orchestra.
but that didn't seem to pan out empirically.
So your question was, could it be self-organizing this coming into civilization?
Yes, exactly, right, right.
I did get a little ahead of myself there with talking about the math.
It is a great story that, you know, people that lived in Thailand or Malaysia had known about this.
They'd seen it forever.
But the first Westerners to come to those parts of the world like Sir Francis Drake from England in the 1500s,
there are ships logs that we can read of his sailors saying, as we go to,
down these rivers, you know, like the river to Thailand, there's these strange creatures that
live in the mangrove trees that flash. And they call them lightning bugs.
Yeah. So I called them growing up in Philadelphia. So, you know, that's still lightning bugs.
Yeah. Lightning bugs, fireflies, whatever you want to call them. They, but what was spectacular
is that there would be tree after tree for miles along the riverbank filled with these fireflies,
thousands of them, it seemed.
And they, it's so like you could visualize it, almost like a Christmas tree with Christmas
lights on it, except that these are beetles that, you know, we think they're these little
beetles that have this strange flashing property.
And the whole tree will ignite and get dark simultaneously.
And it goes on all night long.
And it's just an amazing spectacle.
So, but the question was, as you said, how is it possible?
These are not the most ingenious creatures.
They're just little bugs.
And at the beginning of the night, they're not doing that.
When they fly into the trees, you know, as the sun goes down, they're totally disorganized.
If you get there at dusk, you don't see the phenomenon.
It builds up over the night and it takes a while, but by the middle of the night, it's perfectly organized.
So that was always the question.
Is it that there's, as you say, is there some kind of master firefly like a conductor for the orchestra?
and they're all following the lead of that one,
that's not going to be a very robust biological way of doing it
because if a bird eats that particular maestro,
you know what, then it's not going to work that night.
Yeah.
And also who appoints the head firefly?
That doesn't seem biologically sensible.
Yeah, on the other hand, you have to keep in mind
that there are things in biology organized like that.
Like there is a queen bee who is different from the other bees.
So it's not unthinkable that there is a king firefly.
But no one ever found one.
And so the prevailing view today is that it's done, this spontaneous synchronization
is an emergent phenomenon that, as you say, it self-organizes.
You don't need an external signal like lightning in the jungle.
I mean, those were the old theories that there was, you know, look, it's in the tropics.
There's going to always be some lightning storms and all the fireflies get startled by the lightning flash
and that kind of pre-synchronizes them all
as they respond in shock to that lightning bolt.
But that's ridiculous because it happens every night
even if it's not raining.
So anyway, but there were, like I say,
it was a very old problem.
And it was only by around the 1960s
that those experiments that I mentioned with Penn flashlights
demonstrated that the fireflies are both reacting to flashes
as well as emitting them.
And the conjecture was always that,
they somehow through that process of interaction come into sync.
But no biologists could figure out how to demonstrate that because they didn't have the computers that could do.
I mean, it's not the way that they think.
They have different training.
So you really need a physicist or a mathematician to try to work on this.
And the mechanism is just that the fireflies are looking at each other.
And somehow what they see is affecting their rate of firing.
That's right.
Exactly.
So, yeah, if they see a flyer, you know, a flyer.
when they were not expecting to see one, it might tell them, oh, God, I'm a little bit late.
And then not consciously, but through just some unconscious processes in their nervous system,
because we don't think of them as having much consciousness, they just automatically adjust their timing.
Something in their nervous system changes in response to seeing this flash,
such that on the next time they will be more nearly in sync with that flash.
And it's not an especially complicated form of order, especially sophisticated,
but still it's self-organizing in the sense that there was no teleology, right?
There was no goal.
There was no idea that we're going to get together and do this.
It's just everyone's doing their own individual thing and suddenly, or not so suddenly,
but ultimately they're all doing the same thing.
I saw you, you know, do the same thing at a TED talk where you ask everyone to clap in the audience
and very quickly they're all clapping in rhythm.
Yeah, that's an interesting comparison because there the audience knows it's trying to get in sync.
And but yeah, you're right that the fireflies don't have any particular goal.
And there are different theories about why they're doing it.
I mean, I should clarify, it's only the male fireflies that are doing this.
It's definitely something going on with mating.
You know, it's not just all fireflies.
The females are flying around and they're looking for males to mate with.
And it seems that, well, so this is where the biologists haven't quite figured out what they want to say.
They used to say the idea was that all the fireflies of a certain species would get in sync because it would send their message the farthest possible distance because you would make a very bright signal that could escape the darkness of the jungle.
The females could find them from far away because there'd be this beacon.
Like here's where all the boys are.
But still, from a Darwinian perspective, how is it to my advantage if I look just like my neighbor?
Do the females flash at all?
They will flash.
Yeah, I mean, sometimes they will flash.
They actually do a little dance of light where they flash.
And then if the male is flashing in the right way, that is they want to mate with someone of the right species.
Because if you go with the wrong species, you could get eaten.
Yeah, okay.
Good.
But so, but they do, they send signals to each other.
And, you know, if the flashing is done in a way that they find attractive, or from someone of their species, then they'll actually be drawn toward it.
So, yeah, the females are flashing.
too. There's a lot of signaling to find each other and make sure everybody's on the same page.
Hi, my name is Lisa and I'm a licensed psychotherapist, which means my work doesn't magically
end when the session does. There are notes to write, appointments to manage, billing,
insurance follow-ups, and somehow all that admin used to creep into my nights and weekends.
That's why I switched to simple practice. Simple practice is an all-in-one electronic health record
built specifically for therapists with HIPAA compliant tools and high trust certification.
So I don't have to worry about juggling systems or cutting corners just to keep things running.
Scheduling, documentation, billing, insurance, client communications, even automated appointment
reminders.
It all lives in one place.
And if you're starting or growing a practice, Simple Practice also offers a credentialing
service that helps simplify insurance enrollment, which can be a huge lift when you're starting to scale.
Right now, Simple Practice is celebrating Mental Health Provider Day with an exclusive offer.
Up to 70% off for one year.
Yes, up to 70% off for one year.
But hurry, offer ends May 15th at simplepractice.com.
Simplepractice.com.
When Toyota builds an electric vehicle, we don't start with a blank slate.
We start with everything we know.
The BZ brings Toyota's proven engineering to electric.
With impressive range, intuitive technology, and Toyota reliability,
BZ reflects decades of experience, reimagined for what's next.
The BZ isn't just electric.
It's Toyota Electric.
We make it easy.
Toyota, let's go places.
And your mathematical result, was it that this kind of spontaneous ordering by synchronization is inevitable or it happens under the right circumstances?
Is it rare and fragile or generic or what?
Well, so yeah, that's the particular model that we made was the simplest possible thing where we made.
where we imagine every firefly could see every other firefly.
And that isn't really true.
You know, really, they would mostly see the ones that are near them in a tree,
and they wouldn't be paying very much attention to one that's a mile down the river.
Yeah.
But we ignored that.
So we did what in physics would be called the infinite range approximation,
where every firefly is imagined to be able to interact with everyone else out to infinite distance away from them.
The reason for doing that is that when you're studying something that consists of
a million interacting, you know, complicated.
They're sort of complicated for the reasons I said with this R.C. Circuit analogy.
So if you're trying to study the collective behavior of a million of these little
tricky things, you don't want to think, have the additional complication of who exactly
is talking to who.
So because we didn't even know how to solve the simpler problem.
So, yeah.
So in the case that we did with everyone interacting with everyone, we proved, actually, this
one of the few times we did actually really prove a theorem. We proved that for this model,
they would always synchronize in the sense that it's not that there wasn't a possibility of
something else happening. It's just that there was zero chance of it happening. So in the jargon,
it's like this. What I want to say is it had probability zero. It's not the same. So what's a good
analogy for this? I don't know. For physicists, it's going to happen. You know,
You're a mathematician. You're trying to be more careful. Don't bother. It's going to happen.
Yeah, zero probability doesn't mean that there aren't possibilities of it happening. It's just that you'd never see them in practice. I mean, to give a loose analogy, if I throw a pencil in the air, there is some possibility it could land on its point and balance.
Yeah.
That is possible. It's just, you're never going to see that.
That's right. I mean, it's possible that the popular vote for president would be exactly a tie, right? Yeah. These things can happen. But your mathematical notion of, you know, measure zero.
is even less than that. This is just not very likely.
So the fireflies are going to come into synchronization.
That was a great. That was a great triumph.
And then, but one of the wonderful things,
and one of the wonderful things consistently about good math
is that it finds application all over the place.
So in the brain, in how we sleep and things like that,
similar notions come to rise, right?
That's true.
There are so many different examples of spontaneous synchronization
that are important in science and in medicine and nature.
So, you know, like you mentioned the brain.
So a lot of neuroscientists will tell you that synchronous oscillation of neurons in the brain
is related to phenomena like attention and memory.
You can sort of see sometimes when, if you're looking under an fMRI machine,
you know, like people call them brain scans or they talk about what part of the brain
lights up when someone's doing a certain task or whatever.
Very often the way the brain will sort of get itself.
Okay, so here's an example.
Suppose I'm looking at an apple, you know.
And I can recognize that it's an apple.
You might think that's kind of obvious.
Of course, you can recognize it.
But not everyone can.
There are people with brain damage who can't recognize simple objects anymore.
So there's actually a miraculous thing happening in our brains when we see an apple on the table
and recognize it as an apple and not something else.
We think about what's involved.
We have specialized neurons that detect color.
There are others that are looking at shape.
There are some that are thinking about other qualities of the apple.
And we somehow put all those different qualities together to recognize one whole coherent object,
the apple.
And what you observe in the brain when that's happening is that the parts of the brain that
are noticing color are actually firing electrically at the same frequency as the parts that
are noticing shape.
or whatever.
I see.
So synchronous oscillation is the brain's way of, the biologists call it the binding problem.
How do you bind all the different features of an object into a coherent single object to
recognize that it's not just a bunch of different things happening in your brain all at once?
Interesting.
So it's not just that there's a part of my brain saying, I'm seeing something red.
And another part saying, I'm seeing something apple shaped.
But they're saying it in synchrony with each other.
and somehow that lets the brain or our conscious perception say that is an apple.
Yeah, and it says that, right, exactly.
Those separate things that are all oscillating in sync are all, meanwhile, other parts of the brain that are not paying attention or that are thinking about or, you know, like interested in other aspects, they're out of sync.
And so they're ignored.
It's the brain's way of telling itself what's all part of one object or one sensation.
Go ahead.
I was just going to say, I'll be very honest and confess that I didn't actually read this chapter of your book.
I just remember the chapter title, so I wanted to ask you about it.
But does this imply that there's a separate part of the brain that is keeping track of the frequency of oscillations to say, oh, yes, this is a coherent thing?
That's an interesting question.
Yeah, it might be.
I think the thalamus is often regarded as a relay station, that it takes in signal.
from different parts of the brain, and it might do some of the binding of what's happening elsewhere.
Right.
I'm not positive.
I've got that right.
So some of your listeners may correct you.
Correct me.
And a neuroscientist and a physicist.
So, you know, you're allowed to say that you're not an expert on you.
That part, I'm not sure.
But I am pretty confident that if you ask most brain researchers now, they'll tell you the binding problem is solved by synchronization.
Or at least that's their best current guess.
Now, I should say, you don't always want things in sync in your brain.
So epilepsy is a famous disease.
You know, you can picture someone having those during a seizure.
The most famous symptom is these rhythmic convulsions.
And the rhythmic twitching and convulsions is that many millions or billions of neurons
are discharging in perfect step when they're not supposed to.
Yeah, that I did know about.
That's a problem.
And this is always one of the problems with organization that you want the right amount of it.
Yeah, exactly.
So, yeah, you can have pathological synchrony too.
And where does sleep come into this?
I literally just yesterday was having a conversation with a bunch of scientists in different areas about, you know, so why do we sleep?
And the answer is often, well, there's this chemical that puts us to sleep.
But there's the higher level question, what is the purpose of falling to sleep?
Is this kind of research relevant there?
It could be.
That question, wow, you know, I mean, that takes me back.
my PhD was about sleep research.
I worked on human sleep and circadian rhythms, those 24-hour rhythms that we have in hormone fluctuations and body temperature and lots of other internal rhythms.
So, you know, but nobody has ever really, believe it or not, figured out why we need to sleep.
It might sound ridiculous.
Like my mother, when I was a kid, she actually had a theory.
She said because you have too much sleepy gas.
And so I thought, what?
That's a very mechanistic theory.
I like it.
Yeah, she said when you're awake, the longer you're awake, the more sleepy gas you build up.
And then eventually when you get so much of it, then you have to go to sleep and then it goes away.
So she was actually doing the RC circuit model that I talked about earlier where something builds up to a threshold.
And then she imagined it gets degraded and chewed up when you're asleep.
But actually, that isn't so far off from what one of the leading theories of what's going on is that there are sleep substances that are.
measurable. There are peptides that can be detected. For instance, there's a classic experiment from
a long, long time ago, maybe about on the order of 100 years ago, where researchers kept sleep,
sorry, sheep, the animal, the farm yard animal. You keep a sheep awake, how would you do that?
I mean, you could probably keep bothering it and disturbing it and poking it. I don't know. So they did
something to keep the poor sheep awake for way past its bedtime. So let it read Twitter. That'll be
enough. Yeah, you can, so anyway, you could do sleep deprivation on an animal. And then the
experiment was take a little bit of the blood of that animal that is sleep deprived and inject it
into another sheep and that other sheep falls asleep right away. Okay. So that certainly seems
to imply to my scientific mind that there is a chemical tracer in the blood that's saying,
dude, you should go to sleep. Yeah. So that and we've, over the years, isolated candidates for that,
for a long time, it was thought to be something called muramyl peptide that was the alleged sleep substance.
I think others have been found since then.
So it's possible that that's one of the things that's happening, that just being awake and active produces biochemical byproducts of activity that give you the subjective sensation of feeling tired and that that is you need to restore yourself back to having less of that stuff.
So sleep is partly for that, but it seems there's a lot more going on with sleep.
I mean, there are ecological reasons to sleep.
It depends on if you're a predator or prey.
You know, if you're a prey, you want to be in your borough, especially when it's not favorable for you.
Right.
If you're like an animal that wants to be out in the daytime, then you better be hiding when it's nighttime when all those nocturnal animals are looking for food.
So you can see how synchronization gets involved with all of these different.
things. Certainly, I'm about to fly to Europe and I know that jet lag is something that hits me
very hard. And apparently that's in part because different circadian rhythms inside your body
get out of sync with each other. Right. Exactly. That is what jet lag is. It's a funny thing. A lot of
people get confused about it and they say, I've heard so many people say, oh, I don't get jet lag.
I just, you know, I stay up all night and then I sleep it off the next day and then I'm better.
But what they're not noticing is that jet lag just is not only about sleep and sleep disruption.
There are all these other rhythms that we're not so aware of that are inside of us.
Like, you know, I mean, if you think about it, you're aware of it.
When do you want to go to the bathroom?
When do you feel hungriest?
When are you most alert?
Those are internal rhythms.
And then there are others that, like I say, body temperature is going up and down.
Even if you lie still in bed and people have done experiments.
like this, just keep someone awake in bed all day long. You can measure their temperature
and it's going up and down like a nice sine wave. So there are internal rhythms of temperature,
of alertness. And what happens during jet lag is that even if your sleep gets onto the local
time, your internal rhythms are still back at home time. That's the lag in jet lag.
Yeah, every individual person has a lot of things going on inside them that can be in or out
of synchronization. It really does matter. That's right. That's right. And so the
there are things in the outside world that help to re-synchronize as most important is sunlight,
but food is another one, the timing of your meals will affect.
And melatonin, of course, people have heard now of this brain hormone melatonin that you can use as a pill for a sleeping pill or for a circadian rhythm restoration pill.
But I have to say, I've always been skeptical of melatonin, not having used it.
So maybe those of people out there who are listening and do use it and swear by it.
I'm not saying don't use it, but I can tell you that in experiments, picograms of melatonin are
enough to be biologically active.
That'd be a one follow.
That's like 12 zeros.
Right.
You know, picogram is a tiny, tiny, tiny amount of melatonin has a biological action.
So I can't imagine how much is in a pill.
I think it's like a trillion times more than your brain wants.
So I feel like, really, you're taking such an ungodly amount of melaton.
Melaton, and I would be scared to do it, but I don't hear of anyone having trouble with it, so I'm probably wrong.
When Toyota builds an electric vehicle, we don't start with a blank slate. We start with everything we know.
The BZ brings Toyota's proven engineering to electric. With impressive range, intuitive technology, and Toyota reliability, BZ reflects decades of experience, reimagined for what's next.
The BZ isn't just electric. It's Toyota Electric.
We make it easy. Toyota, let's go places.
Hi, my name is Lisa, and I'm a licensed psychotherapist,
which means my work doesn't magically end when the session does.
There are notes to write, appointments to manage, billing, insurance follow-ups,
and somehow all that admin used to creep into my nights and weekends.
That's why I switched to simple practice.
Simple practice is an all-in-one electronic health record built specifically for therapists
with HIPAA compliant tools and high-trust certification,
so I don't have to worry about juggling systems or cutting corners,
just to keep things running. Scheduling, documentation, billing, insurance, client communications,
even automated appointment reminders, it all lives in one place. And if you're starting or growing a practice,
simple practice also offers a credentialing service that helps simplify insurance enrollment,
which can be a huge lift when you're starting to scale. Right now, Simple Practice is celebrating
Mental Health Provider Day with an exclusive offer. Up to 70% off for one year. Yes, up to 70% off for one year.
But hurry, offer ends May.
15th at simplepractice.com. Simplepractice.com. You know, I'll confess, I think that melatonin is a
miracle drug for me. It could be entirely psychosomatic, because I don't take sleeping pills,
and I generally have no trouble sleeping. And even if I take, you know, NyQuil, I wake up feeling
groggy, and I just don't want to do that. But when I travel and I want to get to sleep with
something like the local bedtime, I take melatonin. It puts me out, and I feel no after effects the next day.
Well, I got to start doing it.
I mean, this is a case where I'm too much of a theorist.
Yeah, well, you know, it could be killing me long term.
I don't know.
Hope not.
Yeah, hope not.
Okay, you raised this issue.
I really wanted to leap in at the time, but I knew we had other things to talk about, so I didn't.
You raised this issue with the fireflies of the approximation where every firefly is seeing every other firefly.
Now, obviously, that's not true, but maybe it's a good enough approximation to get what's going on.
In something like the brain, it's even obviously less true, and it's kind of super important that it's not true, right?
Every neuron is not talking to every other neuron.
And I think, correct me if I'm wrong, that this kind of consideration led you to think about the phenomenon of networks and how things were connected, which eventually resulted in a paper that has so many citations of my jealousy is overwhelmed.
Well, it is, that's right.
It was a desire to move away from that very unrealistic infinite range approximation and to just start paying attention to whatever new phenomena would occur if we tried to be a bit more realistic about the networks that really do occur in so many different phenomena that they got us thinking about what came to be called small world networks.
So the phrase small world is supposed to make you think of that experience that we all have.
when we get on a plane or go to a cocktail party and you meet somebody and you start talking.
And then you realize, oh, yeah, my cousin went to that summer camp.
And, you know, so then people say, oh, it's a small world because it seems like, how is that possible?
How can we be so?
Or there's also the counterpart, you know, the other phrase that you hear all the time is six degrees of separation.
Yeah, that I know someone who knows someone and we can connect ourselves to anybody, it seems,
through just a very small number of mutual acquaintances or chain of acquaintances,
which then became a popular game, right, that Kevin Bacon game with actors.
I'll mention that this morning, Jennifer, my wife, who's a science journalist, said,
do you know a guy named Eric Winfrey?
And of course, yes, because he's a professor at Caltech.
But also, I realize, you know, he, I think, is the nephew of one of your collaborators
or mentors in the synchronization game, right?
He's actually the son.
Oh, he's the son.
Yeah, he's Art Winfrey's son, and Art Winfrey was my closest mentor of my career.
It's a small world.
Yeah, it's a small world.
When I went to work with Art Winfrey, at that time, he had a 12 or 10-year-old son, Eric, who has gone on to be a great scientist and is your colleague at Caltech.
But who also, I'm notable about the two of them, is that they're one of the few father and son double MacArthur award winners.
They both got MacArthur prizes.
That's something to tell your dad, like, I got my own MacArthur now, yeah.
So two geniuses in the family.
And Eric was a very smart little boy.
I'm not surprised he's turned out to be a very smart professor, too.
And that's actually not surprising because we're all academics and scientists and so forth.
But if you did a very simple view of the world where everyone knew, you know, whoever lived within five miles of them and nobody else,
then it would take a huge number of steps of step.
for me to get from someone in another continent.
And the small world network phenomena says, no, it's really just not like that at all.
Yeah, that's right.
That's what's so counterintuitive because we do have this strong sensation that I only
know the people that live near me geographically or that are in my department at work or,
you know, go to my church or whatever it is.
So we feel like we move in small circles.
And so that's why we are always so surprised and say, oh, wow, that's weird.
a small world. And yet, you know, if we were statistically minded, we should be thinking,
this small world thing keeps happening to me. It must not be that rare. Right. Because everybody
experiences it. So it's, there must be some explanation. And one of the things that, um, Duncan Watts,
who was my grad student at the time was interested in, his father had said to him, do you know that
you're only six handshakes from the president, you know, that you could find some, you may not have
ever met, let's say in this case, Donald Trump, but you might know someone who knows someone who knows
someone and within six handshakes, you'd know someone who knows Trump.
Yeah.
So that struck Duncan as an interesting thing because at the time he was trying to study
not fireflies but crickets.
You know, there are crickets that can chirp in unison.
It's the analog of the fireflies flashing in unison.
So the biologists speak of choruses of crickets that are all chirping at the same time.
And we have a particular species of those crickets, snowy tree crickets, as they're
called, that live in Ithaca.
And so we thought we could do experiments on these crickets and see if some of the mathematical
models of synchronization actually predict what the crickets are really doing.
That would be new because the case of the fireflies in Thailand, much harder to go all
the way to Thailand and capture them.
But the crickets are right here in the orchards in Ithaca, New York, where I teach at Cornell.
And so we have like the grandmaster of sonic synchronization right here.
snowy tree crickets. So we thought that would make a nice experiment for Duncan to do for his
project for his PhD work. And so he learned how to capture the crickets and keep them alive. And
we were starting to put them in little soundproof boxes so that we could control how strongly
they could hear each other and, you know, like sort of try to set up an experiment with the help
of a bioacoustics expert named Tim Forrest. Anyway, it was in the course of doing these cricket
experiments that Duncan started to think about, I wonder, you know, when the crickets are
out there in the orchard, who's actually listening to who?
Do they all hear each other?
That can't be right.
Maybe they only hear the ones right next to them.
And so he got to thinking about connectivity in general.
And then he, through a brainstorm, remembered this thing his dad had said about six handshakes
from the president.
And so he came into my office one day and said, how would, if things were connected in this
small world or six degrees of separation way, would they synchronize better than if they
were just connected to their neighbors or would they? I mean, how would it work? And I thought,
I don't know. I mean, nobody, I don't even know how you do this six degrees thing. And so we
realize there's a whole big math problem. What explains the small world? And not only that,
but how would it affect synchronization? And then Duncan said it's much bigger than synchronization.
It would, because anything that's connected like that, you'd think it would make a big difference
because everyone is so close to everyone in the sense of the small world, just a few hopper.
away from everyone else. So, like, how would that affect diseases spreading? Yeah. At the time,
actually, people were talking about HIV a lot. You know, it doesn't get discussed as much anymore,
but during the height of the AIDS epidemic, you would hear people say, if you sleep with someone,
you're not just sleeping with them, you're sleeping with everyone that they slept with and everyone
that that person slept with. So the idea was out there that, you know, you feel like you're only
interacting with a low-risk group, but actually you're only a few steps away from, from,
you know, from the virus, let's say.
I think I'd actually like, I would like to try explaining these two concepts that you talk about
in the book that are relevant to characterizing these networks, the idea of the shortest path
between two people in the network and the separate idea of the clustering, right?
Like how many people are connected to overlapping friends?
Mm-hmm.
That's something you're willing to understandable terms?
Totally, yeah.
It's not very hard.
The idea of path length is just the idea that we were talking about with six degrees.
That if, I mean, like let's say you and I, we've never actually shaken hands.
Right.
So, because we haven't met.
But, and I don't actually know what our shortest path is, but we could start naming physicists and mathematicians that we've met.
Like, okay, I'm going to guess.
I'm guessing you've shaken Brian Green's hand.
I have.
He's been a previous podcast guest, so.
Okay.
So, and I know Brian Green, because I've known him since he was a high school student.
So that would make, and I don't think there's any faster route.
I mean, that's one handshake from me to Brian and one handshake from him to use.
So we're two degrees of separation apart.
And that's our shortest possible path.
That's our path length.
Right.
So path length is just what's the shortest route from one node in a network to another?
And so, okay, so that's one thing you can calculate for a network.
You'll look at all the shortest paths between any pair of points in the network.
And then that average is what we would call the average path length in the network, which is basically a way of quantifying this idea that everyone's about.
The number six is not important.
It's just that it's a small number of steps from any point to any other point, even in a very big network like something the size of the world with seven billion people.
But if your network were more like a lattice where you only knew your nearest neighbors, then the average path length would be enormous.
That's right.
So, right, if you picture a checkerboard, like think of it.
of the nodes in the network as being the squares of a checkerboard, on a say, literally a checkerboard,
which is eight by eight, if you wanted to go from one corner to the diagonally opposite corner,
the fastest way you could get there, well, you could go down the diagonal, I guess,
but that would still be eight squares in between.
And so there, if the world starts getting big, that shortest path is also getting very big.
It would not be, you know, like in a world, if it were seven, well, seven billion is sort of hard to take the square root.
But if it were, it's 10 to the 5.
Okay.
So let's say, yeah.
So let's say it was 10 to the 10th.
So if we had 10 billion people on Earth, which we will pretty soon.
If we're 10 billion people on Earth and they were standing in this big square checkerboard pattern, that would then be, as you said, 10 to the fifth.
So that's 100,000 people on each side of the square.
100,000 degrees of separation.
No one would say six degrees of separation.
It'd say 100,000 degrees of separation.
And no one would say it's a small world because it wouldn't be.
So the point being that worlds don't have to be small.
The checkerboard world is not small.
And yet our world is small.
So that was a question that Duncan and I wondered about, what does it take to make a world small?
The other question, though, is the common sense answer to this, what does it take to make the world small?
It comes from an old idea that like, suppose I know 100 people or whatever number you want to pick, it could be a thousand.
But say it's 100.
You know, like I know them well enough that they could, they would lend me money.
Right.
You know, maybe I have 100 close friends and contacts and relatives.
Okay.
So if I know 100 people and each of them knows 100 people, then naively I can just figure out how small the world is by saying 100 times 100, or in your scientific,
notation, that's 10 to the 2 times 10 to the 2, that's 10 to the 4th.
And if I want to get to 10 to the 10th, I have to do this five times.
So, you know, it'd be five degrees of separation.
If the world were such that I know 100 people and everyone else knows 100 people,
except not the same 100 people.
That's the trick.
In other words, if there's no overlap, then this simple multiplication of 100 times
itself doing that five times, that will be enough.
But that's the trick, as you say.
The problem is that of the 100 people I know, when they know 100 people, a lot of those are the same people because we live near each other or because we're in the same profession or whatever.
And so that's what we're calling clustering.
The fact that it's not just a random choice of 100 people anywhere on Earth.
So we have a more precise definition of clustering, which is we imagine you could think of it this way.
think of two people you know and now ask, do they know each other?
Now, maybe they do, like maybe they do or maybe they don't.
Like maybe someone you're thinking of right now is someone you went to high school with
and someone else is somebody that you know now from work and they've never met and they don't
know each other.
Okay, so those two people don't know each other even though they both know you.
But you could also think of two of the people at work.
Maybe they do know each other.
So the concept we had for clustering is.
is pick any two of your friends and ask what's the probability that they're also friends of each other.
Yeah, okay.
So it's a number from zero to one.
And in some types of worlds, that number will be very small and close to zero.
And in other types of worlds, it would be very.
Also, we used expressions.
Like we imagined kind of fraternity world where, or, you know, the only people you know are the people in your fraternity.
So, of course, two of your friends will know each other because they're in the fraternity too.
Right.
Okay.
So in that kind of world, the clustering coefficient, as we called, it will be very close
to one.
It's almost a certainty that your friends will know each other.
Whereas if you picked your hundred friends at random on the surface of the earth, you know,
there's one in Ethiopia and one in Indonesia.
And then each of them picked their friends at random, 100 friends somewhere else on Earth.
There's very little chance that two friends of yours would know each other.
That just, that odds are way against it that they would happen to happen.
And there's no reason they'd pick out of their hundred people out of 10 billion.
Why would they pick those same friends?
And these two examples, I think these are sort of like the classic kinds of networks
that people had been thinking about.
Either everyone knows everybody else.
So there's lots of clustering and the path is also very short or nobody knows anybody else.
And so the path can be short, but there's no clustering.
Is that right?
Well, let's see if we got that right.
I mean.
I think I didn't get it right.
I think not quite. So the, like the checkerboard world, or actually we often don't use a checkerboard, we used to like to think of it as people standing in a circle.
Right. So if all 10 billion people were just standing out there in a big circle where the 100 people they know are the ones right next to them in the circle. So I have 50 friends on my left and 50 on my right and I don't know anybody else. And the same for everybody else in the circle, the same thing.
that's a very big world because for me to get a message, let's say, to someone diametrically
opposite me, I have to go leapfrogging around in steps of 50.
Right.
And it's going to take a long time to get over 5 billion people away.
So path length very long, but clustering very high.
Yeah, it is clustering.
Yeah, high clustering because of my 50 friends on either side, they will overlap a lot.
Right.
You know, as I move to my friends.
So those worlds, that kind of world has very,
high clustering, but very long path.
Yeah.
And the other kind of world, the random world, is very small, but it has no clustering.
Right.
And so what we thought was this kind of paradoxical thing is that our lives, it feels like
our lives are very clustered.
Most of our friends do know each other, or at least many of them do, much more so than
if the world were random.
But yet the world seems small, almost as small as if it were random.
Right.
And so that wasn't obvious.
How could you have both?
Because the real world somehow does have both.
Could you make a model that has both?
And what Duncan and I realized, but mainly him, was that what was really important, I mean, one way to do it, and we thought this was the way it was probably done, is if people had certain number of far-flung connections.
To give you an example of what I'm talking about, I used to play a lot of chess on the internet.
and I got to be friends with a guy in Holland.
And I mean, I would say he was really my friend.
I knew how many kids he had and I knew about his life.
And I never met him actually face to face.
But I feel like he was my friend.
But the point being, if I wanted to get a message to somebody in Holland,
I could use my link to him.
And there would be a chance he would know that person or he'd know someone who would know the person.
In other words, there was this bridge where I was suddenly connected to somebody
I had no business being connected to except that we both like to play chess.
on the internet. And that bridge not only made me closer to everyone in Holland, but everyone that I know is also now much closer to everyone in Holland, although they don't realize it.
Right, right. Because they know me and I can take the bridge. You know what I mean? And likewise, more conceptually, if you had a friend from high school who is now a classical pianist, suddenly you have a whole bunch of connections. It's a short distance to you to everyone in the classical music world.
Exactly. Right. And so what's interesting about this mechanism, we called it shortcuts, is that the shortcuts really make the world very small, very quickly, though you don't sense it because you don't realize you're connected to everyone in the classical music world.
Right. I mean, because it doesn't sort of operate in your consciousness, but you are. And so this shortcut mechanism, we showed that very, very few shortcuts were enough to make the world incredibly small.
and that seemed to be a very generic phenomenon that because it took so few of them,
it seemed like most networks would have this property because you kind of, in order to avoid it,
you had to scrupulously avoid having any shortcuts in the network.
So we made a prediction back in, well, I guess it was, now I'm just spacing out.
When did that paper come out?
It was a while ago, yeah.
It was the 20th anniversary.
I think it was.
Okay, 98, yeah.
Yeah, that sounds right.
Yeah, 1998.
The paper came out in 1998, and so we had said the brain, for instance, will turn out to be a small world network.
When we can measure all the connections, that we haven't yet, measured all the connections between all the neurons.
There's estimated to be trillions of neurons in the brain, tens of trillions, I think.
So we don't know what the connectome, as they call it, is for the brain.
But we do know the connectome of a tiny worm.
That's the one nervous system that's been completely mapped out called C.
elegance.
Oh, yeah, my favorite little tiny worm.
Yeah.
So we know every neuron in its body, there's about 300 of them.
It's only a few, something like on the order of a thousand cells in the whole creature.
But by looking at the nervous system of this worm, we showed that it actually satisfied our
criteria for a small world, that it was much more clustered than a random world.
it also had path length about comparable to a random world.
So it was as small as it could be while much more clustered.
And the internet and a whole bunch of other networks in the real world.
A bunch of other networks.
Lots of real world networks.
And since then, I mean, in the 20 years since then, it's been abundantly documented
that our prediction was right.
Lots of naturally occurring networks will be small worlds.
And you could ask, well, okay, so what?
But what's interesting is that small worlds allow for very fast propagation of information
through these shortcuts.
So anything that needs to coordinate itself or act as a coordinated unit but is very big,
a small world mechanism is a really good way to do it.
But also it's dangerous in the case of like the HIV example.
Anything that can spread for good or for bad will spread much faster on a small world than
it would on say on a lattice or a ring.
And also typically a wonderful example of self-organization, right?
Like nobody planned it out.
You said naturally occurring.
There's mechanisms that typically give rise to networks just like this.
Right.
They're found all over the place.
And as you say, there's no central planner.
There's no need to design it.
It just sort of happens on its own.
I did want to mention one thing earlier, actually, that I sort of had in my head but didn't say out loud,
which was that there's another way of making the world small that you could imagine, which we
deliberately did not imagine, which is you could imagine that.
that there's somebody that everybody knows.
Right. I mean, if everybody knows Lois Weisberg,
so I use that example because Malcolm Gladwell wrote an article a long time ago
called Six Degrees of Lois Weisberg,
that she was this person in Chicago that seemed to know jazz musicians
and she knew newspaper people and just everybody knew Lois Weisberg.
Anyway, so that's one way that the world can be small.
If everyone knows these super hubs, these connectors,
then of course everyone's,
just a few degrees away because they're all close to lowest Weisberg.
But we didn't think that was really going to be, first of all, that felt like cheating.
Like, of course, that will make the world small if you have that.
But more to the point, we thought that's not really going to be how nature will use it.
That's not the mechanism because for one thing, it's hard for the lowest Weisbergs out there to maintain all those connections.
It's a lot of energetic cost, a lot of, it's just hard.
And you don't need it, right?
Well, you don't need it.
I mean, of course, you might have it.
But you don't need it.
The shortcut mechanism, and you need only very few of those, doesn't cost much.
And that will do the job for you.
So we deliberately ignored.
Also, I would say that I had been told by my friends in neuroscience that every neuron in the brain
connects to about, that is make synapses with about 10,000 others, which might sound like a lot.
But then when you remember that there's, you know, trillion neurons in the brain.
or something like that.
Or maybe it's 100 billion,
but it's way, way more than 10,000.
Yeah, but it's a lot.
Yeah, okay, right.
So it's on the order of 100 billion.
So that's right.
So if it's 10 to the 11th,
but there's only 10 to the four synapses per neuron,
you're, you know, that's a factor of 10 to the seventh difference.
So it's a very sparse network in that sense.
You're not connected to anything like the whole network.
And there are no lowest Weissbergs in the brain.
So we deliberately didn't want to pay a,
attention to those networks. And the reason I'm harping on this is because we missed the boat.
It turns out that there are a lot of networks that use hubs. The most obvious being airports.
You know, if you think of the airport system, and for air travel, you fly to a hub. And the hub has a lot of
roots going into it. So there are some networks that use this hub mechanism to make the world small.
And so that was studied by other people.
And we didn't, you know, like I say, it's an interesting thing, like in the history of science,
that sometimes you'll have a prejudice about what you think the way the world should be.
And you deliberately don't let yourself entertain another possibility because it strikes you as ugly or too simple or irritating in some way.
The world is very irritating because it keeps doing different things in different circumstances and different model.
It's full employment, but still, it's a little bothersome sometimes.
Anyway, those kinds of networks with the hubs were published.
You know, an analysis of them came out the year after our paper on the small world, Rika Albert and her advisor, Laslo Barabashi, wrote a paper about what they called scale-free networks that had not only hubs, but also a distribution of the jargon as degree.
That's how many connections any individual node has, how many friends in our earlier social network analogy.
So if you ask how many people have, say, 10 friends, how many have 100 friends, how many have 1,000 friends, you can find people with more or less big rolodexes.
And it obeyed a power law in that, you know, there was the probability of having a certain number of friends went down like the number of friends to some power.
It was an inverse, you know, like 1 over X to some power, close to 3 or so, 1.2 something.
So that technically would be a small world network, but it has this extra feature that they're also lowest Weisbergs.
There were lowest Weisbergs and also sort of like things a little bit less than lowest Weisberg.
You had sort of lowest Weisbergs at all scales of degree.
They were small worlds.
They didn't have the right clustering properties, actually, at least in the first models.
So we missed the hubs.
Barbashi and Albert missed the clustering.
And since then, people have figured out that real networks are more complicated than the models either of us proposed, which was no surprise.
We were both putting out really idealized simple models, more like for thought experiments.
Because this is within the realm of self-organization, I mean, these kind of networks, we can speculate a little bit, it's late in the podcast, these are at the heart of how complexity and complicated interconnected systems arise in a world.
is ultimately governed by the second law of thermodynamics and things run down?
Well, all I can say is both of these are common network themes, the small world theme
and the scale free.
There are a lot of other things going on.
We've learned a lot more about networks in the past 20 years.
So they were very stimulating early ideas.
I think we could say that.
I wouldn't claim that either one of them is in kind of, I mean, the small world law
is pretty much a universal law.
almost every real world network is going to be a small world by our criteria.
Scale-free has not held up as well, but it's still a pretty common theme to say,
the power law part is the part that's not reliable.
If you just ask, is the distribution of degrees something that obeys a heavy tail,
meaning it doesn't look like a bell-shaped curve with an exponentially damped tail,
but it has something that's got a lot of, a lot more of these lowest Weisbergs than you would think.
Yeah.
That does seem to be true.
Yeah, a heavy tail distribution has a lot more things you might think are unlikely or improbable than you would get by doing sort of traditional bell curve like probability distributions.
That's right.
And so the world is full of things like that and we're still learning to deal with them.
Maybe, you know, earthquakes or solar flares are examples of these, which means that terrible disasters can happen a lot more frequently than we might guess.
It's true.
There are a lot of those heavy tail distributions in natural disasters.
Yeah, with floods, wildfires.
I mean, the statistics of those are often very heavy-tailed.
So, okay, clearly we have enough room for a whole other podcast down the lines.
That is good.
But I do want to give you a chance because you mentioned right at the beginning how the very favorite tool of every mathematician, which is calculus,
isn't an obvious fit to the kinds of studies you want to do with the fireflies where there seem to be some kind of discontinuous jump.
And nevertheless, your most recent book is about calculus.
So I think many people think of calculus as there's nothing new there.
Like we've done calculus a long time ago.
And in fact, my memory of it is, you know, one might say a terrible class I had in high school.
What is it that you think makes us need another book about calculus right now?
Well, I would sing the praises of calculus.
I think it's one of the greatest achievements in the history of humanity.
You know, this is something that took about more than 2,000 years to develop starting from the days of Archimedes up through Isaac Newton and Leibniz.
And I'm taking a very broad view of what I mean by calculus, but let's say, roughly speaking, the systematic use of infinity to solve hard problems.
Right.
You know, that's the thrilling idea in calculus, that you can take a hard problem and chop it up into infinitely small, that is infinitely many infinitesimally small pieces.
and then those turn out to be easier problems to solve, those small ones.
And then if you can figure out a way to put them back together,
which is what we call integral calculus or integrating a differential equation,
then you can do the kind of math that has changed the world.
I mean, that's the math that let Maxwell predict the phenomenon of wireless
that's letting us talk to each other right now.
Yeah, I always try to gloss calculus as saying it's the statement that a medium-sized thing
can be thought of as an infinite number of infinitely small things.
things. Yeah, that's a great, great insight. And it literally changed the world. We can't, without it,
we wouldn't have radio. We wouldn't have television. We wouldn't have turned the tide in the fight
against HIV. So in the book, I'm trying to make, it's called Infinite Powers, and I'm trying to
make the case about just how, how revolutionary calculus was when it was invented and how it's still
giving us gifts today. And I feel that there's a need to do it. While it's true, as you say,
it's not the newest thing under the sun.
A lot of people, in fact, more than a million students in the U.S. alone take calculus every year.
And for them, it's something that they do the advanced placement test.
And they don't know what the heck they, you know, why did I do that?
Yeah.
It's often just taught as like a lot of, there's a lot to learn.
I mean, there's a lot of technical things to learn about how to do this kind of integral or that kind of derivative.
but I feel like the great human story of this fantastic idea that I would rank right up there with evolution and quantum theory.
You know, this is a fantastic thing that I want people to understand just how rich the story is and how world changing it was and still is.
Yeah.
So that's why to me it's not another calculus book.
It's a book that's we know it.
Those of us who are professional scientists know these things.
But I don't think that the typical high school student or even someone who,
might be teaching it in high school, they may not realize this very broad context of what calculus
has done for the world. Well, Jennifer wrote a book about calculus called The Calculus Diaries,
and the gimmick was that a 40-something-year-old English major learns calculus and learns to apply it
to the world. So I was helpful as, you know, an experimental test subject when we went to
Vegas or drove a car and just noticed all the different ways in which you could think about the
phenomena using calculus. So I completely agree with you that.
people just don't quite appreciate how absolutely universal it is.
And if you really get what Calculus is trying to tell you,
your view of the world changes in a profound way.
Perfect.
Right.
Exactly.
So I feel like that needs to be better known.
This shouldn't just be for insiders.
I feel it's a beautiful thing.
It's an inspiring thing.
And so I know there are people out there who would like to know this.
And I should say I've written the book for this sort of person, actually that you and I both like to write for, the educated person who's curious, but who is not a professional physicist or mathematician or may not have even taken these subjects in college, maybe was happy to be done with them in high school.
Yeah.
Well, I think that's what makes it interesting because we probably, there's a preexisting resonance with the word calculus in many people's minds.
and it won't always be positive.
So you don't have a blank slate to deal with.
You're trying to push up against some resistance,
and that's a fun challenge to take up.
Yes, it is.
Yep.
All right, Steve's drunk,
thanks so much for your time.
Thank you, Sean.
This is a great fun.
I'll definitely be recommending all your books,
and I want to read more about small worlds
and scale-free networks and things like that,
and maybe we'll have you on the podcast again
to dig into them further.
Okay, my pleasure.
I hope I will.
All right, thanks a lot.
You thought a soft mattress meant comfort.
But every morning, your back tells a different story.
This is the sound of support.
The sound of air weave.
Born from Japanese innovation, our air fiber technology
provides the firm, even support your body has been craving.
It's not about sinking in.
It's about rising up.
Air weave.
The aha moment your back has been waiting for.
Manufactured in Japan, air weave is truly supportive sleep.
Discover more at airweave.com.
What if you could have even more and more and more help to pursue your goals?
At LPL Financial, we offer more ways for advisors and their clients to thrive.
So what if you could?
Paid advertisement. Investing involves risk including potential asset principal, LPL Financial LLC member FINRA SIPC.
