a16z Podcast - Autonomy Across Air, Land, and Sea
Episode Date: November 4, 20242024 has been a milestone year for autonomous tech. Waymo’s fully autonomous driver has surpassed 20 million miles, while FAA approvals now allow commercial drones to fly without visual observers, ...advancing air autonomy in unprecedented ways.In this special live recording from SF Tech Week, a16z partner Erin Price-Wright moderates a panel of experts from three key domains—air, land, and sea—to explore the latest real-world deployments of autonomous systems, the impact of new chips on cost and efficiency, building full-stack solutions, managing risk, and the evolving role of regulation in driving these technologies forward.Joining the conversation is Macario Namie, CMO of Skydio, discussing the transition from consumer drones to enterprise and government use; Vijay Patnaik, Head of Product at Applied Intuition, who shares insights on developer tools and software for autonomous vehicles; and Peter Bowman-Davis, engineering fellow at a16z, diving into maritime autonomy based on his work at Saronic. Resources: Find Macario on LinkedIn: https://www.linkedin.com/in/macario-namie-bb529/Find Vijay on LinkedIn: https://www.linkedin.com/in/vijaysaipatnaik/Find Peter on LinkedIn: https://www.linkedin.com/in/peter-bowman-davis/Find Erin on Twitter: https://x.com/espricewright Stay Updated: Let us know what you think: https://ratethispodcast.com/a16zFind a16z on Twitter: https://twitter.com/a16zFind a16z on LinkedIn: https://www.linkedin.com/company/a16zSubscribe on your favorite podcast app: https://a16z.simplecast.com/Follow our host: https://twitter.com/stephsmithioPlease note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Transcript
Discussion (0)
There are now drones here in the Bay Area that are flown from somebody that's 20, 30, 50 miles away.
Mining has had some form of trucks without any drivers in them since 2007, 2008.
China outnumbers our shipbuilding capacity about 200 to 1.
Immediately, every hotel drone was just bricked in Taiwan.
Basic assumptions about how software is built for the kind of traditional SaaS world of the 2010s just doesn't work.
in the autonomy space.
You can actually create a really, really incredible reconstruction of the world
just using these video generative models.
And this is not hypergen-AI stuff.
The cars we buy in US, in Europe, etc.,
they're not delightful consumer products,
like when you brought your first iPhone.
This has been a big year for autonomy.
For example, the fully autonomous Waymo driver
has done over 20 million miles,
the equivalent of driving to the moon and back 40 times.
times, and is now doing more than 100,000 rides per week.
But it's not just autonomy on land.
For example, the FAA granted several operators the ability to fly commercial drones without
visual observers earlier this year.
And this is only just the beginning.
Now, in this live recording from SF Tech Week, we brought in experts from three domains, air,
land, and sea, to discuss autonomous systems.
And we touched on the real world deployments, the latest chips and their impact on the economics,
building full stack, quantifying risk, and regulations role in advancing this frontier.
Moderating this panel was a 16Z partner, Aaron Pricewright, along with three panelists.
First up, we have Macario Namie, chief marketing officer of Skydeo.
Skydeo is a 10-year-old company based here in San Mateo. We provide quadcopter drones, more specifically
camera drones. We shipped about 50,000. We started in consumer, especially for outdoor enthusiasts.
We've transitioned exclusively to selling into private enterprises, state and local governments,
as well as the federal government.
Next, we had Vijat-Nike, head of product at Applied Intuition, but also previously spent
five years at Waymo, most recently as head of product of their self-driving truck division.
Applied Intuition is focused on providing developer tools and software to companies that are building
wakeups.
We provide simulation and data tools that are necessary for building autonomous systems.
And finally, Peter Bowman Davis, an engineering fellow now at A16Z, but previously worked on machine learning at CERONIC.
Serronic is a full-stack maritime autonomy company.
We build boats that are autonomous and we sell directly to the government.
So that comprises everything from the whole manufacturing to the simulation side on the autonomy.
We also had some amazing questions from our live audience.
So stay tuned for that at the end.
And, of course, if you'd like to attend events just like this in the future, make sure you're
and while you're at it, leave a review. All right, let's get started. As a reminder,
the content here is for informational purposes only, should not be taken as legal, business, tax,
or investment advice, or be used to evaluate any investment or security and is not directed
at any investors or potential investors in any A16C fund. Please note that A16Z and its affiliates
may also maintain investments in the companies discussed in this podcast. For more details,
including a link to our investments, please see A16C.com.
slash Disclosures.
So I'm really excited because we have someone from the business, from the product, and from the
tech side here, as well as air, land, and sea. So maybe to get started, I would love to hear
how far along in the journey to autonomy you feel like we are in your industry, maybe
framing the levels of autonomy. And where are we really all the way there and where do we have
still some way to go. So Skydeo was sort of started on a foundation of autonomy and we did not
invent the quadcopter. Those existed prior to the founding of the business. I think we've all experienced
or seen them and even just walking around Best Buy and sort of toy form where you have some sort of radio
controlled mechanism to be able to tell the drone where to fly. The challenge with the use of
drones is that it always required a person to be there. And if the more you go up in the use
cases into more enterprise or government use cases, the more valuable the flying becomes.
And so if you're going to go fly around a substation that belongs to an energy utility and
you go crash that drone, you could take out power into an entire neighborhood.
That's not just something that's cute that your kids did on Christmas afternoon.
That's actually something that would cause you to lose your job.
It caused real problems for the community.
So the necessity for the person is not just to be there, but they have to be an expert pilot.
They have to be great at being able to fly in these really challenging environments.
And that was the premise of Skydeos.
Can we build the skills of an expert pilot into the drone itself so that any one of us here
in this room can actually pick up the drone and be reasonably proficient and they become
sort of democratized in terms of their access.
So we started day one from building in autonomy and the first iteration of that was the ability
to follow somebody.
Since then, we've sort of upped our game quite a bit, not only beyond obstacle avoidance,
but to be able to not have a person be present at all.
So going back to that substation example,
there are now drones here in the Bay Area that are flown
from somebody that's 20, 30, 50 miles away,
and those drones complete automated inspection missions.
So we're getting there.
The regulatory environment doesn't allow us to just completely eliminate the person,
but we're certainly making quite a bit of progress.
In the automotive space, which is passenger cars,
at the lower levels of automation,
what we would think of as for a user,
hands-on system where you're still paying attention to the vehicle.
Your hands are on the steering wheel,
but the vehicle can do things like automatic emergency braking
or what's called cruise control.
Those systems, I think, are available on sort of any car you go and buy today.
In Europe, some of those are mandatory from a regulation standpoint to be there.
I think U.S. regulations are slightly behind in mandating some of those systems,
but generally those are available on vehicles.
Where the next focus area for a lot of the OEMs is on what's called sort of level
two plus systems, which are these hands-off systems. So as a user, you don't need to keep your
hands on the steering wheel. You still need to pay attention and keep your eyes on the road.
And one level beyond that, but it's eyes off as well. So you can read a book, you can watch a
movie. Those systems aren't yet deployed. That's in R&D phase right now, just very early
deployments right now. And then on that level four side, I think, in the city in San Francisco,
we've all seen sort of Waymo's Robo taxis, and that's the sort of main deployment on the car
side right now. And I think there are some deployment in China that we see on the level four
side as well. Taking a different industry, I think maybe construction and mining side,
what's interesting is mining has had some form of trucks without any drivers in them since
2007, 2008. It's not the same level of autonomy as Waymo in the sense that those trucks are
following a predefined paths. They get a lot of support from the infrastructure in the mine in order
to do that. But there's a clear business case and an ROI for that product, and hence the mining
industry has been investing in that. The technology itself is far behind what's available on
today in automotive. So there is a big focus to upgrading that technology and serving more of the
use cases. Maritime, I would say, takes a lot of inspiration from the self-driving car community.
And the reason for that is effectively, in Maritime, you have this kind of two-dimensional
plane that you're moving around, very similar to self-driving cars, right? You just have lateral
planning. It's maybe a little bit more complex because you have the longitudinal access as well,
and you also have much less things in your environment to ground you. So when you're thinking about
like an autonomy model, the world doesn't usually just like nicely translate around you. Think about
driving a car in a nice kind of like city skyscraper block as you take a left, the world nicely
transforms around you. But imagine you're in the middle of the ocean and you take a left. The ocean
looks the exact same. And so you actually get a lot less information per frame when you're making
these sort of like vision models or you're making a sort of autonomy stack. And then the other thing that
I wanted to draw is the delineation between a perception stack and an autonomy stack. For a lot of these
use cases, for us at least, perception has mostly been solved. That is to say, object
detection, object avoidance. These are like very, very simple tasks, and they can mostly be done
with CNNs, which are 20, 30 years old. Autonomy is a bit trickier because you actually have to
take kind of elements from the perception stack, and you have to make them actionable. And that
is to say you have to do a lot of long-term planning. You have to actually take in that data and make
decisions based on it. And that's something I think that's only been enabled in the last five.
maybe you can make the argument even two years. And so I'm super excited about a lot of the work
that's going into reinforcement learning and long-term planning because this is super, super important
in the maritime domain, because in maritime, you're not often near the shore. And in the defense
application, you're not often in communications with back home. And so you need to make a lot of
independent decisions. And so these are the things that we're thinking about in the maritime autonomy
space. Double-clicking on some of those sort of technical breakthroughs, where do you think the
latest developments in AI have impacted autonomy. To what extent have they impacted autonomy and how
much change are we seeing in the industry today versus, let's say, five or 10 years ago, just based
on the current state of the art and things like video language models or other new transformer-based
architectures that might not have existed, for example, when Waymo got started or when Skydeo got
started. Yeah, I think pretty significant impacts, actually. In terms of the latest developments,
I think foundation models do have an impact on the architecture of these autonomy systems,
on these ground-based systems where you think of foundation models as replacing a number of more
tasks-specific models that existed. So we see more and more companies making the shift towards
using or it is researching with how foundation models can be used. The quote-unquote frontier of
research right now is end-to-end. Even when I joined Waymo back in like 2016, there was a lot
of hype around end-to-end driving, but it didn't really materialize the technology.
wasn't ready. So now it's almost a second version of that happening now where the research has
progressed a little bit further. So I do think the architectures are going to evolve significantly,
even though they're not yet ready for production. What that also means is that the tools and
infrastructure needed to support that is evolving pretty quickly. And so we are developing new kinds
of simulators that are needed in order to support those advanced architectures. And those
simulators themselves require many of these generative techniques or neural rendering techniques
that have shown good promise and research.
And third, I would say, is just using some of the generative AI to simplify workflows.
As an example, if you're an autonomy engineer, you spend a lot of time working with simulation
and scenarios, but you don't want to write a lot of complicated scenarios.
But we could generate them for you programmatically in a much more confident manner today
than what was possible two or three years ago.
So just at different layers, whether it's the autonomy stack, whether it's the tools being used
to develop that autonomy stack, I think we need.
see pretty fundamental impacts, and that's why we're investing pretty aggressively in utilizing
these technologies. Just double-clicking on the idea of simulation for robotics or autonomy,
I think this is a very non-obvious point to people who haven't worked in this industry for the last two
years, because I think that we've started to use video generative models as drop in replacements
for simulators like Unity or Ross or Unreal Engine. And the reason you need a simulator to be clear
is because, first of all, robots are really, really expensive, and you don't want to take them out to the
field to have them break if you mess up the algorithm, basically. And you also need many environments
where you need to train on policy, meaning you basically need to run it in real time in order to
make sure the thing works. And so in recent years, they've started to use video generative models
conditioned on actions or sensor data. And you can actually create a really, really incredible
reconstruction of the world just using these video generative models. And this is not hypegenital
stuff. This is used by Tesla. This is used by wave, comma. It's pretty exciting stuff. And I think
that some people are being very quiet about it,
but there's some really awesome public releases.
I will say the rise of Nvidia
has been pretty instrumental for our kind of business
to be able to put that kind of compute power
in a four and a half pound form factor
that can be sold for basically $11,000,
would still make some margin.
And that's a very hard thing to do.
I'm curious, how do you think about the cost aspect
when using the high performance chips
that Nvidia comes out with?
How does the sort of ROI for the business change
when you're putting the latest GPUs or compute
onto the drones?
It's so foundational to our business.
We have to have high computers on the drones themselves.
What we did in our latest release that we announced about a year ago
was we actually added excess capacity.
So basically trying to feature-proof the hardware so we can do more over time.
We haven't fully used it.
We expect to be able to run additional models,
including models that our customers build on the drone itself
because they can do much deeper analysis on the things that matter to them.
What's an example of a custom model that a customer might want to build?
So object detection is a really simple one, as you mentioned, but in our world, we see everything.
It's not just about, hey, people, right?
It's like, no, I want to be able to identify that particular transformer.
And by the way, PG&E's transformers are different to Southern California Edison's
transformers, which are different than Baltimore Gas and Electric Transformers.
So they know their transformers.
And then once we actually identify the transformer, we need to be able to determine whether
the thermal signature is actually saying there's a problem or not.
that is so specific.
We're not the best ones to be able to build that.
So that would be an example of how customers can build their own stuff
and then basically run it.
So you can take immediate action on the drone itself.
That's why we put in that excess capacities
to be able to do those kinds of things
that have that kind of extensibility in the platform.
Very cool.
Actually, that brings me to another question,
which is for Serronic and Skydeo,
both companies are essentially building the full vertical stack
where not just the algorithms around autonomy and perception,
but actually the full kind of product that goes into the world.
Whereas applied, you're much more of a software provider working with companies who are building the hardware.
I'd be interested to hear some of the kind of tradeoffs or what do you gain by owning the full end-to-end system and what's harder as a result of having to manufacture and deliver the final product.
We think that the ultimate value of a vertically integrated stack is reliability.
We're very committed to it.
We started with it.
And in fact, our primary competition in the world is DJI, the largest manufacturer of Jones out there.
And they are the complete opposite.
They're happy to build a hardware, and there's a whole plethora of other companies to sort of build their ecosystem around DJI hardware.
And we see that those seams actually start to fracture when you get more and more complicated scenarios.
And so you add in autonomy there.
What happens in the corner cases?
What happens in the failure modes?
How do things react?
That's where we could completely control that, and we can test for it, and we build reliability around it.
So I think the downside is that we might go slightly slower.
Right? Because we do have finite resources. We have to choose where our investments are. Whereas another company that may be all of what they do is to be able to build some kind of capability on top of another person's hardware. For us, we are okay to move a little slower to be able to deliver higher quality.
We're kind of like a weird middle ground, I would say, because we own the full stack.
We also, though, have three types of boats, like small, medium and large, basically.
And these boats are very different in terms of the amount of cameras they have, the actuation techniques, you use.
That being said, we still own all the hardware, especially all the compute.
And so the compute is mostly homogeneous between them, but your actual kind of effector systems or your perception stack is going to be differentiated.
And it's also differentiated in between boats sometimes because we want to test things out.
we want to add another camera or something.
And I would say it's actually a powerful thing to be a little bit agnostic on the hardware
and the software because it basically pushes you to create really, really solid abstractions
for your perception stack or for your autonomy stack.
And it kind of pushes you to be a better engineer.
This is at least what I've experienced in my engineering team.
We really liked to think about, okay, how is this going to work on boat N plus one?
And so that's been kind of a fun challenge to work on, but I do agree that it does slow things down sometimes.
Yeah, I completely agree with that point of abstraction.
And so Applied started with being a tools provider.
So we would provide this simulation and data products.
And eventually our customers were like, the tools are great,
but we don't have the internal capability to build that autonomy stack using the tools.
Can you help us with that?
So that's how Applied actually started.
We now provide an off-road autonomy stack.
We also have a trucking stack.
And to the point that Peter was making, now more so than ever in autonomy,
I think these abstractions are possible where we have a stack that it's not built for a single customer.
to be reusable across customers and they can build their eventual application on top of it.
So if you only want to use the tools, that's great. But if you want an actual autonomy stack,
either as your primary stack or to get kickstart your efforts internally, there are providers
like applied or other ones that you can use with the right abstraction to significantly
accelerate your program. How involved is that sort of translation process to different
form factors, vehicles, customer types? I'm curious to hear how hard it is to get a
that works for one type of vehicle to work in a totally different setup.
I mean, I would love to tell you that it's like seamless and just happens all by itself,
but there's the engineering aspect of it and there's the organizational aspect of it.
I think engineering, to a certain extent, you can engineer the best APIs and abstractions.
There's still customization that you would need to do, especially if it's for the first time
being deployed to different platforms.
But the organizational challenge is even more interesting because for some of the companies
that we are working with,
they're going through this big shift
of going from hardware companies
because vehicles were primarily hardware driven
to becoming software companies.
So they're reinventing themselves,
hiring software engineers,
hiring engineering leaders from Silicon Valley, etc.
And you actually need a very close partnership
to make this work,
especially if there's various different vehicle form factors.
So it's not just an engineering problem.
It's also how do you build up
internal capabilities for customers
who often will work with
them on like training their internal team, et cetera, in order to be able to work together on
this transition of the stack to many different platforms.
Makes sense. I spent most of my career before investing at Palantir. So I'm very comfortable
with that type of model. What was your experience there in terms of how to help companies sort
of make that shift to whether it's autonomy, whether it's software, data?
It wasn't necessarily strictly autonomy, but I think that there are a lot of similarities.
The biggest thing was how you embed with the customer to drive cultural change, which is
The four deployed engineer model really invented at Palantir where I would be flying out to
Azerbaijan or somewhere in Oman or Trinidad or really far-flung places to help their engineers
really on the ground in the field figure out how to use the software.
And so maybe switching gears a little bit.
I'd love to talk a bit about the economics of autonomous systems, also how that relates to regulation.
So we've heard and read in the news a little bit lately about Waymo and the economics of a Waymo ride.
and it's really exciting to see it to start to actually make sense
so that you're not just pouring money into a system for the sake of R&D,
but every single Waymo ride is actually, I think, profitable
if you don't count the overall cost of the vehicle,
which is a big cost to discount.
So I'd love to hear maybe starting with Skydeo,
like how do you think about the economics of the drone industry,
where you've seen real success, where it's been slower,
and maybe also how regulation has played a role in that?
We serve multiple different industries,
and their R.O.I. calculations are going to be slightly different. I've used a couple of examples where we talk about energy utilities. And in that instance, it's about looking at the people and labor it takes to go inspect the equipment, whether that's physical substations or transmission lines or distribution lines. At any time you can save the cost of actually sending a truck on site where they can put a person in a bucket, get them up in the air, which can cost $2,000 per deployment. And you can instead put a drone up and get the exact same information in 60 seconds, just sort of a pretty obvious ROI there.
We also serve public safety, like first responders, police departments, and I think you can't
really put a value on human life, but you can put a value on the insurance payouts that come with
officer-involved shootings. It can easily go to $1 to $2 million every time there's some kind of
use of force. And so being able to avoid that, being able to cut that down in half is really,
really key. Ultimately, we're in the business of providing information for people to make better
decisions. And if you're in a really high stakes scenario, better information about where the
threat is can really make a big difference in terms of whether you end in a peaceful way or
a tragic way. Certainly some elements of economics, but a lot of it is just keeping people safe,
keeping their officers safe, keeping the community safe across the board. And how about with the
regulatory piece of sort of whether an operator has a line of sight on a drone, how maybe take a
particular use case like police officers or something, like how they think about kind of fleet expansion
as those regulations change.
One of the key areas of investments right now
is a concept called drone is first responder,
where you would pre-position docking stations
on the rooftops of cities,
and this is happening in New York,
it's being tested in other cities,
where when a 911 call comes in,
the drone automatically deploys and goes
and is effectively the first responder,
the first person on site,
and is providing eyes back to a remote pilot.
That does two things.
One is, the pilot is sitting in some nice air-conditioned office,
and they can immediately relay information back to any responding officers
so they can respond more appropriately.
They can control many, many drones at the same time,
so it becomes a one-to-many versus a one-to-one argument.
And a lot of calls can be cleared.
These 911 calls for service can be cleared
by basically the drone saying there's no real issue here.
You don't have to go out on site,
and that's tremendous economic savings.
In order for this drone as first responder to happen,
you have to have a regulatory environment
that allows for a lack of visual observer on the roof,
And right now, just a 20-second primer on FAA regulations.
If you're putting anything in the air, it is regulated.
The FAA cares about airspace.
And they mostly care about just not hitting anything.
Don't hit an airplane, don't in a helicopter.
And so they require you to stay below 400 feet.
And they require a person to be visually looking at that drone at all times.
That's like the most basic rules.
So now you have a scenario where you might go further up,
but you don't have the available staff to put a person on the rooftop to be able to look out.
And the second is, if you're in some place like New York City,
the top 100 buildings are over 600 feet.
So how are you going to be keeping everything below 400 feet?
So being able to sort of work with the FAA to be able to create these kinds of waivers
to this traditional regulatory environment that allows for beyond visual line of sight,
beyond visual line of sight without a visual observer,
and to be able to actually stay within 50 feet of structure so you can actually go up and over a building
as long as you're within 50 feet.
And that was a waiver that just came out actually two, three weeks ago in New York City.
And it's a fantastic way of having the FAA sort of work with these agencies to do
what's right for the community while still keeping the air safe.
Exciting.
Congrats.
I'd love to hear the applied intuition, the economic case where you see where is this still
sort of a slightly money losing R&D exercise versus where are you actually starting to see
the economics make sense and where, if at all, regulation plays a role in that.
Yeah, I mean, on passenger cars, they've had driver assistance systems for a long time.
As these systems become more capable, OEMs have an ability to charge more for them, right?
That's why the FSD system from Tesla when it came out was over $10,000.
As an avid Tesla full self-driving user, there you go.
I can attest.
Yeah.
So there's a certain willingness to pay if the performance of the system is up there.
Now, Tesla has discounted that.
So I think the industry is in a price-finding sort of stage right now where obviously the
best thing would be higher performance while keeping costs the same.
But as the cost of compute goes up, more sensors go onto the vehicle, more software being
deployed onto it because the amount of complex, the bomb cost for the OEM goes up.
So I think there'll be some price increases.
OEMs already operate on somewhat thin margin compared to the margins we are used to in the Silicon Valley.
So they're not in a position to keep losing money on each of these systems.
So I think the market will eventually find a price that makes it profitable for the OEM to ship these systems.
On the, I think areas like trucks and construction mining have a different unit economics framework.
So if you think about trucks, for example, and I'll tie in regulation into this as well,
we can think of unit economics as reducing the current costs, but a big part of
Unite economics also, can you increase the revenue per truck or not?
So the first argument is, hey, there's a shortage.
So we're losing, like, supply chain, flexibility, etc.
Like, we do some work in Japan and providing our autonomous truck technology.
In Japan, the government is actually pushing the commercial vehicle sector to invest more in
autonomy because they're seeing, they call it the 2024 problem, where the drivers are
aging out and they are overworked and have health issues.
So the shortage problem is real.
But even if you look beyond the sort of, okay, how do we reduce the labor cost and the
insurance cost?
If you have a network of autonomous trucks, you can actually optimize the entire logistics network
such that you're generating more revenue for truck, which makes you an economics better.
Where regulation plays a part in that is twofold.
One is in a place like the U.S., each state can actually regulate how these driverless trucks are deployed.
And so you can have this weird mix where the states that your truck is traveling through have slightly different regulations
and federal government has different regulations.
So you do need some consistency.
So if you want to have a truck grow from L.A. to Atlanta, which is actually a pretty heavy freight route,
then California has to have consistent laws with Arizona and Texas that allows that.
And I think it's not fully there yet, but getting there.
The other side of it, there are regulations like hours of service that determine how long a truck and a truck driver can drive.
That's for their safety from fatigue, et cetera, and for road safety.
So the government has to be willing to be flexible on those such that those trucks can then operate 24 hours,
such that you can then reconfigure logistics networks
and then make the supply chain more efficient
and make the revenue and the unit economics work.
So I think those are some of the factors in trucking.
And mining, I think, is a different sort of set of factors
in the sense that the ROI is somewhat already clear to the industry.
That's why they've been investing in autonomy for a long time.
And the trucks we're talking about in mining
on which these autonomy systems are being deployed,
there's like a $5 million machine, right?
So it's not a big deal if you put $100,000 LIDAR on it.
Of course, it adds $100,000 and that's meaningful,
but in relative to a $5 million machine, that's not the main point.
The main point is if the system stops and it stops the mining operations
for every minute you stop the mine,
you're losing them tens and hundreds of thousands of dollars.
So the unit economics game there is at a mine level,
not necessarily at a truck level.
I also imagine replacement cycles are different.
It's not as easy to buy a new $5 million bulldozer as it is to buy a new $100,000 car.
That's right.
But the whole ROI calculation becomes a slightly different calculation,
which is how many trucks do you deploy in a mine?
How do they impact the productivity, which increases the mine revenue,
and how do they impact the downtime, et cetera?
So we see slightly different applications,
but I think generally in mining, as I said,
OEMs and the mines, we talk to see the business case there.
It's just improving the technologies such that can reliably work
and not bring down time to the mines.
So I think related to some of the questions around regulation,
I'd love to talk a little bit about geopolitics.
and some of the kind of regional or global differences in our approach to autonomy.
I don't know if this is a true story, but I did hear the story about DJI drones being used
early on in Ukraine. And China had given Russians a backdoor to be able to determine the
positions of Ukrainians on the ground using DJI drones, which was a big impetus for a lot
of the drone activity that we're seeing in Ukraine coming from the U.S. So there's a lot going on
in this kind of geopolitical landscape.
And I kind of love to hear how, for all three of you, actually, given Serronic as a
defense contractor, I'd love to hear how kind of the role of geopolitics and how you think
about autonomy and how it's come up both as maybe a challenge and also a motivating factor.
So Serronic was basically founded on this idea that China outnumbers our shipbuilding capacity about
200 to 1.
So the question is, what can we use as a sort of unfair advantage to leapfrog that, rather than
just compete on the basis of cost per ship, how can we make autonomous distributed systems
deliver sort of an overmatch result over China's kind of chip building capacity? And so this
has obviously played a major role in motivating seronics a company. But sort of even beyond that,
I think we've seen a lot of unmanned service vehicles, which is autonomous boats, be used in the
Middle East, as well as with Ukraine and Russia. And so I think the sort of heating up of global
proxy wars, not just great power conflict, has also.
led to a lot of expansion of use of atomic systems as we see in Ukraine, as we see off the coast
of Yemen and other countries like that. But yeah, that's the TLDR. And then given the sort
of DJI angle here, would love to hear how Skydeo thinks about this. Geopolitics is a very important
topic in our world. You mentioned Ukraine. We've been in Ukraine 30 times. I was there this past
spring. They use DJIs in a very disposable fashion because it's the cheapest they can get and they
hack it. DJ is effectively a hostile vendor to them, and so they have to hack it quite extensively
so that the drones can actually fly there and not be detected by the Russians, and there's
certain techniques they have to do that. One of the challenges that the U.S. looks at is the threat
of being wholly dependent on Chinese-based technology for industries that they would consider
to be critical to national security. What Ukraine has shown to the world is how critical
drones can be in any combat. And if all of our drones and all of our drone parts are being
held by Chinese manufacturers, then we are wholly dependent on them for such a critical
technology. And that is exactly what the U.S. is trying to avoid. And so there's laws being
discussed within Congress now to start weaning the United States off of Chinese manufacturer
drones. So it won't be an immediate ban and won't happen overnight, but they can start
sort of less than independence and sort of encouraging U.S. and U.S. innovators to step into the fold,
ourselves. We're not asking for subsidies, but we do benefit from restrictions for sure
that for some of these organizations like the federal government or state and local governments
to choose Western products instead of Chinese manufacturer products. And one small example
of the kind of power that some of these manufacturers can have, Autel, which is sort of a smaller
version of DJI based in the exact same city in China. They decided one day that they would
update their geo fence, basically where you're allowed to fly or not allowed to fly. And they
turned off all access in Taiwan. So immediately, every hotel drone was just bricked in Taiwan.
Now, why Taiwan? So if you had an example where all of our critical industries are using a
Chinese manufactured drone, and one day, China says, I'm just going to turn them all off,
they can immediately brick them. And that's really the extent of the problem. It's quite
severe. Yeah, I think China is a conversation with every CTO or CEO of any major OEM across
industry that visits our office or we talk to. And these are like weekly conversations. Just to take
an example from automotive and maybe government, because the plot also does a bunch of work with
the government, in automotive, China is basically redefining the industry. There's no sort of
lighter way to put it. There's a few things that are happening. And the Beijing auto show was
earlier this year. It happened to be there in person for it. All of the attention was on the local
Chinese OEMs. Like you could literally go to the boots of the international companies and
consumers didn't really have much interest in them
except for a couple of brands.
And that's because the product innovation
in the China ecosystem is second to none right now.
The cars you can buy there, like buy,
not just drive in a prototype,
just vastly superior consumer experience
compared to what you can get in the US or Europe.
I was talking to Steph earlier
about some of the experiences there in terms of
you walk up to a car and you say,
please unpark yourself, it unparts itself,
opens a door for you,
you sit in the car, the car assistant can process
commands from four people talking simultaneously. It's a delightful experience to sit and
those, these are production cars. And it's not just about the product today. It's actually scary
how fast the pace of innovation is every six months they're innovating on that product. And the
cost at which they're able to do it is very hard for the global industry to match. So at one point
you might think, well, there's enough geopolitics that maybe the global economy is like somewhat
insulated from that. And we're seeing that in the US where there's 100% tariffs on Chinese
vehicles. At the same time, you look at the sort of what's happening.
in the market in China where these OEMs are facing a sort of flattening domestic demand.
They have oversupply.
So even though China is the largest automotive market already and the largest exporter,
they all have ambitions of sort of going global, right?
And some of these OEMs have cost points that are solo, like a BID, that despite tariffs in
Europe and despite tariffs in U.S., they might actually be somewhat competitive.
And that's why every automotive executive is worried about China and thinking about,
okay, what's our strategy, not just in China, but what's our global strategy.
given what we are seeing in China.
I think on the government side, it's similar, honestly, in the sense that the DOD used to be
the driver of innovation, right?
There's a lot of ties between the Silicon Valley history and DARPA and how autonomy came
about and how a number of other technologies, like even internet, came about.
And now we're at a point where I think the Pentagon recognizes that it's been slow in moving
towards software and moving towards autonomy and definitely slower than China, both in terms
of processes of like how do you do procurement is actually a big barrier today.
So we do this conference every year in D.C. focused on national security and the entire
conversation is about how do we move faster and bring these technologies that are being
deployed in the commercial world to national security much faster and how do we evolve our
procurement processes to be able to do that. So I think across industries, we see China being
a major part of conversation, a major driver of strategy for companies. I was going to end
with the last question of what keeps you motivated, but I feel like that's very motivating.
So with that, I think we have a few minutes left. So I wanted to just open it up if anyone in the
room had any questions for our wonderful guests. All right, since this was a live recording
and some of the questions were pretty long, we've condensed them for your ears. And I'm going to
be punching in with the voiceover. All right. First question, what are your experiences dealing with
security guidelines and regulatory bodies? The one thing that I would say is it's a little bit
unintuitive sometimes that designing autonomous systems, as long as they're not like true kinetic
effectors, sometimes it's actually lower risk. The example that I like to give a lot is imagine
designing a drone versus a helicopter, right? Helicopter, you've got to be pretty sure that
that thing will not fall out of the sky, right? A drone like falls out of the sky, okay, that's fine.
We'll iterate, we'll keep going. And so sometimes it actually helps me sleep a little bit better at
night thinking, okay, at the end of the day, these systems are directing themselves. If the boat
sinks, it's not the end of the world. And so that's what I'll add to it. In terms of the actual
reality, the fact that we're designing for the DOD, though, yes, these systems have to be absolutely
like secure, mission critical, especially in terms of reliability. And to this extent, I think
Serronic as an engineering org is built up around this. Like the way we do our systems engineering,
the way we do our test and evaluation pipelines, I think is a lot more rigorous than a lot of other
companies, but at the end of the day, you can sleep a little bit nicer, just knowing that
they're unmanned systems.
From a product design standpoint, in terms of safety, a lot goes into basically failure
mode.
So what happens if the battery gets too low, no matter what inputs the operator gives, the drone
is going to come back and it's going to follow the path that it had.
So it can sort of navigate back from obstacles, no matter where it's out to get back to its
original location.
It can also basically land directly down.
There's a programming of safe landing zone.
So those are all things to try and keep people sort of safe.
In terms of more security, especially with the Department of Defense,
we sell a variant of our products that are effectively offline.
And offline is a bit of a misnomer.
They're online, but they're completely within the private network of the DOD.
So we have no access to it.
It's not cloud-based.
And those are instances where if the customer really, really needs that level of security,
they have it.
And it basically means more engineering work for us because we have to carry two variants forward,
but it's necessary in order to serve a federal government.
Yeah, generally in sort of the automotive realm and sort of way more cars, etc.
What I would say is that what's been done in the industry in the past,
like all of the systems engineering practices that have been used to build aircraft,
like commercial airliners, etc, are necessary and are used but not sufficient.
In the same way, in some of the standards that have been put out,
ISO 26262 that has been used in the industry for a long time,
these are all inputs, but none of these individually or even,
cumulatively are sufficient and so if you look at some of the publications from way more and
some of the work we do with our customers we actually consistently tell our customers we actually
need to do way more than what's actually any regulatory body is asking for or what aerospace
engineering has done in order to prove the safety of these systems and actually validating that these
systems are safe to be deployed whether that's a passenger car whether that's a truck
whether that's a mining agriculture defense application is actually one of the problems our customers
struggle with the most because there is no standard blueprint for it. It's a combination of an
engineering problem plus a data science problem plus a regulation problem plus winning consumer
trust problem because eventually you have to convince yourself and the stakeholders that this
is safe enough. So it's not a science problem, but in many ways it's still the blueprint is yet to
be clearly written for this. And I just don't think the regulations and standards are enough. And the
same applies for cybersecurity. I think they're very short of what actually needs to be put into these
systems. What best practices do you use to reduce stress in your technical debt? If you ask any
seronic software engineer what the three magic words are, they'll tell you this. The kind of design
principles that we follow is simple, correct, fast in that order. The idea is that first of all,
you want to build a very, very simple system that you understand from the electron level. We do
not integrate any technology that we don't understand from the electron level, all the way up to the
software level. And so the TLDR is that.
that we build a ton of stuff that doesn't work at first,
but that we understand super, super well.
And so the systems design, like kind of philosophy,
pervades basically everything in our software spec.
So yeah, the simple correct fast is like the way
we do it at Serronic.
This is totally worked, from my opinion.
I never heard of technical debt.
What's that?
So I think technical debt is inevitable
in fast changing industries like the ones we play in.
So I think we were previously talking about
how the underlying technology in these eventual systems is changing,
which means we have to rethink the products we are providing to the market
quite a bit, right?
So you keep the current system stable and then you deploy a new system magically over time,
but we've all been doing engineering for a long time to know that it's never as clear
cut as that.
But I think we focus a lot on working with our customers on like joint roadmaps,
where we literally go to customers and say, hey, we're going to actually
upgrade the architecture of this product because now we can actually make use of generative
or any other technology in order to improve these products.
And surprisingly, more often than not, if you have a reasonable roadmap,
the customers are actually pretty reasonable.
It does require you to have a trusted relationship where it's just not like here
some money and you're a vendor and a traditional software vendor.
So if you're in commoditized markets where you're just purchasing based on certain features
and who's the most cheapest to procure, it's hard to have that kind of relationship.
But for the industries wherein where the software, we are providing them,
either that's the developer tools or the actual software that's going into the way because this is
cutting edge software and they know this is cutting edge software. So it's a very like collaborative
relationship with the customer. We're often building new products with them. And that allows us
to have sort of these thoughtful roadmaps. Man, I've been in tech 25 years. There's always technical
debt. The longer you're around, the more it piles up. I don't know that I could add anything more.
The one thing that's a little bit unique about Skydeo is that we have these hardware platforms and that
allow us to basically sort of reset. Like the latest generation that we announced last year was three
years and $80 million in the making. That allowed us to basically reset a lot. But we also have a
pretty large cloud software component and there's a hell of a lot of technical debt that's been
built up over the last seven, eight years. I don't have a magical answer on that one.
Some people think to get to self-driving level four or five or a robo taxi status that we don't need
lighter. What's your take there? All right. I can take that super easy question. So I think
Generally, one is somehow the industry has gotten into this, yes,
LIDAR, no LIDAR, sort of binary camps.
But at the end of the day, a sensor is just one other piece of technology
that you incorporate to achieve the ultimate goal of, in this case, level for
robot axes.
So if WEMO had a path to deploying the vehicles that you see on the road without a
LIDAR, I guarantee you WAMO would have taken that path because there's a lot of
engineering and science invention that went into building some of the LIDARs
that Waymo has.
They really are like cutting-edge LIDARs.
And so we're most not building them for the sake of just,
hey, it's fun to work on these technical challenges.
There's a portion of the safety case
that goes back to the question of how do you
certify that these are safe enough,
that relies on certain properties that only LIDARs have
that today the other combination of other sensors cannot.
And even in cars and like China, for example,
you'll see LIDARs and lower levels of autonomy.
So A, that allows them to sort of bring certain
capability to market faster, but also from a liability perspective, you have to really think
from a manufacturer perspective, if the vehicle does get into an accident, and we will see accidents
happen in the industry as sort of the technology is maturing, would you rather have gone
all the way and done whatever was possible from a safety and liability perspective to prevent
that or not as a question that OEMs have to face when they think about should I put a
LIDAR in a passenger car or not.
So ultimately, will we get to a point where systems without LIDARs are good enough to
function in their respective design domain?
That respective design domain could be mining.
That respective design domain could be cars.
It could be some defense applications, et cetera.
I think in the long term, we will get there.
But do I think that at the early stages of deployment of technology, taking the safest path
is the right approach in order to build up trust in the technology,
in order to build up trust with residents of a city,
in order to build up trust with regulators.
I think that's a pretty reasonable approach.
I'm super curious to hear your observations around the ecosystems you're seeing emerging.
I'm sure that's also really interesting from the venture perspective, right?
How do you see the next couple of years coming together there?
I'm happy to take a first crack at this.
So I think it's a really good question.
It's something that we think about a lot.
historically, I'd say the industry has mostly focused around, with a few exceptions applied
being a great example of an exception scaly. I being another one that both businesses really
took off as a result of selling software into the sort of self-driving, early on at least,
into the self-driving market. Most autonomy companies for the last decade have been very tight
coupling of hardware and software, where all of the software was written almost to the
firmware level for the specific hardware form factor. And what we're starting to see, I think part of it
is like the last three years of developments in AI and part of it is the broad explosion of interest
in autonomy across a lot of different use cases is more of a software tool chain emerging. But there are a lot
of unsolved challenges that we see pretty consistently across companies operating in autonomous
of spaces. So even like basic assumptions about how software is built for the kind of
traditional SaaS world of the 2010s just doesn't work in the autonomy space. You often don't
have Wi-Fi. Like you can't expect that you can just ship releases like every five minutes
to customers and they'll be able to update. How do you stream data from one place to another?
Like how do you decide what decision making happens on device, on chip, on the edge versus like
in a cloud environment because it has to consider a swarm or a fleet of devices.
So those are all like really interesting technical challenges and problems that I think
developers will start solving more at scale in the next several years as more and more
autonomy use cases come up.
So I imagine that the kind of developer toolkit around building an autonomous system is
going to be more decoupled from the hardware itself over the next several years.
There's lots of opportunities to build new tech in those scenes coming up.
From our vantage point, autonomy is what democratizes access to the drones, but it's not what people buy.
They don't care about our autonomy.
They frankly don't really care about our drones.
What they care about is the information that the drones give them.
And the easier way we can get that information, the faster way we can get that information,
our next level of autonomy and the broader roadmap is going to be less about how do you fly
and more about what mission are we trying to accomplish
and how do you actually coordinate across multiple drones
to be able to accomplish that mission
in a safe way and a fast way
and that because much more vertically specific
and use case specific.
And that's really to us where like the gold is
and will create tremendous differentiation.
Our hope is that there is actually a very thriving drone industry
in the United States to be able to combat the Chinese manufacturers.
It's also extraordinarily capital intensive.
And that's hard.
That's a big barrier.
We've raised a lot of money.
And we're the largest manufacturer in the United States, but we saw a long, long, long way to go.
I hope there's an sort of proliferation of a number of players coming in and contributing,
because I think it will be overall best for consumers is in building applications for the vehicle.
So today, for the most part, the cars we buy in U.S., in Europe, etc., they're not delightful consumer products.
Like when you brought your first iPhone and you had a magical moment, oh, wow, this is great.
And now some of that has, I think, tapered off at iPhone 16 seems like the same as 15 and 14.
So there's really not been a great consumer product in that sense for a while.
But when you go to China and you experience those, you get some of that wow and that moment of delight back.
And then you peel the layers and say, okay, why doesn't this exist in the cars here?
The reality is that you peel back the layers behind your car.
Today, there's 150 different suppliers that each provided a small ECU as mini computer.
and the OEM integrated that into sort of a functional experience.
But you almost have to redesign the car from the ground up.
And that's what Tesla did because they could start fresh.
They could start with a software engineering talent and said,
we don't need to design it the way that we did.
And that's a journey setting every single vehicle that moves is on today.
And that's why applied is sort of providing that operating system.
Because if we can provide the operating system and give you a nice SDK to build those consumer
applications on top, you can unleash your creativity and think of that.
the car as your third space and what experiences would you want in that way? Because is it theater
mode? Is it something else? Etc. And so that's where I hope the industry goes and I think
overall it will be just better for consumers. All right, that is all for today. If you did make
it this far, first of all, thank you. We put a lot of thought into each of these episodes, whether
it's guests, the calendar tetras, the cycles with our amazing editor Tommy until the music is just
right? So if you like what we've put together, consider dropping us a line at rate thispodcast.com
slash A16C. And let us know what your favorite episode is. It'll make my day, and I'm sure Tommy's
too. We'll catch you on the flip side.