Pony.ai’s Founder and CEO James Peng on What It Takes to Scale Robotaxis

When James Peng founded Pony.ai in 2016, many in Silicon Valley believed autonomous driving was only three to five years away. But he expected it would take at least a decade, because the challenge was never just teaching a car to drive. Commercialization also required regulatory approval, public trust, reliable fleet operations, and a cost structure that could support large-scale deployment. Ten years later, his vision is becoming reality.

In this conversation, we start with his founding journey, the milestones and how Pony.ai became a leader in the autonomous driving space. We also discuss the gap between assisted driving, Level 4 autonomy, and the longer-term goal of Level 5, as well as how Pony.ai uses simulation, real-world driving data, and increasingly capable AI models to improve safety. James explains that the hardest problems are often not the obvious ones but interpreting unpredictable human behavior and handling rare edge cases consistently.

The conversation also explores China’s cost advantage in robotaxis. A mature automotive and electronics supply chain, close collaboration with automakers, and faster iteration can materially lower vehicle and system costs. But moving into new markets still requires Pony.ai to adapt to different road conditions, regulations and driving cultures, from trams and roundabouts to local pickup behavior.

James’s broader point is that the industry has focused too heavily on the initial technological breakthrough. Getting a car to drive itself is only the beginning. The next phase is about deployment density, utilization, maintenance, charging, remote support, and economics. At the end of the conversation, I asked what he believes is underrated. James, an experienced operator, replied - scaling. Pony.ai may have crossed the zero-to-one threshold, but the harder task is scaling from one to ten, and eventually from ten to one hundred. Check out this insightful conversation.

For more interesting conversations with people who are charting the way of the future of AI, check out the podcast tab or follow us on Spotify!

Chapters

02:36 Why James Peng founded Pony.ai06:36 The milestone that proved robotaxis could work09:27 How passengers learned to trust driverless cars11:41 Level 2, Level 4 and Level 5 autonomy18:59 How AI and simulation improve self-driving24:13 Teaching cars to understand human behavior29:11 China’s cost advantage and global competition35:03 Expanding robotaxis into international markets41:13 Why Pony.ai is also building autonomous trucks48:40 Adapting to new cities, roads and driving cultures53:45 Why scaling is often harder than reaching zero to one

Transcript

Grace Shao: Hi everyone, welcome back to another episode of AI Proem Differentiated Understanding. This is your host, Grace Shao. Look where I am, the back seat of a car. Doesn’t look that exciting, does it? Let me flip this around. Look at that. There is no driver. I’m in the back seat of a Pony.ai robotaxi. Today joining me is James Peng, co-founder and CEO of the leading robotaxi company. It’s expanded its footprint across the globe, in Asia, in Europe, in the Middle East. But obviously, today we’re in its leading home market, China and Shenzhen, where it has a fleet of a couple hundred vehicles deployed on the streets already. Hi James, thank you so much for sitting down with me. I’m really excited to be having this conversation with you. So you left Baidu in 2016 to found Pony.ai when many in Silicon Valley were saying self-driving cars are only three years away. But obviously that wasn’t the case.

Grace Shao: So, what did you believe then that this consensus was getting wrong? Tell us about your journey from 2016 until now.

James Peng: Yeah, sure. We were founded in 2016, about 10 years ago. But even at that time, I didn’t believe that autonomous driving can be solved in three to five years. Just from a technical point of view, because even back then, 10 years ago, even a demo for autonomous driving was already very hard. Later on, there’s complexity involved in the autonomous driving industry that involves regulation, user acceptance, the readiness of the ecosystem. So because of the sheer complexity, even then, my prediction was it’s going to take at least a decade for this to be a real application. It turned out to be that my prediction was about right. Now, 10 years down the road, we actually have fully driverless commercial applications in many cities. Of course, it’s just the beginning of the long journey for autonomous driving. But at least now we have real commercial applications.

James Peng: So I think people, like any new industry, people were super optimistic for the short term, but they were underestimating the potential for the long term. So I think autonomous driving is definitely one of those industries.

Grace Shao: What really drove you to want to actually work on this, work on this technology and the future mobility?

James Peng: I think the motivation was twofold. One is that the potential, both commercially and also societal benefits for the autonomous driving is so huge. Think about like everyone needs to have some sort of mobility. Autonomous driving is much safer than a human driver. So it has huge societal benefit of saving people’s lives. So essentially, it’s just such a great industry to work on. Although back then, 10 years ago, it was very unclear when this can be done. The other reason is, of course, because the sheer technical challenge of autonomous driving involves because I was actually in my previous jobs. I worked on different areas, software, hardware, large scale distributing systems, AI and whatnot. But none of the things I worked on is as complex as autonomous driving, which is a field that involves hardware, software, hardware and software integration and Many other things. There’s AI, there’s real time system, there’s also large scale AI training and all that.

James Peng: So just from a sheer technical point of view, it’s such an amazing and challenging thing to work on. So I think those two reasons propelled me to start the company.

Grace Shao: There’s definitely a lot to unpack there. I think later on we can definitely double click on the hardware, software integration, as well as the safety concern there. You say that autonomous driving is much safer than humans. For sure, it’s safer than me driving. I know that. But some may argue otherwise. So let’s talk about that later. But first, I want to ask you about something that was quite interesting. During 2020-23, there was a bit of a public reckoning, I think, within the industry. A lot of peers folded during that time. People decided to pull out of this sector. Some people worried that autonomous driving would really become a reality. But you guys charged ahead and you really believed in your vision. Tell us about that period and how maybe that changed your vision or your growth mentality.

James Peng: I think 2020-23 was a period of time where the autonomous driving industry has evolved for roughly 10 years. I think that was the time of reckoning. That’s the time where the haves and have-nots have really diverged. So I think that’s actually exactly the time. As a company, we have seen tremendous progress. At the end of 2022, beginning of 2023, that was the time we actually finally had the first fully driverless commercial applications operations on the road. So because we made such progress, both from a technical and also from a regulatory point of view, that, of course, we made the progress. We finally see the glimpse of hope. Then, of course, we charge ahead. I think a lot of the other companies who weren’t able to, either from a technical point of view, or from a pure capital-raising point of view, or from a regulatory approval point of view, that weren’t able to have fully driverless applications. Then they were faded away.

James Peng: So it’s sort of like, well, everyone is in school. There’s no big difference. But after graduation, then there’s haves and…

Get full access to AI Proem at aiproem.substack.com/subscribe