Semiconductor Insiders - Podcast EP366: How Cognichip is Changing Chip Design with Faraj Aalaei

Episode Date: September 16, 2026

Daniel is joined by the CEO of Cognichip, Faraj Aalaei, a successful visionary entrepreneur with over 40 years of distinguished experience in communications and networking technologies. As a leading e...ntrepreneur in Silicon Valley, he was responsible for building and leading two semiconductor companies through IPOs as a founder… Read More

Transcript
Discussion (0)
Starting point is 00:00:07 Hello, my name is Daniel Nenny, founder of Semaywiki, the Open Forum for Semiconductor Professionals. Welcome to the Semiconductor Insiders podcast series. My guest today is the CEO of Cognithip, Farage, Alahi, a successful visionary entrepreneur with over 40 years of distinguished experience in communications and networking technologies. As a leading entrepreneur in Silicon Valley, he was responsible for building and leading two semiconductor companies through IPOs as a founder and CEO. Welcome to the podcast, Farage.
Starting point is 00:00:39 Thank you. Glad to be here. It's great to speak with you. And I know we're going to be a meeting at a couple of conferences coming up. And it's a great opportunity to talk and get to know you a bit. Can we start with telling us how you ended up in the semiconductor industry in the first place? Very interesting question. So I didn't start in the semiconductor industry. I actually started as a designer of systems.
Starting point is 00:01:06 And I spent the first three, four years of my life designing circuits for satellite communication. Then I went to Bell Labs for 10 years and built systems that Bell Labs was putting into data centers of those times. They used to be called central offices and so on. In any case, when DSL came around to replace dial-up modems, that was my first entry. into thinking about building a chip company. So Centillium Communication was that company, where I came to it from a systems perspective and my co-founders were actually chip designers.
Starting point is 00:01:49 So that was my first entry back in 97. And the reason I decided to flip over to the chip side of this is because anything that was on the table in those days to go replace dial-up modems, which just actually not possible to build systems, because of the power consumption, the number of chips you needed, just the complexity of just serving one user was not possible. So the thought occurred to me that, hey, you know,
Starting point is 00:02:17 if we can do X, Y, and Z, we can reduce 32 chips that was being offered by large companies into two chips, and now you can actually deliver service at scale. So that was sort of like the motivation to come into the chip business back in 1997. and I never left. I'm still here in the chip business and in its industry that I love because a lot of magic happens when you're designing chips, right?
Starting point is 00:02:46 That's where the core IP is. That's where the possibilities come together. And so it's very exciting to be at always the leading edge of what comes next into the consumer's hand or into enterprises. So it's a great place to be and now it's even better because everybody's starting to pay attention to the chip company.
Starting point is 00:03:04 Yeah, I agree. Semawiki is 15 years old and the traffic of the last couple of years has just exploded. And, you know, the semiconductor industry is now front page news and it's quite an exciting time. But, you know, you've kind of done a pivot now. You know, you've taken two chip companies public and ran a billion dollar segment at Marvell. So tell us a little bit, what made you decide to start Cognit chip? Yeah, so after I left, I sold my company to Marvell and I left, I started to start a little bit. I started to take two or three years and actually make investments. And a lot of these investments were in software, ironically.
Starting point is 00:03:44 I would get calls from chip designers saying, hey, I have this chip in mind, you know, would you look at it? And the answer was no, I'm not going to invest in chip companies because it's the devil I know and I know it's damn too expensive. And as a seed investor, I was looking for software companies. And of course it became the age of AI. And I made investments in AI companies
Starting point is 00:04:08 and spending time with these AI scientists and entrepreneurs, I was learning enough about AI to be dangerous. And so, but that's when the light went on, is the light went on and saying, well, all the problems in these last two or three decades have been building these companies. What if AI could solve the problems? So fundamentally the problems,
Starting point is 00:04:32 as I perceive them, where it takes too long to build these chips, it's way too expensive. And just my own experience, when we built the first company, Centilium, we raised $50 million. When I took it public, we still had 17 of that 50 in the bank. The second company, Aquanchia, we raised $200 million as a private company,
Starting point is 00:04:56 and we took it public probably sooner than we should have because we didn't wanna raise any more money, from private, private markets. And today, as you can see, it's like hundreds of millions of dollars to go do chips. And so my motivation was, what if with AI we could collapse that time
Starting point is 00:05:15 and we could collapse the amount of capital you need, just like going back to essentially the days of when we started Centillion. Now you get entrepreneurs excited, you get the venture capital firms excited to fund these companies to some point of, fruition of their vision and then go from there. That is not possible today. Today, chip design is the venue for large companies
Starting point is 00:05:45 or entrepreneur, chip entrepreneurs who are actually building vertically integrated companies. They build a chip, they build a system, and sometimes they go off and actually offer the service as well to be able to afford to tape out those chips. So I came to this industry, I switched over to AI side to be able to help the industry I love, be able to reinvent itself and keep up pace with the software industry.
Starting point is 00:06:10 Yeah, I agree. You know, I've been in the semiconductor industry for 40 years and it, just personal observation I share with you is that, you know, chip development hasn't sped up the way software development has. And I mean, it's just cost too much to build chips and that limits the market of people that can build chips, right? So just a bottom line, I mean, is AI going to fix this? I believe so. I believe that if you fundamentally approach the problem, AI is the vehicle to
Starting point is 00:06:42 help us solve this problem. Now, AI is sort of like a broad term everybody throws around AI. Not all AI is made for all kinds of problems, right? So, you know, and you take the clues from, you know, looking at, for example, the pharmaceutical industry, the medical industry, a lot of times, when you're thinking about AI, you have to kind of think, all right, what problem is it trying to solve? And is it, is every AI system that's out there made to solve the problem you're trying to solve? And our answer to that from the beginning was no. We knew enough with my co-founders to understand that in order to solve a problem for semiconductor, you have to train these models to understand what chip design is because number one, it's very complex. And number two, at the end of the day, it's not like vibe coding. You know,
Starting point is 00:07:40 you can't be wrong in chip design. And these coding that you do for chip design eventually ends up being a transistor that sits next to 100 billion other transistors and how they interact and how the collection of the transistors you arrange have to solve a problem. Well, you know, large language models by and large do not understand that because there's been no data available for them to train on. So we took it on ourselves to go back to fundamentals and say, yes, AI can solve this problem. But in order to create that AI to be able to solve the problem, we have a lot of work to do. Got it.
Starting point is 00:08:20 So let's talk a little bit about cognitive chip and the product you call. ACI. So ACI is a physics-informed foundation model rather than an LLM applied to design. So what's the actual distinction and what is the model trained on? So it's a chip-specific frontier model, right? And as I mentioned before, it's built from ground up to help chip designers bring about their creativity, but move faster through the process without making mistakes. Okay. So a general purpose LLM is it's trained on pros. It reads text, it creates codes, some hardware examples. It's very good at sounding fluent in everything, but it does not understand chip design because it was never trained on the physics. And one of the reasons that
Starting point is 00:09:12 it wasn't, it's because there's not a lot of open source chip design examples out there for you, like it is in software. Like as you know, software has been around for a very long time in terms of a lot of open source data available. And so the models could train on that and be pretty good actually at creating code. But for chip design, those models aren't there. Those data sets are on there for models to train.
Starting point is 00:09:40 They don't understand timing constraint. They don't understand power budget. What are the trade-offs in area? And what is the judgment that when an engineer look at those, pray those, how does it make that judgment? What information does it need to make that judgment? Those things are just not built into LLN. So what you have to do is reduce this guessing,
Starting point is 00:10:02 which is expensive liability in our industry, if you're guessing about some kind of design. But then train a model on large curated and govern data sets using techniques at the frontier of synthetic data generation, reinforcement learning, noitry reward extraction. There's a lot of techniques in the AI world that has been used in some of the other physical industries,
Starting point is 00:10:30 I would call them physical industries because there's a physics at the end of the day that have been developed. And so take some of those learnings from those industries and bring them into semiconductor and apply them to our field and then create models that actually understand chip design. Oh, interesting.
Starting point is 00:10:48 So you've said, in-house silicon teams at Apple, Amazon, Google, or proof that the industry needs more specialized chips. If ACI works the way you intend, who gets to build the custom silicon that can't today? Yeah. So, you know, as I've said before in many forums, is that, you know, because of the expense associated with chip design, it's really now the land of very large chip companies, or very, very highly funded chip startups. But the need for this purpose chips is not limited to these large companies. And it actually stops innovation when chips can only be designed in a few large companies.
Starting point is 00:11:33 You know, so the workloads are getting more specialized. You got edge devices. You got energy constraint systems. You got a physical AI system like humanoid robots, autonomous vehicles, industrial automation. Who builds ships for them? Right. And so the challenge here is to figure out a design system where lower budget organizations who need specialized ships can also do this, can get into the act of creating their own barriers to entry, creating their own.
Starting point is 00:12:11 their own IP that is unique to them and it differentiates their product. Chips are the fundamental way you differentiate your product in the hardware world. So giving tools to these people so that let that imagination fly and not be constrained by the capital or the time needed to get to the market with those chips. So you're working with some of the top 20 chip makers. What are they actually using it for today? And what results have surprised you the most? Yeah, so these chip makers that were engaged with, their usage varies seriously by customers.
Starting point is 00:12:48 At least the initial usage is varying. And so the variation from my perspective is the best evidence that this is an infrastructure rather than a point solution. I tell my colleagues in the semi-industry that what you have to think about is what AI is going to do to your business three years from now. don't think just about the efficiency you get in the next six months. You got to be thinking about what does this world look like three years from now. And what this world looks like three years from now is to make sure that your organization is organized in a way where creativity and thinking and architectural definition is where your focus is, not the daily grind of getting into the process of working out the design. right so so that the work shifts to the front end the human intelligence gets focused more on the front end of the design process this lengthy design process because that's where market decisions
Starting point is 00:13:51 are made that's where your differentiation is built and let the AI systems get you through the process the rest of the way to a tape out yeah so you've raised 93 million you added lip-butan to board, who's one of my favorite semiconductor industry leaders. What's next for cognitivehip? Well, thank you so much for that question. Lipu is an asset to any organization. You know, this is my third company with Lipu. He's supported my adventures in this entrepreneurship world
Starting point is 00:14:29 for the third time in a row. And we've been successful the last couple of times. And hopefully this will be, there'll be even a bigger success. But, you know, ACI operates today, like a well-trained designer. But the aim for us is to reach beyond that capability. So that ACI can be better than any living chip designer. That's our goal. That's our ultimate, we're our North Star, where we're reaching.
Starting point is 00:14:57 The frontier ahead, though, is the physical AI. You know, every one of these robots and vehicles and automation system ultimately a physical AI model that runs on a physical chip. And most of these systems will need custom silicon rather than general purpose compute to perform in the real world. So now the challenge is, how do we get these physical AI devices to get to the market at the speed of software? So from the time you decide you want to do something
Starting point is 00:15:31 to the time that new model is running inside a humanoid, or the next update to your automation system, that time needs to be shrunk significantly. You cannot wait every five years for your human aid to be upgraded in this kind of world, right? So for us, how do we bring that speed to physical AI? How do we bring it to the edge of the network? And how do we make sure that you can actually
Starting point is 00:16:01 get through that transition as fast as possible? We're not built to be a feature. We're built to be an infrastructure for the next generation of hardware and how they get built. That's the way we look at ourselves, and that's what we're striving to become. Great. It's a pleasure to meet you. Great conversation. I'll see you at the AI InfraSummit next month, so we can talk a little bit more there. I'm very much looking forward to it. Thank you for having me. That concludes our podcast. Thank you all for listening, and have a great day.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.