Microarch Club - 111: Kay Li

Episode Date: May 8, 2024

Kay Li joins to talk about custom hardware used in high-frequency trading, development workflows for FPGA and ASIC design, and why verification has become a bottleneck in the design process. ...We also discuss SiLogy, the startup Kay founded with Paul Kim to improve the design workflow, including their experience applying to and going through YCombinator, their initial target market, and how the platform could evolve over time.Kay on LinkedIn: https://www.linkedin.com/in/kay-li-84924128b/Kay on Twitter: https://twitter.com/silikayliDetailed Show Notes: https://microarch.club/episodes/111

Transcript
Discussion (0)
Starting point is 00:00:00 Hey folks, Dan here. Today on the MicroArchClub podcast, I am joined by Kay Lee. Kay is the CEO of Syllogy, which is a Y Combinator-backed startup building a collaborative CICD platform for integrated circuit design verification. Kay has had an interesting journey to working on hardware and eventually founding a company. We begin in North Florida, where Kay grew up and fell in love with mathematics. This takes him to the University of Chicago, where in addition to math and computer science, Kay studied finance and was exposed to the local high-frequency trading industry. Kay offers a unique view into the use of specialized hardware in high-frequency trading and describes why FPGAs have become popular in the field.
Starting point is 00:00:41 However, despite their effectiveness in latency-sensitive operations, the development workflow for FPGAs has remained cumbersome and inefficient. Kay's own first-hand experience with this process led him to start Syllogy with his co-founder, Paul Kim. The latter part of our conversation focuses on Kay's vision for Syllogy and how the FPGA and ASIC development process can be improved by borrowing from the workflows we have come to expect in software development. We also walk through the process of applying to Y Combinator, discuss what it takes to start and run a company, and talk about how the rapid rise of AI workloads could lead to a rise in the number of chip companies. One of my favorite parts of hosting the MicroArch Club is having the opportunity to talk with both folks who have had a huge impact on the field of processor design and those who are in the earlier stages
Starting point is 00:01:28 of their journey to doing so. When talking to Kay about Sylogy, I can't help but wonder if 50 years from now someone will be hosting a podcast and talk about the company with the same reverence with which I refer to historical EDA companies like Daisy Systems and Mentor Graphics. Either way, Kay and team will be part of the story, and I'm excited that there are still folks like them interested in pushing the industry forward. With that, let's get into the conversation. All right. Hey, Kay. Thanks for joining today. Yeah, yeah. It's good to be here. Awesome. Well, I'm super glad to have you on the show.
Starting point is 00:02:14 I've had a number of different folks from different backgrounds on the show, both folks that have kind of worked in the industry many years ago and are now maybe retired or at the latter stages of their career. I've had a few folks who are working in startups today and kind of on the more modern side of the industry. And I think you certainly fall into that category. And one of the things I really like is kind of comparing and contrasting those different experiences. So I think we'll have a lot of fun maybe learning how you've been inspired from folks in the past and developments in the past, but also learning about maybe what the work you're doing today is going to bring to the
Starting point is 00:02:54 industry as well. Yeah, yeah. Sounds good. Awesome. Well, if you've listened to the show at all, you know that I like to start with getting kind of folks' background. And I'd love to learn kind of what your introduction to computing was and maybe kind of like how that shaped the path you went on, you know, starting in your childhood. Yeah, I mean, like I didn't have like an extremely intense like background with computing growing up. You know, like my parents always had like a computer growing up. And my dad actually did research on like numerical analysis. So I remember at one point when I was in like middle school or something, I asked like if you could help me like learn how to program. And then he showed me Fortran. And I think that kind of ended my exploration at that point for a
Starting point is 00:03:43 little bit. And so, yeah, I mean, like, I've always just like been like goofing around on the computers. You know, a lot of it was just like doing like HTML stuff, or just like, like web based things, like nothing too elaborate. And yeah, those were my early memories working with computers. Mostly, I was just focusing on doing math, and that's, like, what I went to college for. And, yeah, I kind of... Yeah, I kind of did, like, some of the computer programming stuff a little bit later on in college, yeah.
Starting point is 00:04:14 Gotcha. Do you remember what your first computer was or the first machine y'all had in your house? I don't... Oh, man. I think it had, like, an... You know, all I remember is, like, I think it had an Intel Pentium 3 processor. That's the one that I actually remember using with any regularity.
Starting point is 00:04:30 And I remember when processors started getting like above like one gigahertz and then like quickly above it. It was like my mind was blown at that point. Sure. Yeah. Yeah. I don't know. It was great. I mean, like things change like so quickly during those times. And I think that's, you know, I mean, that obviously propelled a lot of innovation
Starting point is 00:04:47 forward because, you know, you can just like wait a year or two and then like, you know, clock speeds would be like so much higher. I don't know. Like your processors would be like so much better. Right. And then, you know, I went from like floppy disk to like CDs to DVDs and like all that kind of stuff and like flash drives. I don't know. It was a really cool time. Yeah. Awesome. Was the kind of like education environment you were in, this is one of the things that's kind of come up on the show a few times.
Starting point is 00:05:13 Was there a emphasis on computer science or was that not something that was really expected to be studied in kind of your high school and middle school environments? Yeah, not at all. Yeah, I mean, my,, yeah, I mean my, yeah, so I, I grew up in Northwest Florida. Uh, I was kind of taught by like, you know, like riverboat gamblers and like itinerant preachers, like that kind of thing. So yeah, it wasn't like the, I mean, I had, I had a pretty good education, um, in some ways, but it definitely wasn't like a high tech. Uh, tech. Yeah, like a lot of that stuff,
Starting point is 00:05:47 I just had to like figure out on my own. Yeah. Gotcha. And you kind of gravitated to math there, you said. Well, how did that manifest in high school? Were you kind of like getting involved in math competitions and things like that? Or was it more of just like within school, that was your interest? Yeah, I did a ton ton of math competitions and i took a lot of like math classes at uh the university of west florida like after school hours so like uh it started in the summers like um you know uh starting in like fourth or fifth grade i would just like audit like some random math classes where my dad would let me and then uh eventually i started taking like more advanced math classes and my dad would let me and then uh eventually I started taking like more advanced math classes and uh that's just what I really liked and uh you know it's
Starting point is 00:06:29 very beautiful because like you can just do it with like a piece of paper and a pen and you know and like a book and so you can just like learn a lot and uh you know it's fun like just like flipping to the end of like a book to see like what I will have learned after a certain amount of time so right yeah I still like to do a certain amount of time. So, you know, I still like to do like math stuff every now and then, um, you know, not with any seriousness, but like, it's all something that like, you know, I hold dear within my heart. Absolutely. And you decided to, uh, go to university of Chicago, I believe, which is a great school. And, um, I think you studied math there. Was that kind of like a natural transition?
Starting point is 00:07:04 Obviously this is the thing you're interested in. YouChicago's, you know, good in that department. Was it just kind of a seamless transition into college? Well, yeah, I mean, I wouldn't call it seamless. I mean, I basically wanted to do math the entire way through. Yeah, I mean, math is like, I mean, it's very beautiful, but it's also like very difficult. And I learned fairly early on that I was never going to make it. I was like a mathematician. You know, I was just being outclassed by like, you know, a lot of my friends at the time. I took like a notoriously difficult math class and actually stuck through all three quarters of it.
Starting point is 00:07:39 We're on the quarter system. And, you know, yeah, but I basically realized that i wasn't going to cut it as like a math person so i had to like try to figure out like what else to do um and you know like uh that was a bit of like a ego disappointment or something but um you know the start the scars of which i carry to this day but you know uh yeah but it was good to figure that out sooner rather than later because i know a lot of people who um continue to do math and then we're just kind of like tortured by it for the rest of their lives. I've only been tortured by it for most of my life. Right. Fair enough. So when you kind of decided or realized perhaps that math was not kind of the professional path, at least purely math, right? Where did you kind of start to look
Starting point is 00:08:25 in terms of what kind of profession or what you might want to get into after you graduated? Yeah, so my dad's a professor. So he naturally wanted me to be a professor as well. And my sister like went to graduate school for accounting. She got a PhD in accounting from MIT. And so academia was like the obvious route. So then I kept taking math classes because like, you know, that usually impresses people. And I was going to try to do maybe economics, maybe like finance, like one of those things. Towards the end of my time, though, I kind of realized I really did not want to go into academia. And so that's how I got into finance, basically, is, you know, like what requires like a lot of math
Starting point is 00:09:05 and what could I, you know, like, I don't know. Yeah, it pays better than grad school. So I could try to figure that out for a little bit of time. I did take some computer science classes in college. You know, mostly, I mean, discrete math, which has math in the name. So that kind of barely counts. Algorithms, which was taught in the name. So that kind of barely counts.
Starting point is 00:09:29 Algorithms, which was taught by like Laszlo Babay, who's like this like great, like theoretical computer scientist who like invented, instead of turning it into like something where you like write depth first search and like Python or something, you turn it into something where you ended up doing like these like proofs related to like whether or not something's NP complete, like, you know, stuff like that.
Starting point is 00:09:44 So that was fun too. but then I did functional programming so you know um in Elm which was which was honestly a lot of fun yeah and uh yeah yeah but then I eventually worked my way over into finance gotcha and you know being in Chicago uh one of the previous guests I had on the show is Matt Godbolt, and he works in trading in Chicago. And I had a kind of a bit of a personal experience going to university in St. Louis and then going up to Chicago. I was kind of the computer science finance kind of track as well. Was it kind of like that was the natural thing to do to get into trading if you were going the finance route? Or was that something that came along after kind of deciding to study finance? Yeah, so I kind of continued studying like math and a little bit of computer science and like some economics, just like not really knowing what was like.
Starting point is 00:10:40 I didn't I was a very career like minded at this point um but yeah i remember like talking with like a corn trader who like you know would trade in the pits at like the cme uh even in like 2012 or 13 whenever i met this guy like it seemed kind of old-fashioned at the time uh and then yeah and then you know i just like knew yeah then it just like applied to a bunch of different places. Oh, a funny thing is that I took a class at the Booth School. It was called Market Design, I think, or Mechanism Design, and something about this. It was taught by this professor, Eric Budish, who wrote a very famous academic finance paper on finance like you know an academic finance like a paper
Starting point is 00:11:26 on high frequency trading the high frequency trading arms race okay uh you know trying to quantify like how much money is like kind of you know uh being accumulated to these like latency games and stuff uh and he and then this was also when flash boys came out roughly uh so i read i remember reading flash boys i remember taking this class but i think i took the wrong lessons from the class i you know i got a good grade but like i i took the wrong lessons and i decided that like hyper busy trainings actually it seemed really cool you know right um yeah was the was the class kind of trying to uh make a case against it not providing a lot of value to society or was it was it actually encouraging the uh like thinking it was interesting i think uh so the class was like
Starting point is 00:12:13 more broader focus there was like a lot of things in like this like um specific field of like uh mechanism design that were really interesting at the time uh but yeah i mean eric brutish's work i think tries to argue that um it's this like continuous time uh matching of like people uh it was like uh market participants was like inefficient and that like it could be solved if you just like had like batch auctions if you just like had auctions like basically every like 100 milliseconds or so because then like the lancy uh yeah edge that you get is like becomes lower so you don't have to like worry about competing on like nanoseconds right right that makes sense so you you get interested in uh high frequency trading um what was kind of the next steps from there how did you
Starting point is 00:13:03 how did that actually kind of like manifest in in what did next? Yeah, so I applied to like a lot of different companies. And then I eventually started working out like a really small trading shop in Chicago. It was like around like 12, 13 people at the time. So really more of like a startup type of environment than, you know, your citadels, your HRTs of the world right um you know i thought i didn't really know anything so it would be good to like get exposure to like you know or get a lot more um i don't know like attention or something so uh i started off as a quant and i realized pretty quickly that was a terrible quant because uh whenever i did you know one problem is that like uh one really bad feature for a quant or a trader to have is uh not losing is is really not enjoying losing money right so i really hated whenever i saw my strategy like lose like i don't know like a few thousand dollars or something like that i would like agonize over like the fact
Starting point is 00:14:03 um you know like whereas like the entire game is like a statistical one so you have to like take the ups and the downs like right so that wasn't so i didn't cut it very well as a quant but the good thing about working out like a small firm is that they can you know there's usually like a bunch of fires going off at like any given time so uh i did like programming and then you know i had learned like c++ and Python at this point. So then eventually I started doing more C++ stuff and then eventually I got into FPGAs because, you know, that was like the new hotness in hyper-music trading at the time. So that's like, yeah, that's how I got started with chips essentially.
Starting point is 00:14:39 Gotcha. And what year was this or what time period was this in? It's roughly like 2016. Okay. Okay. Yeah. People are still using FPGAs. People have been using FPGAs at that point in time, but like there's still like, you know, a small trading firm in Chicago could find like little latency games that they could win at. Yeah. Gotcha. And so even for like a small, you know, company, like you were working at that point, there's hardware specialization that's going on.
Starting point is 00:15:06 Is this pretty much like across the board if you're going to play in this game? Is having custom hardware or at least, you know, reconfigurable hardware in the case of FPGAs and running all your own servers, is that just kind of like table stakes to even participate? Yeah, I mean, if you want to be a participant on some of these latency games, definitely. I mean, it depends on like what type of like strategies you're trying to run.
Starting point is 00:15:30 But yeah, like custom hardware at this point is like table stakes. And you can go through like the major training companies and look at their job postings. Like they all have like needs for like FPGA or ASIC engineers. Right. And so had you had any exposure to FPGAs at this point or were you just kind of, you know, in this job or internship and, you know, kind of introduced to this magical new concept of reconfigurable hardware? experience with FPGAs before. University of Chicago is very famously a very theoretical place. So there's no like FPGA theory going around. So they don't really have
Starting point is 00:16:08 any of that happening at the time, as far as I know. I remember during Professor Budish's class, he would talk about hybrid Z-trading for a lecture or two. And one of the murmurings was about how, like some trade show, they were like like oh yeah there's like custom hardware that you can use to trade so you don't even have to go through like software at all uh and he was like wow that's crazy you know so um yeah that's all i knew but you know the good thing about working at a small company is that even if you're not like a subject matter expert on this thing you can uh people will give you time to just like, try to figure it out in order to, uh, yeah. Like, yeah. In order to just like, see what you can get done. I mean, there, there are negatives, which is that like, uh, you're not, you're just kind of on your own, like trying to figure things out. Right. Uh, you don't get like the best,
Starting point is 00:16:57 like instruction, but it is good. Cause like you get exposure at least. Yeah. Gotcha. And what were some of the first things that you uh you know configured in fpga to do like what was your kind of hello world uh for fpgas uh i mean one of them was just like a just like a faster feed so like um yeah like uh cmu famously has like this like really like huge like insane uh message format uh with a lot of information on them. But like, you really only need like a certain like parts of it. So in order to just like improve like throughput throughout your like trading system, you can just like, but read it quickly and then just like transfer like the important data to
Starting point is 00:17:38 the different parts, like much more efficiently. So that was one. And then there was just like a lot of like trigger-based trading, which is what, yeah, like just like a lot of like trigger based trading, which is what. Yeah, like we did a lot of that. So that's what actually started making the money. It was like, you know, there was like some event on one symbol and then like we could take we could trigger like a trade in another symbol or sometimes the same symbol. Yeah. Gotcha. And was that all happening in the fpga in the trigger base case or was that uh yeah it was yeah yeah yeah gotcha yeah there's no software interaction uh at all yeah gotcha and how often is the um kind of like reprogramming of these strategies taking place uh at the kind of like edge there with the fpgas yeah i mean uh reprogramming it yeah so
Starting point is 00:18:27 i guess like um you know you don't reprogram the image that often i would say usually what happens is that you have like a certain firmware image and you have like a software process that like is like kind of the buddy of it so that you know the software actually tells like the hardware you know if like this symbol ticks up by by three, then trade on this other symbol at this price or something. So it programs the triggers into the FPGA, and the FPGA will use a very simple logic to run through them in order to see what to trade. Gotcha. Gotcha. That makes sense. And were you writing most of your RTL in Verilog at that point? Or did you all have any alternative languages that you were using? Most of that was just straight Verilog. And I got into the verification side of it just
Starting point is 00:19:17 because I was writing a C++ test bench for PostSynth. So yeah, like, yeah, you know, basically after, like, we have a firmware image, like, we have to, like, test it with, like, some real data, but also some, like, fake data in order to make sure that, like, you know, when things don't go through, like, software at all, you have to be very careful with, like, the risk profile of that, right? So that's why verification is super important in trading. Because you can, you know, you can send orders very quickly, but that could also mean you could lose a lot of money really quickly. Great. Can you kind of talk through what verification looks like in FPGAs? Obviously, this is going to be relevant kind of later on in your path as well. But just kind of like from a first principles perspective, what is verification in FPGA or logic design in general? Yeah, I mean, verification is basically, does the chip do the thing that I expect it to do?
Starting point is 00:20:11 Like given like some higher order model of what the chip is supposed to be doing. So that could be a design document. It could be like a model that somebody writes in a different language, like Python or Scala or something. You know, but basically, you know, in a different language like Python or Scala or something. But basically, chips are highly complex, like parallel systems, right?
Starting point is 00:20:33 Like software engineers love complaining about like, oh, they had to debug this like multi-threaded, like yada, yada. But like every clock cycle, like a million things are happening on a chip. So you can imagine that it becomes like, the complexity of like trying to debug that is like very difficult. And also like whenever you, uh, program in FPGA, there's no, there aren't a lot of great ways to
Starting point is 00:20:50 just like see what's going on inside. You can't just like slap on GDB and like, uh, you know, uh, let it rip. Um, so you have to do a lot of stuff before like pre-synthesis. So, you know, and you know, you could have, so let's say you have like a chip for trading or something, right? There's a part that does like the parsing of the messages, right? That you get from like a certain exchange. It's in some format. You have to extract like the price and the size data from it, let's say, right? Then you have like another part that's like a trigger based part, which like takes the price and size of like a trade, let's say, and then compares it,
Starting point is 00:21:33 like it runs through like some stuff in memory to see like if it should fire, right? That's another part of the logic. And then it could maybe fire like multiple things at like a given time, it might have to queue up some messages, you know uh all that kind of stuff uh all these things are happening that logic is running every clock cycle so you have to be sure that you tackle like every edge case you have to make sure that there aren't any like crazy race conditions um because like you could you know
Starting point is 00:22:02 let's say you have like two ethernet ports right that are both receiving trade information you don't want like the you know and the message will messages can be replicated on like both ports right you want to fire on like the first one but you want to make sure that like if the second one comes in maybe even happens on the same clock cycle you're not like double firing or you know there are all sorts of like weird like edge cases that can come about. So that's kind of a simplified view of what FPGA verification is about. And you can get as, yeah, your test benches, which are these ways of just testing
Starting point is 00:22:39 different sub-components of the system. They could be really small. It could just be, there's a messaging protocol between two blocks on your chip, or it can be very complex. It's like an integration of multiple blocks working together to make sure that there's nothing that goes awry there. Yeah. And it takes an enormous amount of time and effort. And that's why there are FPGA verification engineers and ASIC verification engineers who spend their entire time grinding out tests, going through test cases, doing constrained randomization.
Starting point is 00:23:11 You're running through random seeds constantly because maybe if you get a size that's problematic or all sorts of things can happen or like all ones or all zeros or like some like weird pattern that happens, like maybe like the chip will behave in like a way that you don't expect. So you have to look through, you have to run a bunch of random seeds. You have to go through, see the test failures, see why they failed. And yeah, I mean, it's a, it's very, it's very onerous. Right. Yeah. Right. And there's kind of like a few different vectors of optimization, right, when you're working with FPGAs and that like there's, you know, correctness, of course, which is kind of what you're speaking to there. But then there's also, you know, your utilization of logic elements on the board, which is, you know, fundamentally physically constrained.
Starting point is 00:24:10 There's also cycle times, which, you know, you're going to, if you're doing more in that clock cycle, right, you're eventually going to start bumping that clock cycle out. Now, what's kind of the process for balancing those various constraints that you have? And did you run into that much in trading or were you all mostly using like pretty beefy FPGAs that could handle whatever logic you were throwing at it uh i mean we use pretty beefy fpgas but like uh yeah i mean mostly we're just trying to i mean most important is correctness right uh you know you want to make sure that like whatever you get out is correct you know there's huge risk involved and you want to make sure that things are like down pat um but you know latency is obviously super important so you have to tighten up like certain paths or you know like
Starting point is 00:24:50 make sure that if you're going to add pipelining it's like on a non-critical path um you know stuff like that and yeah um i don't know it does get pretty complicated but uh ultimately what's important is that like it actually works and um you know it fits like a certain latency profile and you can do all sorts of like little tricks in order to like try to fit things in um yeah like a in a certain clock cycle but uh yeah yeah but that that's kind of why at a certain point you need asics right like if if your latency if latency is important enough you start like getting into like actually taping out a chip um because you know FPGAs no matter like
Starting point is 00:25:31 how many tricks you can do right they'll never be as like fast as an ASIC right because you have to go through all this programmable you know all these lots and stuff so right right and so uh did you ever were you ever exposed to ASICs in the in the trading space or was that mostly just like y'all didn't get to that point? You weren't actually ever taping out chips. So when I was at Hudson River, well, you know, I'll say that I like Hudson River Trading and a number of other companies. They have like ASIC verification engineers and ASIC, um, like, uh, engineered like job postings. So taping out a chip in hyper-easy trading is like pretty common, I would say at this
Starting point is 00:26:14 point. Gotcha. Gotcha. Makes a lot of sense. So you were kind of at this, uh, this smaller trading shop, right? And then you eventually, uh, ended up after university going to, uh, Hudson river. Is that right? And then you eventually ended up after university going to Hudson River. Is that right? Yeah. What was that kind of decision like? Did you just want to have a larger experience or how'd you end up there? Yeah. I mean, things kind of were
Starting point is 00:26:36 working out that well. I like the company that I was with in Chicago. That was part of it. And the second part was just that I, you know, I've gone to school in Chicago. I lived there for a few years afterwards. I kind of wanted to try something different. So I was looking at a number of different jobs at the time. And, you know, HRT, like Hudson River Trading, has like a really good reputation. They had, I interviewed there, I really liked the people that I interviewed with and talking to, and they had a really nice office at the time. Well, they still have a really nice office. They had a really nice office.
Starting point is 00:27:09 And, yeah, I don't know. It kind of just, like, worked. It was an interesting work. They did a lot of stuff with, like, open source, you know, like tools for, like, chips, and I thought that was really cool. So it felt like a pretty natural pairing. Gotcha. I feel like the FPGA space is one that is, you know,
Starting point is 00:27:33 pretty much reliant on proprietary tooling. As you mentioned, there are some open source tools. And I think, you know, more and more, there is more open source tool chains. But fundamentally, a lot of times when you get down to the bitstream you have to rely on on proprietary tools what type of tools were you using in this environment and did you find them kind of like adequate or or better than adequate at the task you are trying to do yeah so at HRT they you know we used
Starting point is 00:28:04 a lot of Verilator and CocoaTB. So Verilator is like an open source simulator. Some people would disagree that it's actually a true simulator or whatnot, but that's neither here nor there. And then CocoaTB is like a Python library that's like simulator agnostic, where you can write test benches in Python. And yeah, they use a lot of both of those. And then there's actually a really good blog post written by my old boss, Todd Strader, on how we use those tools or how we verified hardware at HRT. And yeah, they were pretty good. I mean, for FPGA workloads especially, I thought they worked pretty well. But the only problem is that when you get to, like, larger designs, sometimes, like, the performance would drop off pretty drastically.
Starting point is 00:28:53 One part of it is just, like, the way that we wrote our test benches. Another way is just, like, when you're introducing Python into something, it's automatically going to slow down. And Verilator had some issues with scaling. Yeah, like it didn't really work, play very nicely with the larger designs. And it's very fast for like smaller designs. And you don't have to worry about licenses. And you can run a bunch of tests in parallel, which is like what made it very attractive. And you'd also like spec the code because it's open source, right? So you can inspect the code,
Starting point is 00:29:24 you can see, like, you can fix bugs, you can upstream them, that kind of thing. But towards the end of my time there, I worked pretty much entirely on like Verilator and CocoaDB issues, trying to make sure that we could run as many tests as fast as possible. Gotcha. And what's kind of the thing that would you mentioned that some folks would not consider Verilator a real simulator or a full simulator? What would be the distinguishing factor between it and maybe some of the proprietary options that are alternatives? So most simulators are event-based simulators. And so it does these... Some would argue that's kind of a hack in order to just get... Yeah, so certain things with delays don't work in Verilator. I think they're starting to change that. Certain language constructs aren't supported as well.
Starting point is 00:30:25 There's an issue also with encrypted IPs. So if you buy verification IPs from people, or if you buy IPs from a third-party vendor, they're not just going to give you the raw source code and stuff, so you have to have a way of simulating the design with the IP. And for that, Verilator just has no answer for it. So that's one big pain point that a lot of people have.
Starting point is 00:30:46 It's also not a four-state simulator. It's just a two-state simulator, just zeros and ones. You can catch a lot of bugs with Xs and Zs and whatnot. So yeah, I think there's some other stuff there that people don't like
Starting point is 00:31:03 about Verilator as well. It doesn't have mixed language support as far as I know. I think there's some other stuff there that people don't like about Verilator as well. It doesn't have mixed language support, as far as I know. I think it just only supports system Verilog and Verilog. No VHDL. Yeah, so I thought if you have a Verilog-only codebase, it's pretty great. And you have small enough designs, and you can work around some of those other issues. But yeah, for the most part, if you work at like a large chip company, people aren't doing everything in Verilator.
Starting point is 00:31:28 And even at HRT, we use proprietary simulators when we ran into some of those issues. Yeah. And so would you usually use Verilator as kind of like the, it's just pre-synthesis verification, right? And so would you, you do the variator verification and that would be kind of the uh improved development workflow and and that sort
Starting point is 00:31:51 of thing uh and be able to get quick iterations on that and then you go through synthesis and do post synthesis verification as well and was that with proprietary tools uh you know we have like our kind of own like lab testing environment that would do uh post-synthesis stuff um for the very later yeah like the the attractive feature of it was that you could run like a bunch of tests in parallel because you don't have to worry about uh like licenses right so we could spin out like you know each developer could spin out like tens or hundreds of thousands of tests like with the press of a button that was pretty nice um you know just like distribute it out to like hrt's like uh like a compute cluster and then get results back really quickly uh that was a really nice feature that you couldn't really
Starting point is 00:32:36 get if you just only did proprietary um simulator stuff but yeah like before we would ship an image we would have to run some stuff through a proprietary simulator, depending on what project people were working on. Sometimes you could just get by with the Verilator CocoaDB stuff because there's enough confidence in some of the other components or just enough confidence in the components of the testing that was already done. One of the things that you mentioned was the, uh, encrypted IP blocks. Uh, and, and, you know, for folks that are not familiar with, uh, FPGAs or ASICs or things like that, uh, it can be kind of surprising the way that I think IP works in these various scenarios. Like if you come from a software background, uh, you might be familiar with integrating, you know, open source libraries, source libraries or, in some cases, less commonly now, proprietary libraries.
Starting point is 00:33:29 But proprietary IP is extremely common in logic design. What kind of percentage of designs that you've worked on have been made up of proprietary or pre-built IP-built ip designs that y'all weren't actually developing yourself yeah i think yeah so i mean in the industry like uh selling ips is like a huge like profit driver for like a lot of different companies a lot of companies their entire business knowledge is like selling ips right um so uh yeah like that's just the standard in hardware. For HRT specifically, yeah, I mean, I can't really comment on the exact proportion of off-the-shelf IPs versus in-house, but wherever we saw an advantage to just build stuff in-house, we would try to do it, especially on latency things.
Starting point is 00:34:26 Things that are especially latency sensitive. And I think that's true for across the industry. You know, honestly, a lot of like the IPs that you can buy off the shelf, like the, you know, we, you know, we thought that we could do better on. So then we just like invested the manpower to do so. Yeah. Was there any consideration for like the debug ability of your designs? If y'all wrote things in-house versus took IP off the shelf, especially if it was an encrypted IP block? Or did y'all ever have cases where you suspected that there was, you know, an error in the IP block or you just couldn't figure out what was going on with it yeah i mean uh in like the times where reviews like yeah like uh off the
Starting point is 00:35:12 shelf ips like there were often times where like there would be like some strange error that would pop up and you just like had very little visibility to what was going on so that was like endlessly frustrating because you have to like contact the vendor, you have to like, like write some tickets, like stuff like that. So that's like another reason not to do it. Right. Yeah. Whereas like if it's all in house, you can just like look at it. Sure. It, did you kind of, were you in a role where you were actually deciding, you know, what vendor provided IP would be used? And if so, you know, it's a,
Starting point is 00:35:43 it's a pretty different process than just going on GitHub and finding a library that implements what you need. What's kind of the process for deciding, Oh, you know, we need this functionality. Uh, let's go look at a vendor for this IP and then actually acquiring it. Yeah. Honestly, that was like kind of above my pay grade. Um, I didn't really, yeah. Like, yeah,. I know that people were constantly in touch with various IP vendors and providers, but yeah, I didn't really have to do a lot of that myself, fortunately. Gotcha. Gotcha. So you were at Hudson River for about four years, is that right? Yeah, like four and a half years, I think. Gotcha. And after you'd been there for a while you decide that uh it's it's time to go do something else uh what was
Starting point is 00:36:30 kind of the process uh of deciding that and uh you know what did it look like kind of leaving hudson river and uh before we actually get into uh what you decided to go do when you were leaving uh did you already have an idea for for where you were headed i had a few ideas for where i was headed so uh i mean the process of leaving you know you know i put in my put in my notice um you know i was very sad to leave because like you know i have a lot i still have a lot of friends uh at hrt and you know it was a great place to work um i thought you know i wanted to explore new opportunities i I wanted to try some different types of work. I had a non-compete so I knew I had to wait that out a year. I was initially going to try joining another trading firm.
Starting point is 00:37:17 But I kind of took my sweet time to just study, like read a bunch, just like try to figure out like stuff that you know just like different industry trends like I thought that was like really interesting. I also took like a month or two to just like kind of like you know lay on my back for a bit you know because I was working pretty hard but you know yeah I was trying a lot of different things. And then eventually I decided to like, you know, the number of times we can actually do a startup are like pretty limited, I think. So I think it was something that I always had in the back of my mind that I wanted to try at some point. So that's I decided to just like go for it. Gotcha. Gotcha. So, uh, you know, maybe a lot of folks are not as familiar with the, uh, the non-compete status, but that's fairly common, uh, in finance. I think, I think that, uh, it may
Starting point is 00:38:13 be less common now. Cause I believe that non-competes were just recently, uh, uh, banned essentially, but some people are like trying to sue over that. Um, I don't, I, I don't know what it's like at HRT or Citadel or anything now, but yeah, they were super common. And yeah, I think they'll try to enforce them as much as they can. Right, right. And I guess kind of the logic there is you've had all these experiences, and also in trading, the specific strategies you're using
Starting point is 00:38:44 are obviously when it's essentially a race, really valuable, especially in like the short term. So, you know, you kind of understand why they would have that. Did that end up being, you know, you mentioned you did a number of different things during that period. Did having that non-compete actually kind of perhaps enable you to go and try out a couple different things since you had to wait that period out anyway? Yeah, I mean, you know, I think it did, honestly. I know that a lot of people think that non-competes, I mean, this is, I think, just one case in which, like, a non-compete was actually, like, good for me to try to, like, figure something out. Otherwise, like, I would have probably just, like, really tried to just, like figure something out. Otherwise, like I would have probably just like
Starting point is 00:39:25 really tried to just like jump into another job as like quickly as possible. Right. Yeah, yeah. I mean, the AI stuff was like a huge thing and like I actually worked on like an AI inference chip, you know, for like training applications. And yeah, it was really cool stuff
Starting point is 00:39:44 and like that was like pretty hot um yeah i mean i i always want to learn rust so i like did some like rust stuff but yeah i think it was good for me to just like spend a few months just like really thinking about like what i really wanted to do next um because like the natural thing like once you get into finance and like you know you're getting free dinners at nobu and stuff is just like keep like you know going to nobu but like uh yeah i don't know like give me some time to reflect right which is very useful yeah gotcha and uh so you eventually decide that you want to go and start a company did the decision to kind of go and start a company precede the idea or did you um obviously you'd spent a lot of time in this space
Starting point is 00:40:26 of working with the developer tooling around logic design uh was that something where you know you were you were just kind of um from the beginning passionate about improving that experience for other folks yeah i think i think they kind of went hand in hand i think the desire to start my own company was always like latent uh you know i would would always joke about like, you know, dumb startup ideas. Things that are too dumb to put out into public. But, you know, like, yeah. But, you know, one thing that like YC tells you is that you should like try to figure out like where your areas of expertise are and like start there. And I just remember that like the process of developing your own chip or just like
Starting point is 00:41:06 iterating on designs just like so painful and so annoying and you have like this entire we had our own like weird infrastructure that was like built up in order to try to like get around some of it and yeah then I just like started talking to other people I knew who were working in chips and they all basically said the same thing um yeah like every company has their own like weird cicd testing framework uh and you know no one really loves it uh but you know it's just good enough it gets the job done um so yeah that's kind of how i like came into the you know like those two things came together like you know natural entrepreneurial esprit let's say and uh uh yeah like this like um i don't know like domain knowledge and something i really wanted fixed like i'm working on like an
Starting point is 00:41:53 fpga project right now um you know to kind of dog food our product a little bit but also just like partly for fun um yeah and you know i'm like tearing my hair out uh like just like getting stuff running. It's pretty awful. And I want more people to just be able to pick up an FPGA and then just get started, just trying stuff out. It would be really cool. Absolutely. I can certainly identify with that. And I'm very grateful for FPGAs because I don't have any sort of formal education in hardware.
Starting point is 00:42:28 But my introduction to FPGAs is what kind of like opened the door to getting experience in it because there isn't really a parallel to being able to do hardware development and test out different designs, you know, from, in my case, my home office, right? And so, but I do see a lot of folks that maybe it's the huge, you know, Vivado or Quartus install that holds them back, or maybe it's going through and learning different terminology, or just like the sheer time that you have to wait for synthesis, especially in larger designs. Those things can all be, you know, massive barriers. So I like kind of the idea of both improving for industry, right? The folks that are already doing this, they already have pain points, but also as part of that kind of opening up the door to other folks.
Starting point is 00:43:22 And it sounds like, you know, you've done a number of kind of like solo projects or side projects where you've been doing your own designs. I'm curious if you think that like an individual is capable of doing like a meaningful chip design, or if you think the complexity has risen to a level where that's like not really a feasible mode of operation. I mean, I think as it stands right now now to be able to do like a really complex design is like pretty infeasible for an individual um even playing around with things it's like kind of annoying to do like uh people learn all sorts
Starting point is 00:43:55 of insane programming languages for like no observable like use right you can look at like project or their leaderboards or something right right? Right. But even the most arcane languages that you see on Project Euler have an easier setup time than an FPGA, which is used by hundreds of thousands of people, right? And which is sort of crazy to me. And my goal is that everybody should be able to like start making their custom hardware like on an fpga maybe to get started and eventually maybe like you know if they find something interesting enough to be able to tape it out uh and yeah i would love to write like some blog posts like have like educational material on how to get started because you know uh up until
Starting point is 00:44:43 recently there hasn't been like a lot of like good like literature on how to get started with like designing custom hardware even if it's like an fpga like maybe you want to prototype like a gpu on a fpga you know uh just for fun like it'll never be as performing as an a100 or like whatever but like it could just be a fun thing to get a better appreciation for what's going on right uh that's just like so annoying and painful to get started right now that people are just going to fall, you know, like people are going to see that it takes like, you know, like nine hours to install like Vavado
Starting point is 00:45:10 and like, you know, like, or like whatever, like, and they're just going to give up. For sure. So I want to circle back around to maybe how you've taken some steps to address some of the different parts of the development workflow and maybe some that you'll want in the future. But let's kind of rewind. You mentioned YC. You did go the Y Combinator route with starting your company. I'm curious. I've talked to a number
Starting point is 00:45:37 of different folks who have gone through Y Combinator. And there's some folks who come in and they basically have an idea and have done no work. There's some folks who come in and they basically have an idea and have done no work. There's some folks who have literally been building a business for a number of years and they're trying to scale it, essentially. What kind of category or did you fall somewhere in between those two extremes? I guess I would say I'm a little bit between the two extremes. We had a general idea of trying to make hardware development easier. We're trying to, like, that's a pretty wide front on which to tackle. So we're trying a number of different things, we're noodling on them for a bit. And then when we came to
Starting point is 00:46:20 Y Combinator, we kind of had settled on the idea of a web-based platform for chip developers to do design verification. Because design verification ultimately is where most people spend their time. It's just running the tests, checking results, debugging. That actually takes up most developer time. That's how you iterate. That's how you get those iteration cycles down, Pat. You do place and route a few times or something, mostly to check that things haven't gone horribly awry or something. But your day-to-day developer experience, which is, I'm very humanistic in this regard. I want those developers to have a really great experience. And there's no great... Yeah, I mean, there hasn't been a great off-the-shelf platform for that,
Starting point is 00:47:10 which is what we're trying to develop now. Absolutely. And as part of the process of starting this company, obviously you already mentioned you found a co-founder. What was the process like identifying a co-founder? And who is your co-founder? Okay, so my co-founder and who is your co-founder? Okay. So my co-founder is Paul. So he was most recently a backend engineer at Cloudflare and he actually did a lot of cool testing for Cloudflare. He architected this test framework
Starting point is 00:47:36 that helped them migrate a really important auth service. He was on the auth team and the service was securing millions of users. you know also super important and you know he's somebody that I knew like we were roommates in college like so I've known him for a very long time and you know all yeah like we just like talk to each other all the time like you know we've been to like like France and Japan China and Lebanon with each other we go on like vacations with each other so like naturally when we were talking about when I was like thinking of like doing startup stuff like um you know I was like talking with him about it and eventually you know it became kind of obvious to me like originally I was going to try to do do it like do it solo against
Starting point is 00:48:21 everybody's advice but then I was like no that's just crazy and uh you know i have you know like paul's great and he started getting interested in hardware as well because like it's like a really cool technology but uh you know it's funny because i take for granted how bad some things are but you know if you show like somebody who only has done like software uh what it's like to try to program an fGA. It's nice seeing it through fresh eyes. So you can be like, oh yeah, that is pretty horrible. Why is this license a gigabyte long? I don't know, stuff like that. Right, right.
Starting point is 00:48:53 And you're a fairly technical person and certainly have an engineering background. You're kind of stepping into a CEO role in the company. What was the decision like, you know, CEO versus CTO, which I believe Paul is the CTO. And do you really feel like at this point that there's a big distinction or is that more, is being CEO and being perhaps more like organizationally focused as y'all scale the company? Is that something that's kind of like a goal of yours? i mean right now like uh
Starting point is 00:49:26 paul just like handles like all almost all the coding and then i try to handle almost everything else like so everything related to like you know just like um things as mundane as like like figuring out workers comp and like getting us like health insurance uh to doing uh to more important things like sales like talking to customers like that kind of stuff you know I'm doing some work to like dog food the product a little bit right now so you know doing a little bit of coding here and there but yeah I think that like division it's like a pretty pretty good yeah and like right now it's like kind of like a dev tool IIy kind of like framework is like
Starting point is 00:50:06 how we're thinking of it. So it makes sense for Paul to take the reins of that a little bit more so than me. Like, you know, obviously like I have like a say, cause you know, like I have like a domain knowledge in this. Um, so like, uh, we, we talk a lot. Um, but yeah, yeah, no, absolutely. I think that makes a lot of sense. Obviously, both roles are super important. I'm curious, once you all decided to start this company, what was the process like for
Starting point is 00:50:35 applying to Y Combinator? And then once you got in, what was the following process like after that as well? Yeah, I mean, the Y Combinator application is very simple. Like you have to record like a one minute long video explaining like what your company does and your background. That's probably like the most difficult thing. I went through a lot of takes, but even that is like pretty straightforward. And then there's an interview. So I actually applied initially just solo, which there's no chance I was going to get in solo, I think.
Starting point is 00:51:15 And then when me and Paul were getting more serious about doing the startup, I was like, hey, you should add yourself to the Y Combinator application because it's good for you to think about some of these questions, see how I answered them. And so like, you know, yada yada. Like, you know, I thought it was like a good idea, like a little exercise. We didn't really expect to get an interview.
Starting point is 00:51:35 And then you get an interview. It's scheduled like very quickly. And then you get an answer like the next day. And the interview is like pretty, it's pretty basic. You just have to be able to explain what your company does, why you're doing it, like who you're making the product for, just like very simple things. And I think they really value clarity of thought.
Starting point is 00:51:59 And if you can kind of get those right, you know, like I'm not, you know, like you have a pretty good shot of like getting in. And then after we got our acceptance, like the next day I got a phone call from like Brad Flora, who's our YC group partner. We just hired pretty quickly to just take it. And I moved to San Francisco from January, like mid January to mid April. And, uh, yeah. And, uh, it was a really great experience.
Starting point is 00:52:29 Uh, I liked it a lot. Absolutely. And, and y'all are kind of, uh, recently out of the program. Uh, and at the end, you know, you, uh, you had your launch and everything like that. Um, uh, I saw y'all's post on hacker news, uh, and you know and there's a lot of great comments there and feedback. What was the process like of launching, and what was sort of the milestones that y'all wanted to get in place
Starting point is 00:52:52 before you went public with it? Yeah, I mean, yeah. One thing that YC really tells you to do is to launch as soon as possible. And part of the advice is that you should launch a product, even like if you aren't embarrassed by the product you launch then you waited too long like that's like classic advice so we just like set like a pretty high goal for ourselves to launch like in march uh you know worked on it for like basically like two months just like really crap like uh it was like a really big lift and um yeah i mean it was cool to like just
Starting point is 00:53:27 have that like date set you know you have to schedule it a little bit in advance um and uh we had to delay it once because uh you know i i had to like i don't know our website didn't look very good and i was feeling pretty embarrassed about that so like i had to get into framer and like start like moving widgets around. But yeah, like it was really cool to see. And then like that entire day, like when we launched, me, Paul and our founding engineer, James,
Starting point is 00:53:54 we just like sat in a room and then we just like, just cranked out like comments, like answering people's questions. And yeah, it was really cool. And we celebrated with like Brazilian barbecue. It was like a really fun time. Like, you know know i have very fond memories of that day absolutely well let's let's actually talk about what y'all are doing and uh what the name of your company is uh is syllogy the
Starting point is 00:54:17 uh correct pronunciation yeah it's syllogy it has the capital l in there which is very like 1990s core but like um i think i'm gonna have to downgrade that to, you know, uh, an L in minuscule, but, uh, yeah, I mean, I kept trying to figure out like a name, uh, for a very long time and, uh, yeah, you know, naming a startup is never easy, but like, uh, two like Two things like I just want to combine together We're just like the idea of that like we're doing things with like silicon and that there's a lot of logic that we're trying to Verify right so that's basically it. It's not very it's not very creative or sexy or anything But it is and I was it was important to be able to get like a dot IO at the very least right because You know most of those are taken up
Starting point is 00:55:04 You know, I thought about like, you know most of those are taken up um you know i thought about like you know i opened up like an ancient greek dictionary uh to try to figure out like good words that i could use there like i tried all sorts of like wacky things um but yeah that's just kind of the name we settled on and you know i think it flows off the tongue uh syllogy so um yeah i don't know yeah as as an engineer i'm'm a big fan of naming things what they are. So, you know, it passes my test for sure. But, you know, we've talked a little bit about some of the different parts of logic design. And y'all are really, at least initially, and, you know, maybe I can extrapolate a little bit to y'all wanting to own perhaps more of the development workflow.
Starting point is 00:55:47 But you're really focusing in on verification. And one of the things I noticed when doing some research on, you know, the problem space that y'all are trying to solve, in addition to, you know, my own experience with it, was on your Y Combinator page, there's the video from John from Asianometry, which I'm sure most listeners already watch this channel because it is absolutely wonderful. But John goes through and describes kind of like this verification gap. And I thought it was really interesting, the framing. And I'm curious kind of like how you all play into this. It was I think in 1997, there was this concern about that chip manufacturing, right, was progressing at such a rate and the development tools were not keeping up with it. And so like the productivity was lagging. So essentially, we'd be able to manufacture devices or silicon, right, that was more capable than we could actually produce with the tooling
Starting point is 00:56:53 that we had. And he goes into a number of different reasons for why that wasn't the case. But then, you know, verification comes in and becomes sort of the bottleneck in this process. And I'm curious if, you know, why, I guess, verification is the bottleneck there. And if that is the reason that y'all are kind of tackling that as perhaps the first part of improving the development workflow here. Yeah, I mean, I think so. I think verification has just been overlooked for like a number of reasons. I mean, a big part of it is that it wasn't... A lot of design verification work got outsourced to India and other lower-cost countries.
Starting point is 00:57:37 There's not... And it's also just not very sexy of a field. You can think of it as QA, right? Which is not to say that the work there very sexy of a field. It's sort of like, you can think of it as like QA, right? Like, you know, like, which is not to say that like the work there isn't like super important or like super interesting. It's just that for whatever reason, it was like not seen as like an important like field.
Starting point is 00:57:55 And if you were, you know, graduating with like an electrical engineering degree, then if you worked as like an architect, right, you would get paid like 50% more than if you got paid as a verification engineer so people in the United States like you know no one graduated like top of their class uh in electrical engineering and went to work as like verification engineers um and I think that for like cultural reasons it was kind of like not seen as like that important um yeah you know and I do think that like it is a huge bottleneck um because
Starting point is 00:58:28 people have just like not kept their eye on the ball um you know whenever it comes to i think custom silicon uh like the amount of custom silicon entering the market right now and uh it's like just like exploding and like people are really trying to like do creative new things with custom silicon and um yeah i mean part you know and what's like really grinding people down now is like just like this like verification gap like the productivity just like hasn't kept up and um i don't know the entire industry in general hasn't innovated that much recently because like i just think that you know also like there's like there's like a big gap of people there's kind of like a lost generation of people
Starting point is 00:59:10 who um stopped doing electrical engineering and you know i don't know like 2008 to like you know a few years ago maybe um because that's like software engineering uh you know like software engineering salaries like exploded right but hard you know like software engineering salaries like exploded right but hard you know like hardware engineering hasn't kept hasn't kept up um i think people at nvidia now are like uh pretty happy though but uh but yeah so you know there's all sorts of like weird like uh i don't know like economic macroeconomic reasons that like, it just hasn't kept up. And I think more and more people are starting to see that it's like a huge problem, right? I believe like Intel keeps like delaying certain like new chip architectures or whatever, because
Starting point is 00:59:56 basically because of verification, they keep like finding like little bugs that like get introduced and they can't, they have to like, you know, they have to just like, I don't know, bring a slightly newer version of like an old architecture. But yeah, and you know, I hear that like NVIDIA's like DV workflow is like very good. So that's like one reason why they've like done so well. So I think more and more people are going to start seeing as like a competitive advantage to have like a really great verification workflow um yeah i mean like startups like have like tons of verification engineers and you know it's like a huge overhead for them um and you know people want to be making new chips like it'd be you know it'd be really cool if like you know uh you know if you just have an idea for a chip, you could like spin it out like a few quarters or something.
Starting point is 01:00:46 Right, right. So in terms of, you know, like what is literally the bottleneck, I know y'all are focusing on, it seems like to me at least, kind of like collaboration features and then perhaps just like compute as well, right? Because y'all are hosting the compute in which the verification runs. Are those kind of the major aspects of what, what is causing the bottleneck right now? Are there other aspects of verification that y'all are tackling or want to tackle in the near future? Yeah. I mean, like in the immediate term, like we're focusing on like collaboration and like uh compute because like uh like a lot of times like in chip design like tests will like take like days to run like sometimes like you know
Starting point is 01:01:32 they're a week plus long tests and you know uh just getting those numbers down would be like pretty helpful i think but also collaboration is like still pretty primitive uh there's a lot of you know a lot of times like the state of the art involves like, like copying over a waveform to your coworker or taking screenshots or like sending a Microsoft Word document in an email. You know, it'd be better if like, you can just like tag people directly where like the issues are and be able to like debug like within, like be able to send links instead. So that's kind of like one of the big things that we're working to enable um and yeah in the future like i mean this is something that we're also actively working on this is just like helping people write test benches quicker uh you know
Starting point is 01:02:15 you should be able to go from like a spec of the chip to uh like just even like a list of like edge cases like really quickly um or like things to test for, things to make sure that you cover, whenever two things are integrated, it'd be cool to like just be able to like inspect like those two blocks and like see like potential interactions that could go awry. And you know, that'd be especially useful
Starting point is 01:02:39 because like a lot of times like these integration tests, like, you know, there's like two teams that work on like two different like blocks, right? And you need to integrate them. And each has their own domain knowledge of the block, but it's hard to transfer that information around. So that's also a collaboration thing as well. So yeah, I think there's a lot of low-hanging fruit, but also there's a lot of potential innovation that you could just have in terms of like improving people's like productivity. Yeah. How flexible are y'all in terms of tooling? I know you mentioned Verilator on your website. Is it mostly like a, you know, folks upload their RTL source and, you know, you run the Verilator on it and execute the test benches? Or is there, you know,
Starting point is 01:03:24 the ability for folks to bring their own tooling as well? Yeah, we support a lot of different tooling in addition to Verilator. Yeah, like we started off just with Verilator because that was what I was most familiar with. But, you know, like customers have just been like, oh, yeah, we need to like use like some proprietary simulators as well. So we do have like some support for a number of those. Yeah. And the way that it works is basically you connect, it's like a GitHub app that you just connect your project to it. And then we have a web UI so that you can, that'll just, and our service will just run the test periodically. It'll be able to inspect a YAML file that where you'll be able to like
Starting point is 01:04:05 tell it how to like build the test binary and then run it. And then we just like collect all the information and like put it in like a really nice like format for you. Yeah. Absolutely. So do you see it kind of being like fitting into additional, perhaps like GitHub actions flows that folks would run and what, what are kind of some things that y'all could do that that someone could not do um in like maybe github actions or other ci tooling
Starting point is 01:04:31 you know that's just like essentially raw compute i mean what we're building is really like a chip developer focused workflow so like basically we're trying to like make sure that chip developers can run as many tests as fast as possible and like just like you know like it'll run them continuously over a lot of like different seeds and stuff not just like on like a git push but also just like periodically and uh like reporting features and um like a chip developer focus like workflow like things like waveforms uh rerunning failing tests um yeah um you know a lot of these things that like people normally to, either doesn't exist at their firms or their companies, or they would have to roll out themselves with a DevOps team that has to connect a bunch of tooling together.
Starting point is 01:05:15 Yeah, we're trying to make it a very simple chip developer focus workflow. And ideally it'll be something, they just, the first thing they do when they get to work, maybe after emails, open up our tool and see what issues flowed in, see test results, see what failed and see people's comments and help with debugging. Right. You mentioned that some larger companies may have kind of like already rolled their own systems for this. Do you feel like, I guess, a two-part question, do you feel like that, you know,
Starting point is 01:05:55 y'all are starting out targeting more like midsize or smaller companies, maybe other startups? And do you feel like some of the more accessibility of fabbing chips, you know, it's becoming more and more accessible to folks? Do you feel like you're kind of, you know, picks and shovels, as they say, for that kind of movement as well? Yeah, definitely. I think that a lot of, I mean, we've gotten a lot of traction from startups, especially because, you know, this is tooling that they would have to build out themselves at some point anyways, right?
Starting point is 01:06:27 So then they could just get onboarded with us and, like, we can help them out, like, you know, day zero. So, yeah, like, and I think that there's a lot more opportunity for people to be building their own chips. And there's, in fact, a lot of open source stuff coming out. There's Tiny Tape Out stuff. There's also open source PDKs, which would be cool to integrate with our product at some point. So I think I just went to a... Me and our founding engineer, we went to the Fossey Latch Up, the open source silicon conference. Free open source silicon. Which is really
Starting point is 01:07:05 cool to see like the kind of projects like people are starting to work on so i think more and more people are getting interested in like open source uh silicon but also like custom silicon and uh yeah like i would like to be part of that story that like more people are getting into like making their own chips like i think that'd be super cool absolutely well if you know folks are are able to reduce some of the overhead of verification in their design process by you know using a tool like like y'all's um there's also you know subsequent parts of that synthesis placing route right we've mentioned a couple of these um are y'all interested like it seems like right now the verification flow would be, you know, improved
Starting point is 01:07:48 quite a bit, especially if you're collaborating with other folks by, you know, using Zillogy or something like it. Um, but ultimately then you still have to have the proprietary tooling or, or perhaps maybe some of the open source tooling if applicable. Um, and you know, that there's still a fair amount of overhead in there. Are you all interested in kind of like chipping away at that part of the stack? And are there unique challenges with tackling that as opposed to verification? Yeah, I mean, it would be really cool to be able to like, you know, be kind of like this thing that like glues together all of these like different tools and different parts of
Starting point is 01:08:23 like the, you know the process of developing chips. I think my pie in the sky vision is that once you, in our app, you should be able to have a flow that once everything's done, you can click Add to Cart and send your design to TSMC. I think that'd be great. In terms of developing our own tools like uh you know you know there there would be like challenges for that um you know there's a lot of really great tooling out there that exists and a lot of great open source stuff um so yeah uh yeah i don't want to like uh
Starting point is 01:08:59 you know um like make any really strong predictions like this early but you know i'm like a yeah i'm very happy about like uh like the you know potential avenues for future growth sure right uh you know another thing that i've kind of observed with folks who get into the fpga design flow or asic design flow is this desire to maybe like create alternative tools as well. So like there's one, there's one you know, mode of operation where you could go about automating the operation or, you know, let's say like hosting tools and that sort of thing. Then you could also go down a path of, you know, potentially pursuing developing your own kind of like synthesis and that sort of thing. We already touched on why that can be challenging when you're targeting you know proprietary bit streams and that sort of
Starting point is 01:09:49 thing uh but are you all interested in you know potentially working in the uh you know like more modern hdl space or some of the the synthesis process uh for chips yeah definitely i mean like uh i think we're you know we'll we'll try to like skate to wherever the puck's going but like uh there's a lot of like different avenues that people are like interested in like uh uh yeah like a lot of cool like um like higher level synthesis stuff like it's like super cool to me and uh it would be great to like be able to like have a way of supporting those like very native like very easily and um yeah and uh yeah i mean i'm very excited about like the the um where like things are going uh in the space so yeah i don't know uh is another thing that kind of uh feels like an obvious path or something that you know i personally would like to see in in my own
Starting point is 01:10:41 kind of development uh we talked about some of the IP blocks and that sort of thing. You know, and obviously there are some barriers, just like some of the barriers you all ran into at Hudson River or at any of your stops where you had, you know, encrypted IP blocks and trying to use those with open source tooling. There's similar sorts of barriers that you could run into with trying to use a product like Sylogy. But one of the things that comes to mind is like, if folks are developing in Sylogy and, you know, verifying IP blocks and that sort of thing, there's also sort of like a unique marketplace, perhaps perspective there where IP blocks could become more accessible. You could get,
Starting point is 01:11:23 you know, more verifiable properties about them and that sort of thing. Is that something that you could see going after or something you're interested in? Yeah, definitely. I mean, I think it would be really cool if there were a really easy way for people to develop their own IPs
Starting point is 01:11:36 and then maybe just upload them, either open or closed source, to our platform. And then you can be able to buy or download them, license them. Yeah, I think that would be super cool. I mean, one of my ideas, it's somewhat of a joke for the future, is that maybe we run a promotion for Zillogy, which is that if you sign up for two years or something,
Starting point is 01:12:00 then we'll throw in a free PCIe core for you. Right. Yeah, something like that. And it depends on what people are looking for. Hopefully there's a lot more open source, like, silicon interests and people will start open sourcing their IPs. And then maybe we can have a leaderboard for, I don't know, like, fastest PCIe core with the least amount of logic utilization, like yada, yada. Like, I think that'd be super cool. Um, you know,
Starting point is 01:12:28 we have to see whether or not, uh, there's space for that in the market, but, um, yeah, I, I would love that personally. Cause I, I hate having to like, I was like, Oh man, I gotta have to write my own like driver for this or something. And, um, you know, or like, yeah, like it really does bog bog people down like when they can't do like very simple things like quickly uh and i think that is like a huge barrier to entry for a lot of people learning about uh custom hardware absolutely absolutely well cool well thanks for uh kind of walking through some of your product there if folks are interested in in trying out syllogy
Starting point is 01:13:01 how can you go about doing that today oh yeah uh yeah. What they can do is like so they could go to our website, Sylogy.io. If you there's like a log in button on the top right. And you can create a free account just to like try it out. You can even create like an anonymized account if you really want to. But if you're interested in like maybe a more full fledged tour, that's like a very basic version that you can like run some tests on like a very simple verilator hello world but if you want to look at like some of the more like enterprisey like versions of it just click book a demo it will just be like me and paul like we'll walk you through some stuff or yeah just like shoot me an email i this is dangerous
Starting point is 01:13:40 but like you can just email me at like k like k-a at syllogy.io. So, um, yeah, I, I'm a compulsive email checker. So like, uh, yeah, like, uh, if people are like genuinely interested and want to talk about it, like, you know, uh, I'll, I'll find time. Awesome. Awesome. Well, I'm sure folks would definitely appreciate that. Um, you know, one of the things I kind of wanted to wrap up with our chat today is obviously there's a lot of changes happening in the semiconductor industry right now, both on like the manufacturing side, but also in the workloads. And, you know, you mentioned working yourself on kind of like an AI inference chip in some of your free time.
Starting point is 01:14:28 I've talked to a few folks both on the podcast and off of it about how these different training and inference workloads are changing the microarchitecture of some of these chips that are being produced. And, you know, that can always lead to different types of innovation, as well as potentially empower some more like upstart companies to make some progress against the behemoths of the industry. I'm curious, just, you know, as someone who's in the space, right, has experience in it is, you know, potentially going to partner with or sell the customers in that space as well. What kind of your interpretation of the industry is today? And if you see any kind of like major trends that you find interesting. Yeah, I mean, I think that in terms of like major trends or like things that I find interesting. Yeah, I mean, more custom silicon just like being pushed to the edge, like just like niche forms of compute, like, you know, like in like satellites or with like cryptocurrency mining
Starting point is 01:15:28 or just like on your phone, like low power things there, robotics. I mean, there's like so much like interesting work being done with open or with custom silicon right now and custom hardware like that. I think it's like super cool. I think a really important thing that people should be aware of though, is that like this, like the software operability like software hardware like compatibility is like super important and that's kind of like one of the big reasons why NVIDIA has like the you know stranglehold that it does right is that like like CUDA is actually like you know hugely important and yeah I think that and one thing that we are trying to enable is a better way for people to do this
Starting point is 01:16:07 software, hardware co-design, that kind of thing. Yeah, I don't know. I think it's super interesting. I think the new types of chips that are coming out that people are coming to us with ideas about are super impressive and interesting.
Starting point is 01:16:24 And I'm glad to see like different companies like try chips um and um yeah i think uh yeah we're only going to see like more and more of it and hopefully uh in the near future you know we might move back to a future where there are suddenly a lot more electrical engineers out there, like chip designers and people who normally would have just default gone to a bang job or a software engineering role start getting interested in hardware again. And actually, a lot of the people I talked to who are software engineers, they actually did take a CPUs class or something, and they actually did take like, you know, like a CPU class or something,
Starting point is 01:17:05 and they really liked the hardware, but like, you know, some of these like issues were just like, you know, beating them down. So they just went for the easier route instead. Sure, sure. Right. Well, I think that's a pretty insightful take. And, you know, I'm, I'm envious in some ways of your position, and that I'm sure you'll get kind of a front row seat to the way things are going and you know, how folks are using tooling to get there. But I think that, you know, we covered quite a bit today. Kay, I definitely appreciate you being willing to jump on here, especially so soon after y'all launched. And I'd love to have you back on again in the future and kind of like do a progress check in on where y'all are at after, you know, some period of time here. Yeah. Thanks for having me on. It was like a very fun
Starting point is 01:17:49 conversation. You know, hopefully I didn't violate any like non-disclosure agreements. And yeah, I mean, I hope all the folks sitting at home had a good time listening. So yeah, I would love to come back on um you know uh yeah absolutely well uh okay have a great week and uh we'll talk soon all right thank you

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.