The Data Stack Show - The PRQL: Data Warehouses on Steroids

Episode Date: August 26, 2022

In this bonus episode, Eric and Kostas preview their upcoming conversation with Kishore Gopalakrishna of StarTree.

Welcome to the Data Sack Show prequel. We just recorded a fascinating show with Kishore. He is one of the founders at StarTree and was one of the original creators of the Apache Pino project, which can do user-facing analytics at an unbelievably massive scale. He developed that at LinkedIn.

Costas, it was such an interesting episode. What really stuck out to you from our conversation with Kishore? I'm going to let you go first this time because I usually don't do that. I mean, okay, I really enjoyed the technical conversation that we had. Systems like Pinot have some very interesting, let's say, technical choices because they have to deliver, let's say, very fast results, but make sure that they can also support crazy concurrency. And it was super interesting for me to like to go through like the choices that they've made to achieve that. And also what the trade-offs are. It's like, you know, sometimes like you hear about, you say like, okay, we have like Snowflake, we have BigQuery out there. And so then you have like something like

Pin or like ClickHouse and you're like, okay, why not just use like these? They sound like, okay, data warehouse on steroids, right? Like why do we need both? And there's like a lot of noise out there. It's not always easy to understand the differences. And for me, it was extremely, extremely enlightening today to understand exactly what the differences are and why at the end we probably need both of them because they serve like different use cases and they make completely different trade bills. So yeah, that's, that's what I, I keep like from the conversation today.

And I'm really looking forward, like to talk with more vendors of this space and talk about how we build the systems. Yeah, absolutely. I agree. I think one of the other, one of the other things that was interesting was, you know, Pino is used by really large enterprises, a lot of them, upcoming episode with Kishore about Apache Pinot and StarTree, which is built on Pinot. And we will catch you on the next one.