The Data Stack Show - The PRQL: Is A/B Testing Only Relevant for B2C?

Episode Date: March 11, 2022

Eric and Kostas preview their upcoming conversation with Che Sharma of geteppo.com.

Welcome to the Data Sack Show prequel. We get to talk with lots of interesting people who have done groundbreaking work at large companies. Today, we're talking with another one of those. Che, who worked at Airbnb, was the fourth data scientist there and really built out their data science practice and experimentation framework. Fascinating. It was involved in some really instrumental technology and also knows the infrastructure side of the house as well, because he's had to build a lot of infrastructure. So Kostas, my question for you. So as a marketer, you know, I've done a lot and do a lot of A-B testing stuff. You're an engineer, but also a founder. Have you played around with A-B testing tools in the past and if so what was

your experience as an engineer using those tools yeah i did although i mean i don't think that i had the best experience with them probably because we're talking about like the previous generation of tools that's one thing and another thing is that i was working in B2B products. So one of the important parameters of a successful experiment is the population size that you have, right? Sure. Yeah. I never had the opportunity, let's say, to be exposed to such a large number of users that would justify doing that. And yeah, I'm still very, very interested in these tools and I'd love to have another tool to help me make decisions.

But to be honest, I haven't utilized them so far. So that's one of the things that I wanted to discuss with Jay and we discussed. Is it just a B2C? Yeah, it was a great conversation. Yeah. Is it something that we can use in B2B and how? And actually, he gave a very good suggestion and explanation of how these tools are used in B2B components.

At the end, you can use it in any case. But there are different reasons why you would do it. I'm not going to disclose what because we would like our audience. Of course, you have to listen to the episode to find that out. Yeah, I think that was a really interesting point. And then, you know, I think the other major thing that's going to be really interesting to listeners is a discussion of our favorite new buzzword, the modern data stack. But it is interesting because he's building a product that enables A-B testing on data in the warehouse.

And I am personally extremely bullish on this because it solves a huge amount of technical problems in implementing A-B testing as the current vendors have them. And in many ways, I think we'll sort of create a much better relationship between teams that need testing and data engineers who are trying to wire this stuff up because a lot of times the tools just create problems there. So if any of those topics interest you, tune into the next episode with Che and we'll dig in.