The Good Tech Companies - Escaping AWS S3: How One Cybersecurity Firm Cut Costs With AIStor

Episode Date: November 26, 2025

This story was originally published on HackerNoon at: https://hackernoon.com/escaping-aws-s3-how-one-cybersecurity-firm-cut-costs-with-aistor. A cybersecurity company sl...ashed cloud costs and boosted performance by moving from AWS S3 to MinIO AIStor, gaining speed, resiliency, & scalable on-prem control Check more stories related to cloud at: https://hackernoon.com/c/cloud. You can also check exclusive content about #cloud-repatriation, #minio-aistor, #aws-s3-costs, #cybersecurity-data-storage, #s3-compatible-object-storage, #on-prem-private-cloud, #erasure-coding-resilience, #good-company, and more. This story was written by: @minio. Learn more about this writer by checking @minio's about page, and for more stories, please visit hackernoon.com. A cloud-native cybersecurity company hit a cost and performance wall on AWS S3 as its log data grew to exabyte scale. By repatriating workloads to MinIO AIStor, they gained S3 compatibility, massive performance boosts, resilience via erasure coding, and full cost control. The shift enabled scalable, high-speed, on-prem operations while reducing unpredictable cloud bills.

Transcript
Discussion (0)
Starting point is 00:00:00 This audio is presented by Hacker Noon, where anyone can learn anything about any technology. Escaping a WSS3, how one cybersecurity firm cut costs with AI Store by Minio. In a story that is not uncommon among SaaS companies, a cloud-native cybersecurity organization was faced with massively escalated cloud costs as its log data expanded to multi-exabytes. Storage costs aside, the cost to simply operate on this data became astronomical. This organization was hit from both sides at the same time because storage costs were only one part of the problem. Their cloud storage provider, Amazon's S3, simply did not have the performance required to handle the log operations they required over this volume of data.
Starting point is 00:00:43 This cybersecurity firm would continue to sell its managed service on AWS, but it had to move its internal workloads off the public cloud. This is where an on-prem architecture with Minio's AI store stepped in to Solveith of their problems simultaneously. cost and performance. Challenge, their concerns were multifaceted. They had to make sure that they had no outages before, during, and after they transferred their log data. Any loss of data or downtime would cost them customers and reputation. A WS's pricing structure is responsible for the economic side of their difficulty. Generally speaking, while S3 compatible storage cost scale with the volume of data, additional charges accumulate from egress, transfers out of a WS,
Starting point is 00:01:26 retrieval fees from speciality storage classes and encryption. More specifically for this cybersecurity company, the cost of gets and puts as they operated over their log data in the public cloud had become intolerable. Anytime this cybersecurity firm wanted to do anything with their own data, it resulted in a new charge. These fees only compounded as their volume of data increased. Finally, they needed an S3 compatible object store they could implement and manage on their own. They already had an interlocking data architecture that depended on the S3 API. Any solution to their difficulties had to drop into their existing stack and work with everything they had. The S3 API is an integral part of the modern data stack, almost every piece of the software
Starting point is 00:02:09 that anyone uses anywhere accommodates the S3 API in some way or another. This ISP articularily true of this cybersecurity company, whose entire architecture depended on the S3 API. Solution. Adopting Minio AI Store. After assessing their challenges in researching potential solutions, they realized that only AI Store was able to address their requirements. Ister's object storage provided them with S3 compatibility, allowing the cybersecurity company to migrate without disruption to their operations. High performance. They required faster retrieval times to support their security analytics and incident response workflows. AI Store, with read speeds of up to 2, 6 terabits per second, 325 gibbytes per second and write speeds of up to 1.32 terabits per second, 165 gibbytes per second
Starting point is 00:03:02 in a 32 node cluster configuration was a natural choice. Availability and resiliency. Erasure coding is a core component of AI store and provides resilience during drive or node level failure events, ensuring continuous uptime for their security operations. Best in class support. Being Being able to leverage the panic button and interact directly with engineers for critical issues became an urgent need as the cybersecurity company continued to scale. Implementation and architecture, this security log data was ingested via a third party as well as a homegrown log management tool which used AI store as an S3 compatible storage backend. For analytics and security event processing, they leverage a mix of real time streaming
Starting point is 00:03:45 and batch processing frameworks, ensuring rapid incident detection and response. Additionally, their infrastructure is designed to support high-speed networking, utilizing NVMI storage and 100 GBE networking to handle the demands of their security operations efficiently. According to Arvind Gupta, head of customer engineering at AI Store, given Thathier a security company, the data durability and availability is of prime importance. That means they need to ensure the data written to AI store object store is never lost. Any data loss is business critical for them, and so is A store. For most of the organizations, durability and availability of data is the greatest concern.
Starting point is 00:04:25 Minio provides durability with erasure coding across nodes and drives. High availability can be achieved with multi-site deployment across different availability zones and regions. The cybersecurity company found that they could use their existing DevOps and IT personnel for the migration. Their experience in cloud technologies was easily transferable to AI Store. This is part of a broader effort of AI Store to perfectly align with S3 API, which includes aligning on error messages. This means the cybersecurity company was able to
Starting point is 00:04:56 configure and deploy AI store on its own. Of course, AISTER was able to help with the planning process and advise on hardware, but the heavy lifting of this migration fell to the cybersecurity company's own team, which was able to manage it without much difficulty. AISTER runs on commodity hardware, which means this cybersecurity company wascible to use an easily accessible and reliable collocation service for its implementation. There was no need to source, maintain, or train for specialized equipment. They are able to swap out hardware as their needs adapt, and because they aren't tied to any specific vendor, they can negotiate the best prices for their hardware as they add and replace. Proving again that owning your own data can be
Starting point is 00:05:37 cost effective on multiple levels. Related. Object storage erasure coding versus block storage rate dealing with something similar? Figuring out what to do with log or unstructured data is not a unique problem to cybersecurity. Many organizations struggle with either the large volume of log data under management or how long to keep it. Using a managed service for both storage and the curation of logs can be prohibitively expensive. Disaggregating this approach and using AI store for log data can be incredibly cost effective. Osset was for this cybersecurity company. Returning to the topic of public cloud costs, skyrocketing and unpredictable cloud bills are certainly not unheard of. The question becomes, when do these expenses no longer
Starting point is 00:06:20 make sense for an organization? There is a tipping point where the volume of log data, or any data for that matter, builds to the point where it no longer makes economic sense to store data in the public cloud. Beyond this tipping point, it makes sense to move the data and workload to a non-premises private cloud. Organizations reach that threshold much faster when they need to move large amounts of hot data are due to tiering, API calls, replication, encryption, and similar processes. Great for bursty, experimental and cyclical workloads, the cloud will always have a place in our architectures. But more and more organizations like this cybersecurity firm are coming to understand the cloud as an operating model, note a specific vendor. In other words, their stack
Starting point is 00:07:04 can be optimized for the cloud without having to be in it. Growing footprint, the cybersecurity company continues to grow its AI store footprint to support the growing data demands around various new initiatives. Since repatriating from a W. Stowe and on-prem private cloud powered by Minio AI store, the cybersecurity company has been consistently expanding its existing cluster and adding more and more clusters. Gupta explained that this footprint is expanding to even more workloads. They're exploring new use cases and avenues to start using Minio for all the data needs. The cybersecurity companies transition from a WS to AI store exemplifies the power of cloud repatriation in reducing costs and improving performance. By leveraging Minio Ister's
Starting point is 00:07:47 high performance S3 compatible object storage, they have create a scalable, performant, and cost-effective infrastructure to support their operations. If you're interested in doing the same, please reach out to USAT hello admin. I.O. We're on our Slack. Thank you for listening to this Hackernoon story, read by artificial intelligence. Visit hackernoon.com to read, write, learn and publish.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.