The Good Tech Companies - Escaping AWS S3: How One Cybersecurity Firm Cut Costs With AIStor
Episode Date: November 26, 2025This story was originally published on HackerNoon at: https://hackernoon.com/escaping-aws-s3-how-one-cybersecurity-firm-cut-costs-with-aistor. A cybersecurity company sl...ashed cloud costs and boosted performance by moving from AWS S3 to MinIO AIStor, gaining speed, resiliency, & scalable on-prem control Check more stories related to cloud at: https://hackernoon.com/c/cloud. You can also check exclusive content about #cloud-repatriation, #minio-aistor, #aws-s3-costs, #cybersecurity-data-storage, #s3-compatible-object-storage, #on-prem-private-cloud, #erasure-coding-resilience, #good-company, and more. This story was written by: @minio. Learn more about this writer by checking @minio's about page, and for more stories, please visit hackernoon.com. A cloud-native cybersecurity company hit a cost and performance wall on AWS S3 as its log data grew to exabyte scale. By repatriating workloads to MinIO AIStor, they gained S3 compatibility, massive performance boosts, resilience via erasure coding, and full cost control. The shift enabled scalable, high-speed, on-prem operations while reducing unpredictable cloud bills.
Transcript
Discussion (0)
This audio is presented by Hacker Noon, where anyone can learn anything about any technology.
Escaping a WSS3, how one cybersecurity firm cut costs with AI Store by Minio.
In a story that is not uncommon among SaaS companies, a cloud-native cybersecurity organization was
faced with massively escalated cloud costs as its log data expanded to multi-exabytes.
Storage costs aside, the cost to simply operate on this data became astronomical.
This organization was hit from both sides at the same time because storage costs were only
one part of the problem. Their cloud storage provider, Amazon's S3, simply did not have the
performance required to handle the log operations they required over this volume of data.
This cybersecurity firm would continue to sell its managed service on AWS, but it had to move
its internal workloads off the public cloud. This is where an on-prem architecture with
Minio's AI store stepped in to Solveith of their problems simultaneously.
cost and performance. Challenge, their concerns were multifaceted. They had to make sure that they had
no outages before, during, and after they transferred their log data. Any loss of data or downtime
would cost them customers and reputation. A WS's pricing structure is responsible for the
economic side of their difficulty. Generally speaking, while S3 compatible storage cost scale
with the volume of data, additional charges accumulate from egress, transfers out of a WS,
retrieval fees from speciality storage classes and encryption. More specifically for this cybersecurity
company, the cost of gets and puts as they operated over their log data in the public cloud
had become intolerable. Anytime this cybersecurity firm wanted to do anything with their own data,
it resulted in a new charge. These fees only compounded as their volume of data increased.
Finally, they needed an S3 compatible object store they could implement and manage on their own.
They already had an interlocking data architecture that depended on the S3 API.
Any solution to their difficulties had to drop into their existing stack and work with everything they
had. The S3 API is an integral part of the modern data stack, almost every piece of the software
that anyone uses anywhere accommodates the S3 API in some way or another. This ISP articularily true of
this cybersecurity company, whose entire architecture depended on the S3 API. Solution. Adopting
Minio AI Store. After assessing their challenges in researching potential solutions, they realized
that only AI Store was able to address their requirements. Ister's object storage provided them
with S3 compatibility, allowing the cybersecurity company to migrate without disruption to their
operations. High performance. They required faster retrieval times to support their security
analytics and incident response workflows. AI Store, with read speeds of up to 2, 6 terabits per second,
325 gibbytes per second and write speeds of up to 1.32 terabits per second, 165 gibbytes per second
in a 32 node cluster configuration was a natural choice. Availability and resiliency. Erasure
coding is a core component of AI store and provides resilience during drive or node level
failure events, ensuring continuous uptime for their security operations. Best in class support. Being
Being able to leverage the panic button and interact directly with engineers for critical issues
became an urgent need as the cybersecurity company continued to scale.
Implementation and architecture, this security log data was ingested via a third party as well
as a homegrown log management tool which used AI store as an S3 compatible storage backend.
For analytics and security event processing, they leverage a mix of real time streaming
and batch processing frameworks, ensuring rapid incident detection and response.
Additionally, their infrastructure is designed to support high-speed networking, utilizing NVMI storage
and 100 GBE networking to handle the demands of their security operations efficiently.
According to Arvind Gupta, head of customer engineering at AI Store, given Thathier a security
company, the data durability and availability is of prime importance.
That means they need to ensure the data written to AI store object store is never lost.
Any data loss is business critical for them, and so is A store.
For most of the organizations, durability and availability of data is the greatest concern.
Minio provides durability with erasure coding across nodes and drives.
High availability can be achieved with multi-site deployment across different availability zones
and regions.
The cybersecurity company found that they could use their existing DevOps and IT personnel
for the migration.
Their experience in cloud technologies was easily transferable to AI Store.
This is part of a broader effort of AI Store to perfectly align with
S3 API, which includes aligning on error messages. This means the cybersecurity company was able to
configure and deploy AI store on its own. Of course, AISTER was able to help with the planning
process and advise on hardware, but the heavy lifting of this migration fell to the cybersecurity
company's own team, which was able to manage it without much difficulty. AISTER runs on commodity
hardware, which means this cybersecurity company wascible to use an easily accessible and
reliable collocation service for its implementation. There was no need to source, maintain, or
train for specialized equipment. They are able to swap out hardware as their needs adapt,
and because they aren't tied to any specific vendor, they can negotiate the best prices
for their hardware as they add and replace. Proving again that owning your own data can be
cost effective on multiple levels. Related. Object storage erasure coding versus block storage
rate dealing with something similar? Figuring out what to do with log or
unstructured data is not a unique problem to cybersecurity. Many organizations struggle with either
the large volume of log data under management or how long to keep it. Using a managed service
for both storage and the curation of logs can be prohibitively expensive. Disaggregating this
approach and using AI store for log data can be incredibly cost effective. Osset was for this
cybersecurity company. Returning to the topic of public cloud costs, skyrocketing and unpredictable
cloud bills are certainly not unheard of. The question becomes, when do these expenses no longer
make sense for an organization? There is a tipping point where the volume of log data, or any data
for that matter, builds to the point where it no longer makes economic sense to store data
in the public cloud. Beyond this tipping point, it makes sense to move the data and workload to a
non-premises private cloud. Organizations reach that threshold much faster when they need to move
large amounts of hot data are due to tiering, API calls, replication, encryption, and similar
processes. Great for bursty, experimental and cyclical workloads, the cloud will always have a
place in our architectures. But more and more organizations like this cybersecurity firm are coming
to understand the cloud as an operating model, note a specific vendor. In other words, their stack
can be optimized for the cloud without having to be in it. Growing footprint, the cybersecurity company
continues to grow its AI store footprint to support the growing data demands around various new
initiatives. Since repatriating from a W. Stowe and on-prem private cloud powered by Minio AI
store, the cybersecurity company has been consistently expanding its existing cluster and adding
more and more clusters. Gupta explained that this footprint is expanding to even more
workloads. They're exploring new use cases and avenues to start using Minio for all the data
needs. The cybersecurity companies transition from a WS to AI store exemplifies the power of
cloud repatriation in reducing costs and improving performance. By leveraging Minio Ister's
high performance S3 compatible object storage, they have create a scalable, performant, and cost-effective
infrastructure to support their operations. If you're interested in doing the same,
please reach out to USAT hello admin. I.O. We're on our Slack. Thank you for listening to this
Hackernoon story, read by artificial intelligence. Visit hackernoon.com to read, write, learn and publish.
