Infraspec Blog Posts
Sharing our learnings from our work
Taking Back Control: Observability as Reclaiming Agency
The story of every growing system is fundamentally a story about losing and regaining control.
Act I: The Illusion of…
Pragmatism Over Perfection
We as Engineers often chase perfection. It fuels our curiosity, sharpens our skills, and makes us feel good about the…
Apache Spark: Unleashing Big Data with RDDs, DataFrames and Beyond.
My Journey with Spark Before I knew Spark, I mostly used only Pandas and NumPy for data processing. They worked well for…
Building Scalable Multi-Tenant Systems with AWS CDK: An IAC Approach
In this blog, I will be taking you on a journey of building the scalable and efficient IAC solution that we build for…
Efficient Data Migration: From Hive Metastore to Unity Catalog in Databricks
TL;DR We had to migrate extensive data from Hive Metastore to Unity Catalog in a regulated large-scale enterprise…
ClickHouse Performance Benchmarking on ECS for Log Storage and Querying
Imagine being a Formula One driver, racing at breakneck speeds, but without any telemetry data to guide you. It’s a…
Cache Strategies
What is Caching? Caching is a technique that enhances application performance by temporarily storing frequently accessed…
From Chaos to Clarity: Managing Environments with Terragrunt
Managing multiple environments was a never-ending headache for me. Like many others in the DevOps world, I was…
Leveraging NFS Filesystem as Volumes in Docker: A Comprehensive Guide
As an Infrastructure engineer, I’ve had my fair share of experiences with containerized environments and the challenges…
AWS ECS: FARGATE vs self-managed EC2
Cooking Up Cloud: Fargate or EC2—Which Kitchen Suits You?
The Amazon Elastic Container Service (ECS) from Amazon deploys…
