About

I am Amin Siddique, a data engineer focused on building reliable pipelines, migrating legacy systems, and making sense of the rapidly evolving AI-meets-data landscape.

I have spent years working with production data systems across industries — dealing with SQL migrations between dialects (Oracle, Exasol, Databricks), building dbt models at scale, optimizing Spark jobs that process billions of rows, and designing architectures that survive real-world load.

Why This Blog Exists

Most data engineering content falls into two categories: vendor marketing or academic theory. Neither helps when your pipeline fails at 2 AM or when you need to migrate 500 stored procedures to a new platform.

Reliable Data Engineering fills that gap. Every article is grounded in hands-on experience with production systems. I write about what actually works, what breaks, and what I wish someone had told me before I learned the hard way.

What You Will Find Here

• Data pipeline patterns that survive real-world production load
• SQL migration strategies across dialects (Oracle, Exasol, Databricks, and more)
• dbt best practices from running hundreds of models in production
• AI in data engineering — how LLMs, agents, and new tools are changing the way we build and maintain pipelines
• Honest tool reviews with real benchmarks, limitations, and trade-offs

My Approach

I do not write sponsored content. When I recommend a tool, it is because I have used it. When I criticize something, I explain why with specifics. Every article includes limitations and honest assessments, not just the highlight reel.

Connect

• Medium: medium.com/@amin-siddique
• Email: amin.siddique@outlook.com

Have questions or feedback? Visit the Contact page.