Hello! I'm

RATHIN
SHARMA

Senior Analytics Engineer
Founder ofArchstack·data engineering, written plainly
Ask me anything about my work, experience, or background...
Chat

About Me

I'm a Data & Analytics Engineer who turns messy data into decision-ready insight. I work with Snowflake, Airflow, dbt, Power BI, and thoughtful modeling that business users actually adopt.

I treat data like a product. Contracts, lineage, and quality get the same rigor as code. I challenge assumptions and hunt for the simple design beneath complexity.

Outside work, I write and teach at Archstack — a small brand where I break down the ideas behind modern data platforms: warehouses, transformation, semantic layers, and the AI/ML stack growing on top of them.

WHAT
I DO

DATA ENGINEERING

Building Scalable Pipelines

ANALYTICS ENGINEERING

Modeling for Business Impact

AI ENGINEERING

Agents, RAG & LLMs on Warehouse Data

~60%

Reduction in Dead Inventory

~30%

Faster Inspection Cycles

~25%

Faster Order Fulfillment

~20%

Improved Yield Accuracy

End-to-End

The Data Lifecycle

Click a layer to explore.

AI & Agents
Testing / Experimentation
Reporting / BI
Transformation / Stewardship
Storage / Engineering
Collection / Sources

Collection / Sources

ERPs, apps, IoT via Fivetran, Dagster, custom connectors, and Azure Functions. CDC and event streams designed with data contracts from the start.

My career &
experience

Founder & Creator

Archstack

Independent

NOW

Creator brand covering modern data platforms, warehousing, dbt, Snowflake, and the AI stack growing on top — on YouTube and in writing. Tools, teardowns, and architecture breakdowns.

Senior Analytics Engineer

Cooke Inc.

Saint John, NB, Canada

NOW

Lead a team of Analytics Engineers, driving global analytics initiatives and ensuring delivery of scalable, high-quality data solutions.

Analytics Engineer

Cooke Inc.

Saint John, NB, Canada

2023

Design and development of optimized datasets, streamlining data access and enhancing the efficiency of data analysts.

Business Intelligence Analyst

Cooke Inc.

Saint John, NB, Canada

2022

Gathered and analyzed data from diverse sources, including customer data, financial data, and sales data, to uncover valuable trends and patterns.

Data Analyst

Scion Infotech

India - Remote

2020

Partnered with clients to gather requirements, translate them into functional specifications, and design scalable reporting solutions.

My Work

AI Engineering

Claude-Backed Internal Agent

Internal chat and agent surface that answers data questions over warehouse context. Semantic layer as retrieval surface, Claude tool use to hit live dbt models, prompt caching to keep per-request cost flat.

ToolsAnthropic SDK, Tool Use, Prompt Caching, MCP, Semantic Layer
Production tool, used daily by analytics + ops
Databricks

Technologies

Depth over logos

What I run in practice.

Ingest & Store

FivetranEvent HubS3 / BlobSnowflakeDatabricksPostgresTrino

Model & Transform

dbtSQLPythonSparkData VaultMedallionData Contracts

Orchestrate & Serve

AirflowDagsterAstronomerSemantic LayerPower BIAPIs

AI & Agents

ClaudeAnthropic SDKSnowflake CortexSnowparkXGBoostMCPCursor

AI-Native

How I build now

The two tools that changed how I ship data work.

Cursor

Cursor

Daily driver

Every dbt model, pipeline, and PR runs through Cursor. I lean on Composer for multi-file refactors, Agent mode for bounded migrations, and project-level rules to keep style consistent across a warehouse of models.

ComposerAgent ModeProject RulesMCP Servers
Claude

Claude

Default model

Claude is what I reach for when the work is ambiguous — architecture reviews, deep SQL debugging, cross-system design. I build Claude-backed internal tools and agents on the Anthropic SDK with tool use and prompt caching.

OpusSonnetTool UsePrompt CachingAnthropic SDK
Dagster

Interactive

ETL vs ELT

See the difference in how data flows through stages.

Extract
id
item
price
1
nitrile gloves
13$
2
NITRILE GLOVES
1.5 $
3
Gloves, nitrile
$7
4
nitrile glove
$12.00
5
gloves-nitrile
USD 5
Transform
id
item
price
1
Nitrile Gloves
$13.00
2
Nitrile Gloves
$1.50
3
Nitrile Gloves
$7.00
4
Nitrile Gloves
$12.00
5
Nitrile Gloves
$5.00
Load
id
item
price
1
Nitrile Gloves
$13.00
2
Nitrile Gloves
$1.50
3
Nitrile Gloves
$7.00
4
Nitrile Gloves
$12.00
5
Nitrile Gloves
$5.00

Key Difference: ETL transforms data before storage (good for structured, known schemas). ELT loads raw data first, then transforms in-warehouse (better for flexibility and modern cloud warehouses).

Principles

My Data Philosophy

Outcomes Over Outputs

I measure success by business impact, not lines of code. Every pipeline, model, and dashboard should answer a real question.

Data as Product

Treat data assets like products: documented, tested, versioned, and user-focused. Quality and reliability are foundational.

Simplicity Through Layers

Complex problems decompose into simple layers. Staging to intermediate to marts. Each layer has a clear purpose and contract.

Reading

What informs my approach

Designing Data-Intensive Applications

by Martin Kleppmann

A deep dive into building reliable, scalable, maintainable data systems. Shapes how I design ingestion, storage, and serving.

Fundamentals of Data Engineering

by Joe Reis & Matt Housley

Pragmatic trade-offs across ingestion, modeling, orchestration, and consumption. Clarifies ETL vs ELT choices.

The Making of a Manager

by Julie Zhuo

Tactics for setting expectations, giving feedback, and building trust. Guides how I mentor engineers and run projects.

Postgres

Contact

Location

Saint John, NB, Canada

Designed and Developed by Rathin Sharma

© 2026