Senior AI & Data Engineer
Well Experienced Data Warehouse Craftsman
I design, build, and operate end-to-end data pipeline (Ingestion, Transformation, and Serving) at scale.
Confluent Certified Data Streaming Engineer · GCP Certified Data Engineer
Projects
All projects →01
Crypto Tracker - Local Data Pipeline
An end-to-end local data pipeline: crypto and FX data ingested with dlt, warehoused in DuckDB, modelled with dbt into a medallion + star schema, orchestrated by Airflow 3.
dlt ingests CoinGecko and Frankfurter APIs into a DuckDB landing zone; dbt builds bronze trust-filter views, silver cleaned staging, and a gold star schema (dims, facts, marts). One Airflow 3 DAG runs ingest-then-build daily through a single-slot pool that serializes DuckDB writes. No API keys, no cloud account.
- data-engineering
- python
- SQL
- Airflow
- dbt
- DuckDB
- dlt
02
Blanche - Online Clothing E-commerce Platform
Full stack e-commerce website written in React Typescript + Gin Golang. Enabled caching mechanism through Redis.
React TypeScript storefront over a Gin (Go) REST API backed by PostgreSQL. A Redis read-through cache serves repeat catalog queries, and authentication uses JWT with role-based access.
- web-development
- frontend
- React
- backend
- Go
- database
- Redis
03
Sushee - Online Restaurant App
An Online Restaurant built using Golang, PostgreSQL, and React.
Three-tier ordering app: React SPA -> Go REST API -> PostgreSQL, run locally with Docker Compose. Orders flow through an explicit state machine from placement to kitchen fulfillment.
- web-development
- frontend
- React
- backend
- Go
- database
04
E-Wallet Backend Service
An E-Wallet API built using Golang and PostgreSQL.
Transactional ledger service in Go on PostgreSQL: double-entry balance records, idempotency keys on transfer endpoints, and row-level locking so concurrent transfers cannot lose updates.
- software-development
- backend
- Go
- database
05
MasTrendy - Daily Update Discord Bot
A Discord bot that publishes a curated daily trends digest.
Scheduled Python pipeline fetches daily trend sources, normalizes and deduplicates them, persists the results, formats a digest, and pushes it to Discord channels via webhook on a cron schedule.
- software-development
- bot
- data-engineering
- python
06
Hotel Booking Cancellation Prediction Model
Predictive model categorizes bookings as likely or unlikely to be canceled, achieving an accuracy of 83.56%.
Feature-engineered classification pipeline (scikit-learn) predicting hotel booking cancellations at 83.56% accuracy; the trained artifact is persisted and reused for batch scoring.
- data-science
- data-analytics
- machine-learning
Project 1 of 6: Crypto Tracker - Local Data Pipeline
Writing
Everything →January 2025
Tired of stacking UNION ALL, have you tried BigQuery GROUPING SETS?
This article explores BigQuery's GROUPING SETS clause as a more concise and readable alternative to complex UNION ALL queries for generating aggregations at multiple levels of granularity.
- bigquery
- sql
- data-engineer
- data-analysis
January 2025
BigQuery “NOT IN” vs “NOT EXISTS” vs “EXCEPT DISTINCT” understand the differences in 3 minutes!
This article compares three BigQuery operators—NOT IN, NOT EXISTS, and EXCEPT DISTINCT—for excluding data from query results, using a real-world debugging scenario involving bot traffic exclusion.
- bigquery
- sql
- data-engineer