Senior AI & Data Engineer
Well Experienced Data Warehouse Craftsman
I design, build, and operate end-to-end data pipeline (Ingestion, Transformation, and Serving) at scale.
Confluent Certified Data Streaming Engineer · GCP Certified Data Engineer
Projects
All projects →01
Second Brain - Git-Backed Obsidian Knowledge Vault
A Git-backed Obsidian second brain with an agentic capture pipeline — informal chat updates become linked, structured Markdown, ready for weekly and annual reviews.
Plain Markdown files are the source of truth, organized by lifecycle: Inbox → Projects/Areas/Resources → Archive (PARA). The owner's main interface is Discord and WhatsApp, where a Hermes agent turns informal messages into structured notes and dated work logs with employers kept clearly separated; Task Board due dates surface as Google Calendar reminders. Obsidian supplies editing, wikilinks, and the kanban board; Git versions every change with machine-local state git-ignored, so the vault reproduces on any device.
- personal-knowledge-management
- note-taking
- obsidian
- discord
- google-calendar
- git
- ai-agents
02
Crypto Tracker - Local Data Pipeline
An end-to-end local data pipeline: crypto and FX data ingested with dlt, warehoused in DuckDB, modelled with dbt into a medallion + star schema, orchestrated by Airflow 3.
dlt ingests CoinGecko and Frankfurter APIs into a DuckDB landing zone; dbt builds bronze trust-filter views, silver cleaned staging, and a gold star schema (dims, facts, marts). One Airflow 3 DAG runs ingest-then-build daily through a single-slot pool that serializes DuckDB writes. No API keys, no cloud account.
- data-engineering
- python
- SQL
- Airflow
- dbt
- DuckDB
- dlt
03
Blanche - Online Clothing E-commerce Platform
Full stack e-commerce website written in React Typescript + Gin Golang. Enabled caching mechanism through Redis.
React TypeScript storefront over a Gin (Go) REST API backed by PostgreSQL. A Redis read-through cache serves repeat catalog queries, and authentication uses JWT with role-based access.
- web-development
- frontend
- React
- backend
- Go
- database
- Redis
04
Sushee - Online Restaurant App
An Online Restaurant built using Golang, PostgreSQL, and React.
Three-tier ordering app: React SPA -> Go REST API -> PostgreSQL, run locally with Docker Compose. Orders flow through an explicit state machine from placement to kitchen fulfillment.
- web-development
- frontend
- React
- backend
- Go
- database
05
E-Wallet Backend Service
An E-Wallet API built using Golang and PostgreSQL.
Transactional ledger service in Go on PostgreSQL: double-entry balance records, idempotency keys on transfer endpoints, and row-level locking so concurrent transfers cannot lose updates.
- software-development
- backend
- Go
- database
06
MasTrendy - Daily Update Discord Bot
A Discord bot that publishes a curated daily trends digest.
Scheduled Python pipeline fetches daily trend sources, normalizes and deduplicates them, persists the results, formats a digest, and pushes it to Discord channels via webhook on a cron schedule.
- software-development
- bot
- data-engineering
- python
07
Hotel Booking Cancellation Prediction Model
Predictive model categorizes bookings as likely or unlikely to be canceled, achieving an accuracy of 83.56%.
Feature-engineered classification pipeline (scikit-learn) predicting hotel booking cancellations at 83.56% accuracy; the trained artifact is persisted and reused for batch scoring.
- data-science
- data-analytics
- machine-learning
Project 1 of 7: Second Brain - Git-Backed Obsidian Knowledge Vault
Writing
Everything →January 2025
Tired of stacking UNION ALL, have you tried BigQuery GROUPING SETS?
This article explores BigQuery's GROUPING SETS clause as a more concise and readable alternative to complex UNION ALL queries for generating aggregations at multiple levels of granularity.
- bigquery
- sql
- data-engineer
- data-analysis
January 2025
BigQuery “NOT IN” vs “NOT EXISTS” vs “EXCEPT DISTINCT” understand the differences in 3 minutes!
This article compares three BigQuery operators—NOT IN, NOT EXISTS, and EXCEPT DISTINCT—for excluding data from query results, using a real-world debugging scenario involving bot traffic exclusion.
- bigquery
- sql
- data-engineer