data-eng

A Baseline for DataHub SideCar

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

A Python data visualization tool for identifying political popularity through Twitter

Production-grade market data pipeline: Alpaca (Daily & 1Min) → normalized schema → partitioned Parquet → DuckDB analytics + strict QA observability.

🚀 SQL repository for Data Engineering covering CTEs, Window Functions, GROUP BY, String, and Date Functions.

Apache Airflow Cheatsheet

Beowulf meets agentic AI. An MCP server that gives LLMs structured access to the complete Old English text, dictionary, and linguistic annotations.

This project is an End-to-End Video Captioning System designed to bridge the gap between Computer Vision and Natural Language Processing. It automatically generates descriptive text for video content, essentially teaching a computer to "watch" a video and describe what is happening in English

Automated ETL pipeline for Bitcoin price data: collection, analysis and export with CLI, Docker, CI/CD

Azure Databricks medallion pipeline combining stock prices and news to surface quantitative analytics in Power BI.

End-to-end Implementation of the medium article leveraging services of AWS and Algolia.

Create a fully functional and scalable RESTful API from scratch using modern tools available. Set up routes and pipelines, database storage, token generation using different encryption and hashing algorithms, handle asynchronous code, handle common errors and known exploits.

A resilient database migration pipeline normalizing a legacy CSV into a 3NF SQLite database using Polars, with robust pytest coverage.

Data Engineering Basic Guide

Hi, I'm Tatiana I'm a Data & Cloud Engineer in training, currently building real-world data-driven projects. 🎓 Background: Engineering 📍 Based in Bielefeld, Germany 🎯 Interested in Data, Cloud & AI roles ⬇️ Featured projects below

ETL Pipeline untuk scraping, transformasi, dan load data produk fashion ke PostgreSQL & Google Sheets

Supermarket sale and stock data management project for ETL and Real-Time Analytics.

Mastering the data-cleaning and logic-plumbing required for production-ready AI models. From raw data sanitization to robust NLP feature extraction.

user management app and agent to handle report access