Lightweight observability for Python processes with instant UI
AI-powered Smart Water Leak Detection system using Machine Learning and IoT sensor data. Includes a Streamlit dashboard for real-time leak prediction, geo-visualization, batch analysis, and AI-driven insights.
Learn DataOps by building a complete data pipeline with Airflow, dbt, PostgreSQL, and Grafana using real-world animal nutrition data. Automate, monitor, and understand DataOps principles with hands-on examples and CI/CD integration.
AI-native platform that autonomously detects and remediates data pipeline failures
Lineage dashboard for spatial ETL pipelines: instrument your job with a decorator, then explore the source-transform-output DAG with per-stage row counts, geometry validity, CRS and schema drift — plus a self-contained shareable HTML/SVG graph.
An AI-powered tool that summarizes enterprise data pipeline logs using LLMs.
Python-based daily data quality validator for pipeline operations. It checks record counts, duplicates, null values, and generates automated reports.
Revolutionary AI-powered native C++ plugin for Scribus: Intelligent dashboard with real-time pipeline monitoring, AI-assisted layout validation, and automated publishing workflow optimization
Automated financial data pipeline using OpenBB, FRED, Sina Finance, PostgreSQL, data quality monitoring, and Streamlit dashboards.
A single-page showcase for Pipeline Operations Console: an AI-assisted console that puts real-time monitoring, predictive maintenance, and regulatory compliance for an entire pipeline network onto one screen
Data ledger, combining data pipeline monitoring and metadata management of individual data items in the flow.
Python CLI tool for ETL pipeline audit analysis — reconciliation, diagnostics, and health summaries from a local SQLite database
Hands-on lab demonstrating CI monitoring with GitHub Actions — automated build/run pipeline on every push, including a deliberate failure/debug cycle to test error detection and recovery.
This project is an automated Data Quality Monitoring System built using Python. It validates datasets and sends email alerts when data quality issues are detected.
Step failure alerts for Metaflow pipelines
Add a description, image, and links to the pipeline-monitoring topic page so that developers can more easily learn about it.
To associate your repository with the pipeline-monitoring topic, visit your repo's landing page and select "manage topics."