Data engineering · observability

Pipeline Observability

The ELT job behind Data Copilot, instrumented. A GitHub Actions cron extracts market data daily, transforms it to Parquet, and commits it — this page watches that job: freshness, per-ticker coverage, and run history.

Status

loading…

Per-ticker coverage

Rows fetched and latest date per instrument — a lagging bar means that ticker is behind the freshest date.

Run history

The pipeline

Schedule
cron · 21:30 UTC daily
Source
Transform
Yahoo → tidy long → Parquet (zstd)