Intelligent data pipeline with AI-driven analytics — automated insight generation from multi-source business data.
Overview
Airflow orchestrates multi-source ingestion, dbt transforms to BigQuery, and a LangChain analyst generates scheduled narrative reports, anomaly summaries, and trend analysis.
Engineering Challenge
Grounded insight generation required a tool-augmented approach where the LLM executes SQL against BigQuery rather than reasoning over raw data.