World Cup prediction market pipeline
I built this as two parallel pipelines over Manifold Markets' public API and Polymarket, testing calibration and the favorite-longshot bias in 2026 World Cup markets. One runs Spark, dbt, and DuckDB or Postgres as a Kubernetes batch job; the other runs the same logic on Databricks with Delta Live Tables and Unity Catalog.
View project →