Back
Technology  · 

Real-Time Trading Dashboards with Databricks Apps and Dash

Engineer focused and looking intently at a computer screen.

Presented at the Databricks Data + AI Summit 2025

In trading, speed and insight go hand in hand. At the 2025 Databricks Data + AI Summit, Optiver shared how we built low-latency, self-serve dashboards by integrating Databricks Apps with Dash. The result: real-time market visibility that scales with both data and decision-making.

From Fragmented Systems to Live Insights at Scale

In the session “Real-Time Market Insights — Powering Optiver’s Live Trading Dashboard with Databricks Apps and Dash,” attendees got an inside look at how we:

  • Replaced siloed, on-prem systems with a unified, petabyte-scale Databricks platform
  • Cut end-to-end latency from minutes to seconds through Spark and Structured Streaming optimization
  • Empowered traders to build and iterate on dashboards without engineering support
  • Solved scale and reliability challenges with smart caching, version control, and modular dashboard generation

By hosting Dash apps directly on Databricks, we eliminated infrastructure overhead while enforcing fine-grained access controls through Unity Catalog. The result is a dashboarding ecosystem that balances trader autonomy with engineering performance — built for impact at speed and scale.

Watch the Talk

For engineers working with real-time systems, market data, or scalable streaming architectures, this talk is a deep dive worth watching.

Interested in building systems like this?

At Optiver, our engineers work on low latency pipelines, real-time analytics and scalable infrastructure to support fast and informed decision making. We’re hiring data engineers in Chicago, Sydney, and London — explore the roles and apply today.

Technology
Insights

Related Articles

  • Technology

    UI as a Systems Problem

    When something feels slow, you’re probably looking in the wrong place. UI issues are rarely local and are often caused by how data is fetched, recomputed, and duplicated across the system, becoming visible only when multiple services, queries, and interactions run at the same time. Read how Optiver approaches building systems where UI and data are tightly coupled.

    Learn more
    Global
  • Technology

    Infrastructure-as-Code for Latency-Critical Bare Metal Systems

    About the Speaker Leanne Fok is a Senior Infrastructure Engineer in Amsterdam with 15+ years at Optiver. She previously led the Infrastructure Platform team responsible for our internal Infrastructure-as-Code stack and is now leading the Infrastructure Kubernetes project. Infrastructure-as-Code is straightforward in the cloud. But what about on bare metal? In her PyLadies talk, “Infrastructure-as-Code […]

    Learn more
    Global
  • Technology

    Building visibility into a CI platform

    This article explores how we operate a CI platform on fixed hardware, where auto-scaling is not always an option. It covers how we built visibility into queue times, utilisation, and system behaviour to manage capacity with confidence.

    Learn more
    Global
  • Technology

    When Speed and Scale Collide

    Data systems are often described along two axes: speed and scale. In practice, “speed” usually means some combination of latency and throughput, and systems are often optimized for one at the expense of the other, sometimes by trading efficiency for raw capacity. Those distinctions tend to break down quickly once systems move beyond simple use […]

    Learn more
    Global
  • Experienced, Technology

    Choosing between free threading and async in Python

    As host of this year’s first PyAmsterdam Meetup, Optiver welcomed the local Python community back to our headquarters for an evening of tech talks, networking and knowledge sharing. To open the event, Optiver Senior Software Engineer and Team Lead Samet Yaslan delivered a timely talk for developers working on performance-critical systems: “Choosing Between Free Threading and Async.” Prompting his choice of topic was a recent change in CPython, as Samet explained: “Beginning with version 3.13, CPython introduces an option for a build known as free threading, where the Global Interpreter Lock (GIL) is removed. The question is: With the GIL gone, do we still need async in Python?” Here’s how he breaks it down, and what it means for your next Python project.

    Learn more