Back
Experienced Technology

Lead Data Engineer

Chicago

Optiver Chicago is seeking a seasoned Data Engineer to support and advance the data capabilities of our local research team and contribute to our broader Lakehouse architecture vision. In this role, you'll work with cutting-edge tools like Databricks, Apache Spark, and Delta Lake, translating experimental research workflows into scalable, production-grade systems.

As a critical engineering presence in Chicago, you'll directly influence local data strategy while collaborating with our Global Research and Data Platform teams. Your work will drive real-time insights, enable predictive analytics, and power decision-making across the trading lifecycle.

This role combines hands-on data engineering, cross-regional collaboration, and platform innovation—all within a high-performance, data-driven environment.

What you’ll do:

  • Design, build, and maintain reliable ETL/ELT pipelines using Spark, Structured Streaming, Databricks, and our in-house high-performance tools
  • Optimize and productionize research workflows with a strong focus on scalability, resilience, and performance tuning
  • Collaborate with power users to develop and share reusable patterns, templates, and onboarding pathways
  • Define, document, and enforce data engineering best practices
  • Mentor junior engineers and drive a culture of continuous learning and DataOps excellence

What You’ll Get

  • Immediate impact on the data systems powering world-class research and real-time trading decisions.
  • A unique opportunity to shape Lakehouse engineering in the United States and influence global data architecture.
  • High autonomy to own complex workflows and template “how-to” solutions across teams.
  • Close collaboration with quant researchers and traders to unlock predictive insights and trading alpha.
  • Partnership with best-in-class engineers across Chicago, Amsterdam, and Sydney.

In addition, you’ll receive:

  • The opportunity to work alongside best-in-class professionals from over 40 different countries
  • 401(k) match up to 50%
  • Comprehensive health, mental, dental, vision, disability, and life coverage
  • 25 paid vacation days alongside market holidays
  • Extensive office perks, including breakfast, lunch and snacks, regular social events, clubs, sporting leagues and more

Who you are:

  • 5+ years of hands-on experience in data engineering, delivering robust pipelines at scale
  • Advanced Python skills and deep experience with Apache Spark and the Databricks platform
  • Familiarity with Delta Lake, streaming data systems (e.g., Kafka), and distributed compute environments
  • Solid understanding of cloud-native data architectures (preferably AWS) and infrastructure cost optimization principles
  • Proficiency in relational databases (e.g., PostgreSQL) and modern orchestration tools
  • Bonus: Experience with system-level languages (e.g., C++, Rust) and exposure to MLOps or MLflow
  • Proven ability to lead projects independently and deliver outcomes in fast-paced environments
  • Clear communicator who collaborates well with researchers, traders, and engineers alike
  • Enthusiastic mentor and strong advocate for engineering rigor and platform scalability
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical discipline

Who we are:

At Optiver, our mission is to improve the market by injecting liquidity, providing accurate pricing, increasing transparency and stabilizing the market no matter the conditions. With a focus on continuous improvement, we prioritize safeguarding the health and efficiency of the markets for all participants. As one of the largest market making institutions, we are a respected partner on 100+ exchanges across the globe.

Our differences are our edge. Optiver does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, physical or mental disability, or other legally protected characteristics.

You are viewing: Apply now
Lead Data Engineer
Experienced Technology Chicago
Careers

Related vacancies

  • Technology

    Career Kickstarter: Women in Tech 2026

      Ready to fast-track your engineering career in just one week? At Optiver, our engineers are at the forefront of technological innovation, developing and refining the advanced systems that keep us competitive in global markets. The problems we solve are complex, requiring not only technical skill but also diverse perspectives and creative thinking. Understanding the […]

    Learn more
    Amsterdam
  • Technology

    Reference Data Analyst

    WHO WE ARE Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the […]

    Learn more
    Sydney
  • Technology

    Software Engineer – User Interface (C#)

      Optiver is seeking a Senior C# UI Engineer to help shape the next generation of our global trading and research interfaces. This is a hands-on technical leadership role focused on building performant, intuitive, and scalable user interfaces that interact seamlessly with our C++-based backend microservices. Our UIs are built using an in-house, high-performance C# […]

    Learn more
    Amsterdam
  • Technology

    Senior C# UI Engineer – Trading Systems

      Optiver is seeking a Senior C# UI Engineer to help shape the next generation of our global trading and research interfaces. This is a hands-on technical leadership role focused on building performant, intuitive, and scalable user interfaces that interact seamlessly with our C++-based backend microservices. Our UIs are built using an in-house, high-performance C# […]

    Learn more
    Amsterdam
  • Technology

    AI Agents Developer

    Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with over 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, […]

    Learn more
    Shanghai
  • Technology

    AI Agents Developer

    We are seeking a highly skilled and experienced AI Agents Developer to join our dynamic team. In this role, you will focus on designing, developing, and deploying intelligent agents that leverage artificial intelligence to streamline operations and improve productivity. What you’ll do: Design and develop robust AI agents using Python Integrate AI solutions with existing […]

    Learn more
    Austin
  • Technology

    AI Agents Developer

    We are seeking a highly skilled and experienced AI Agents Developer to join our dynamic team. In this role, you will focus on designing, developing, and deploying intelligent agents that leverage artificial intelligence to streamline operations and improve productivity. What you’ll do: Design and develop robust AI agents using Python Integrate AI solutions with existing […]

    Learn more
    New York
  • Technology

    Graduate Machine Learning Modelling Engineer

    Join Optiver to accelerate your growth in the most fascinating and dynamic industry. As a Machine Learning Modelling Engineer, you’ll get to leverage AI and deep learning to thrive in a fast-paced, cutting-edge environment, and apply your advanced degree in a highly impactful role. You will still use your brain to come up with cutting-edge […]

    Learn more
    Shanghai
  • Technology

    FPGA Development Team Lead

    WHO WE ARE Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market […]

    Learn more
    Mumbai
  • Technology

    FPGA Engineer

    WHO WE ARE Optiver is a tech-driven trading firm and leading global market maker. For over 35 years, Optiver has been improving financial markets around the world, making them more transparent and efficient for all participants. With more than 1,600 employees in offices around the world, we’re united in our commitment to improve the market […]

    Learn more