Back
Experienced Technology

Kafka Engineer

Sydney

WHO WE ARE

Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and risk management. By providing liquidity on multiple exchanges across the world in various financial instruments we participate in the safeguarding of healthy and efficient markets. We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products: listed derivatives, cash equities, ETFs, bonds and foreign currencies.

Optiver’s Sydney office is one of the primary players within Asian markets, trading a range of products. Established in 1996, we’re an active participant on the Hong Kong, Korea, Singapore, Taiwan and Japan exchanges, and act as Optiver’s APAC head office.

 

WHAT YOU’LL DO

We’re looking for a skilled Data Engineer with strong Kafka experience to help design, build, and maintain our real-time data pipelines. You’ll work closely with researchers and engineers to ensure the performance, reliability, and scalability of data systems that support our trading and research platforms.

This is a hands-on role with a focus on Kafka infrastructure, stream processing, and integration with our broader data architecture. You’ll play a key role in shaping our data platform and ensuring we meet the growing demands of our business.

  • Design and manage scalable Kafka-based data pipelines.

  • Build and maintain Kafka producer/consumer libraries.

  • Monitor and optimise Kafka performance, latency, and reliability.

  • Collaborate with teams to integrate streaming pipelines into research workflows.

  • Implement access control, authentication, and encryption for Kafka.

  • Support disaster recovery planning and production stability.

  • Deliver data to S3 and support lakehouse ingestion.

  • Document systems and share Kafka best practices across teams.

  • Stay up to date with emerging technologies and recommend improvements.

WHO YOU ARE

Must-Haves

  • 3+ years of experience in data engineering.

  • Strong hands-on experience with Apache Kafka in production.

  • Solid understanding of Kafka architecture and components.

  • Experience deploying, scaling, and monitoring Kafka clusters.

  • Proficient in Python.

  • Experience in Linux environments.
  • Good understanding of networking and security best practices.

Nice-to-Haves

  • Experience with Kafka Streams or Kafka Connect.

  • Familiarity with tools like Spark, Flink, or Beam.

  • Exposure to cloud-based Kafka (e.g., AWS MSK, Confluent Cloud).

  • Knowledge of IaC tools (e.g., Terraform, Ansible).

  • Interest in trading systems or financial data.

 

WHAT YOU’LL GET

You’ll join a culture of collaboration and excellence, where you’ll be surrounded by curious thinkers and creative problem solvers. Driven by a passion for continuous improvement, you’ll thrive in a supportive, high-performing environment alongside talented colleagues, working collectively to tackle some of the most complex problems in the financial markets.

In return for your expertise, you will be offered a competitive salary package as well as access to a range of Optiver perks, including:

  • The chance to work alongside best-in-class professionals

  • Competitive remuneration, including an attractive bonus structure and additional leave entitlements

  • Training, mentorship and personal development opportunities

  • Gym membership plus weekly in-house chair massages

  • Daily breakfast, lunch and an in-house barista

  • Regular social events including an annual company trip

 

Optiver is committed to diversity and inclusion, and it is hardwired through every stage of our hiring process. We encourage applications from candidates from any and all backgrounds, and we welcome requests for reasonable adjustments during the process to ensure that you can best demonstrate your abilities.

Questions? Get in touch with the recruitment team at [email protected]

You are viewing: Apply now
Kafka Engineer
Experienced Technology Sydney
Careers

Related vacancies

  • Technology

    AI Engineer

    WHO WE ARE Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the […]

    Learn more
    Shanghai
  • Technology

    2026 Shanghai Data Scientist Summer Internship

    As a Data Scientist intern, who loves to solve both data science and technical problems, you will have the opportunity to perform extensive data analysis to implement new algorithms that support and improve our existing models, strategies, and datasets. By the end of the 8-week internship, you’ll have deepened your understanding of how technology is […]

    Learn more
    Shanghai
  • Technology

    2026 Shanghai Machine Learning PhD Internship

    As a Machine Learning Modelling Engineer, you’ll harness your understanding of AI and deep learning to generate impactful insights and drive innovative new strategies that have the potential to transform global financial markets. Your intellectual creativity won’t just be theoretical; you’ll get to turn your cutting-edge ideas into real-world solutions that contribute towards our trading […]

    Learn more
    Shanghai
  • Technology

    2026 Shanghai Software Developer Summer Internship

    As a Software Developer Intern at Optiver, you’ll work alongside experienced engineers to develop innovative solutions that enable us to respond to the financial markets at lightning-fast speeds. In just a few weeks, you could develop applications that contribute towards our trading success. By the end of the 8-week internship, you’ll have deepened your understanding […]

    Learn more
    Shanghai
  • Technology

    2026 Shanghai FPGA Developer Summer Internship

    At Optiver, FPGAs play a critical role in executing successful trades. With no external clients, we operate in a fast feedback, quick release environment.  As a FPGA Developer Intern at Optiver, you’ll work alongside experienced hardware engineers to ensure we have the fastest and most reliable trading systems in the industry. You’ll constantly be innovating with […]

    Learn more
    Shanghai
  • Technology

    Software Engineer – Autotrading

    Optiver is looking for a Software Engineer to join our London Autotrading development team.  This team works both on expanding the functionality of our autotrading systems to meet the unique needs of the desks in London, as well as taking a lead on optimizing and improving the scalability of our core trading platform. Our systems […]

    Learn more
    London
  • Technology

    Support Engineer

    Optiver’s Enterprise Technology Support Engineers focus on IT systems and applications that allow users to perform their daily work. We firmly believe in finding the right blend of functionality for our users and manageability for administrators. To that end, the person we seek will revel in finding that balance, and running systems that consistently work […]

    Learn more
    Amsterdam
  • Technology

    Data Site Reliability Engineer

    WHO WE ARE Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the […]

    Learn more
    Singapore
  • Technology

    FPGA Engineer

    At Optiver, we pride ourselves on being real Engineers, not just coders. Our Engineers work closely with Traders to identify the business problems we face and determine how they should be solved. We apply a disciplined and scientific approach to engineer simple, well-architected solutions that meet the dynamic needs of our traders. Our passion is […]

    Learn more
    Amsterdam
  • Technology

    Linux Systems Engineer

    The Optiver Linux Systems Engineering Team ensures our trading servers work so we can trade. You will work in a highly-customized bare metal environment where proprietary tools and technology run at breakneck speed. You will be expected to help build the pioneering tools to keep our systems best-in-class while enabling our technology evolution in a […]

    Learn more