Senior Production Engineer

Susquehanna International Group, LLP; Hong Kong; On-site; HKD 900,000 - 1,200,000; Full time

Job summary

Susquehanna International Group, LLP in APAC seeks a Senior Production Engineer to build and operate the technology supporting its Broker Dealer business. You will collaborate with developers and production support to improve reliability, automate testing and release processes, and own practical engineering solutions across the lifecycle.

You will design and maintain CI/CD pipelines, automate testing, build runbooks, dashboards and tooling, and resolve production incidents to prevent recurrence

Qualifications

• 10+ years of experience in production engineering, DevOps, SRE or software engineering with production systems responsibility.
• Strong Python programming and automation tooling, with testing, error handling and docs.
• Experience designing CI/CD pipelines, deployment automation and environment configuration.
• Experience building automated integration/regression tests with data management and validation.
• Troubleshooting across apps, OS, networks and messaging interfaces.
• Experience designing monitoring dashboards and alerts using logs/metrics.

Responsibilities

• Design, build and maintain CI/CD pipelines across development, testing and production environments with automated checks, controlled deployments and rollbacks.
• Develop automated integration and regression testing frameworks and turn business scenarios into repeatable tests.
• Build tooling for test data prep, environment setup and validation of messages across integrated systems.
• Develop dashboards and alerts for application health, connectivity and data quality.
• Automate deployment, configuration validation and pre-market checks; investigate incidents and root causes.
• Collaborate with developers, BA/QA, business users and vendors to prepare systems for production release.

Skills

Python programming

CI/CD pipelines

Troubleshooting

Communication skills

Linux/Windows environments

Education

Bachelor's degree in a technical discipline

Tools

GitHub/GitLab

Docker

Kubernetes

Airflow

Kafka

MongoDB

Grafana

Nagios

Elasticsearch

Job description

Overview

As a Senior Production Engineer, you will help build and operate the technology supporting Susquehanna’s APAC Broker Dealer business. You will work closely with developers, BA/QA colleagues and production support to improve system reliability, automate testing and operational processes, and deliver safe, repeatable releases.

This is a hands-on engineering role within a small, business-facing team. We are looking for someone who can identify gaps, design practical solutions and take ownership of delivering them. You will combine strong programming and troubleshooting skills with an understanding of how systems behave across the development, testing and production lifecycle.

Your work will focus on:

• Improving the resilience, recoverability and operational readiness of our trading systems.
• Building automation for regression testing, deployment, monitoring and daily operations.
• Improving release quality and developer productivity.
• Supporting production systems and resolving recurring issues through engineering improvements.

In this role, you will:

• Design, build and maintain CI/CD pipelines across development, testing and production environments, incorporating automated checks, controlled deployments and rollback capabilities.
• Establish and develop an automated integration and regression testing framework. Work with BA/QA colleagues to turn priority business scenarios into repeatable automated tests, and with developers to make applications easier to test.
• Build tooling for test data preparation, environment setup, workflow simulation and validation of messages and processing outcomes across integrated systems.
• Develop dashboards and actionable alerts covering application health, client and platform connectivity, message flows, processing failures and data quality.
• Automate deployment, configuration validation, pre-market checks and other recurring operational tasks.
• Investigate production incidents and testing issues, identify root causes and implement improvements that prevent recurrence.
• Improve recovery procedures, including restart, replay and reconciliation controls to ensure processing remains complete and accurate following interruptions.
• Manage application environments and configuration, working with Infrastructure and IT Security teams to support consistent and reliable operation.
• Work closely with developers, BA/QA, business users and external vendors to resolve integration issues and prepare systems for production release.
• Develop expertise in the front-to-back Broker Dealer application stack, including external connectivity, order and RFQ routing, order management, market and reference data, middle office and post-trade processing.
• Write and maintain operational runbooks, troubleshooting guides, technical documentation and recovery procedures.
• Share production support responsibilities with the team and use operational experience to guide automation and reliability improvements.

What we’re looking for

• At least ten years of relevant experience in production engineering, DevOps, SRE or software engineering with substantial responsibility for production systems.
• Strong Python programming skills and demonstrated experience building maintainable automation tools, with appropriate testing, error handling and documentation.
• Hands-on experience designing and maintaining CI/CD pipelines, deployment automation and environment configuration.
• Experience building automated integration or regression testing solutions, including test data management and validation of system behaviour.
• Strong troubleshooting skills across applications, operating systems, networks and messaging interfaces.
• Experience designing monitoring dashboards and alerts, and using logs and metrics to diagnose problems.
• Experience supporting production systems, managing incidents and implementing improvements to reliability and recovery.
• Confidence working across Linux and Windows environments.
• Strong communication skills and the ability to work effectively with technical colleagues, business users and external vendors.
• A proactive approach to identifying gaps, taking ownership and delivering practical solutions with minimal supervision.
• A careful approach to data accuracy, release quality and operational controls.
• A degree in a technical discipline or equivalent practical experience.

Useful additional experience

• Financial markets technology, particularly institutional Sales & Trading, RFQ workflows, order management or post-trade processing.
• FIX connectivity, message validation, replay or reconciliation tooling.
• Tools such as GitHub/GitLab, Docker, Kubernetes, Airflow, Kafka, MongoDB, Grafana, Nagios or Elasticsearch.
• Additional programming or scripting languages, such as C#, PowerShell or Bash.

#LI-Onsite

#LI-JC1