Senior DevOps Engineer - Data Pipelines & AI Infra

Millennium Management; Greater London; On-site; GBP 36,000 - 76,000; Full time

Job summary

Millennium is seeking a highly skilled DevOps Engineer to join the Equities Trading team in London or Dubai. Design and implement resilient, scalable infrastructure for research and trading workloads, and collaborate with researchers, portfolio managers, and developers to deliver reliable data pipelines and automation.

You will monitor production systems, optimize pipelines and AI-driven testing frameworks, and ensure the health of data streams while maintaining strong CI/CD practices.

Qualifications

• Strong Python proficiency and experience with observability/tools.
• Hands-on with workflow orchestration (Airflow).
• Experience with data pipelines and ETL processes.
• Proficient with containerization and orchestration (Docker, Kubernetes).
• Strong CI/CD understanding and tooling.
• Excellent problem-solving, communication, and collaboration.
• Highly organized with ability to manage multiple priorities.
• 5+ years in a quantitative role, trading knowledge.
• Excellent analytical and detail-oriented mindset.
• Ability to work in a collaborative team.

Responsibilities

• Design and build out environments.
• Perform continuous status checks on automated tasks.
• Develop automated testing frameworks and AI-driven solutions.
• Improve stability and performance of infrastructure components.
• Continuously monitor logs for all production apps.
• Proactively identify and resolve issues before they impact operations.
• Oversee health of data pipelines and dependencies.
• Ensure timely delivery of external data.
• Collaborate with researchers, developers, and portfolio managers to tailor solutions.
• Monitor and maintain data scraping pipelines for accuracy.

Skills

Python

Observability tools

Airflow

ETL pipelines

Docker

Kubernetes

CI/CD

Problem solving

Communication

Organization

Quantitative experience

Trading knowledge

Analytical skills

Attention to detail

Team collaboration

5+ years experience

Tools

Airflow

Docker

Kubernetes

CI/CD tools

Job description

Millennium is seeking a highly skilled DevOps Engineer to join the Equities Trading team in London or Dubai. Design and implement resilient, scalable infrastructure for research and trading workloads, and collaborate with researchers, portfolio managers, and developers to deliver reliable data pipelines and automation.

You will monitor production systems, optimize pipelines and AI-driven testing frameworks, and ensure the health of data streams while maintaining strong CI/CD practices.