Senior ML Systems Engineer - Production-Scale AI Infra

Encord; London (KY); On-site; USD 121,000 - 175,000; Full time

Benefits offered by this job

Competitive salary and equity

London office culture

25 days annual leave

Learning budget

Travel for UK/Europe

Daily company lunches

Team offsites

Job summary

Encord is seeking a Senior ML Systems Engineer to join our in-house ML team. You will design, build and operate the infrastructure that serves our computer vision and multimodal models in production, turning research into real product features.

The role sits on the engineering side, owning architecture, deployment and operations, while collaborating closely with Research, Product Engineering and Human Data teams across the company.

Qualifications

• 5+ years of software engineering experience, including meaningful time building and operating ML systems or model-backed products in production at scale.
• Strong software engineering and system design fundamentals.
• Hands-on experience deploying modern deep learning models in production, with a strong understanding of model serving, inference optimisation, GPU utilisation and performance trade-offs.
• Experience designing and operating scalable, distributed production systems, ideally involving GPU workloads, high-throughput data processing or low-latency inference.
• The ability to reason through an ML system end to end, from data and model choices to offline and online evaluation, deployment, monitoring and retraining.
• A track record of personally owning complex systems from design through to production
• Bonus: computer vision or multimodal deployment experience (not required), model-serving frameworks, or experience with video, 3D or other complex data types

Responsibilities

• Design, build and operate model-serving and inference infrastructure for transformer-based vision and multimodal models.
• Own the serving architecture behind our ML features, justifying trade-offs in latency, throughput, reliability and GPU cost.
• Optimise models and pipelines for production through batching, KV caching, GPU utilisation and orchestration.
• Integrate models into Encord's product and annotation workflows together with Product Engineering.
• Build reusable abstractions that work across models, data types, customers and changing task templates.
• Set up monitoring and observability, and own performance and reliability once features are live.
• Take prototypes from your research-focused teammates and turn them into shipped features.
• Contribute to platform design decisions, take part in design reviews and help us hire.
• Work with Python, PyTorch, CUDA, Kubernetes and GCP/AWS

Skills

Python

PyTorch

CUDA

Kubernetes

GCP/AWS

Job description

Encord is seeking a Senior ML Systems Engineer to join our in-house ML team. You will design, build and operate the infrastructure that serves our computer vision and multimodal models in production, turning research into real product features.

The role sits on the engineering side, owning architecture, deployment and operations, while collaborating closely with Research, Product Engineering and Human Data teams across the company.