ML Systems Engineer

Roc Search Inc.

Greater London

Hybrid

GBP 100,000 - 110,000

Full time

3 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Startup in London is seeking an ML Systems Engineer to join a distributed AI platform operating across edge and on-premises infrastructure. The role focuses on production ML workloads, deployment, monitoring and continuous improvement in a fast-growing AI tech environment.

You will work with Applied Scientists and Research Engineers to build the infrastructure, deployment workflows and experimentation environments needed to take new algorithms from concept to real-world application.

Qualifications

  • Proven experience building and running production ML workloads.
  • Strong software engineering foundations and Python fluency.
  • Experience with distributed training and model deployment.

Responsibilities

  • Design workload scheduling and resource allocation for ML apps.
  • Own model deployment, versioning, monitoring and rollbacks.
  • Build automated deployment pipelines and testing environments.
  • Develop distributed training infrastructure, including orchestration.
  • Profile and optimise model inference across hardware.
  • Build observability solutions with Grafana and Elastic Stack.
  • Develop telemetry and data pipelines for ML systems.
  • Troubleshoot infrastructure and ML system issues.
  • Collaborate with research teams to accelerate experimentation.

Skills

Python
MLops
PyTorch
Distributed systems
Model deployment

Tools

Grafana
Elastic Stack
TensorRT

Job description

ML Systems Engineer
Distributed AI | Machine Learning Infrastructure | Edge Computing

London (2 days per week in office)

AI Startup

£100,000-£110,000 DOE + Bonus

Skills: Python, MLops, Pytorch, Grafana, Elastic Search, TensorRT

The Opportunity

An exciting opportunity to join a fast-growing AI technology business developing advanced machine learning solutions for complex, real-world environments.

The company is building a distributed AI platform that enables machine learning models to operate directly within physical infrastructure, rather than relying solely on centralised cloud environments. Its technology focuses on improving operational efficiency, enabling intelligent decision-making and supporting more sustainable infrastructure.

As an ML Systems Engineer, you'll join a specialist team responsible for building the infrastructure that allows AI models to be trained, deployed, monitored and continuously improved across multiple distributed environments.

The Role

You'll take ownership of the systems engineering behind production ML workloads, ensuring models run reliably and efficiently across heterogeneous, resource-constrained hardware.

Working closely with Applied Scientists and Research Engineers, you'll bridge the gap between research and production, building the infrastructure, deployment workflows and experimentation environments needed to take new algorithms from concept through to real-world application.

Key Responsibilities
  • Design and manage workload scheduling, resource allocation and isolation across multiple concurrent ML applications.
  • Own model deployment and lifecycle management, including versioning, updates, monitoring, rollbacks and fleet-wide consistency.
  • Build automated deployment pipelines, staged releases and testing environments.
  • Develop distributed training and fine-tuning infrastructure, including orchestration, checkpointing and recovery.
  • Profile and optimise model inference across different hardware environments, including GPU and LLM workloads.
  • Build monitoring, alerting and observability solutions using tools such as Grafana and the Elastic Stack.
  • Develop reliable telemetry and data pipelines to support machine learning, analytics and model performance.
  • Troubleshoot complex issues across infrastructure, software and ML systems.
  • Work closely with research teams to accelerate experimentation and improve engineering standards.
What We’re Looking For
  • Strong software engineering fundamentals and excellent Python skills.
  • Experience building and operating production machine learning systems, from training and data pipelines through to deployment and monitoring.
  • Solid distributed systems knowledge, particularly around reliability, state management and version control.
  • Experience managing multiple workloads across shared or resource-constrained hardware.
  • Understanding of model optimisation, profiling and efficient inference.
  • Strong knowledge of PyTorch or similar ML frameworks, including distributed training and checkpointing.
  • Experience with monitoring and observability tools such as Grafana, Prometheus or the Elastic Stack.
  • A hands-on engineer who enjoys solving complex technical problems and working closely with research and engineering teams.
Desirable Experience

Experience in one or more of the following would be beneficial:

  • Reinforcement learning infrastructure (Ray, RLlib) or control systems.
  • LLM deployment and inference optimisation (vLLM, llama.cpp, ONNX, TensorRT).
  • Federated learning, transfer learning or distributed machine learning.
  • Edge computing, on-premise GPU infrastructure or hardware-constrained environments.
  • Device orchestration, remote deployment and fleet management.
  • Simulation environments and virtualised testing infrastructure.
  • Streaming and telemetry technologies such as Kafka or MQTT.
  • Operating AI systems within critical or regulated infrastructure.
Why Join?
  • Work on genuinely challenging problems at the intersection of AI, software engineering and distributed systems.
  • Play a key role in taking advanced machine learning research into production.
  • Join an ambitious, well-backed technology business at an exciting stage of growth.
  • Work alongside talented Applied Scientists, Research Engineers and infrastructure specialists.
  • Take ownership of systems and architecture with the opportunity to make a significant technical impact.
  • Contribute to technology with real-world applications across large-scale physical infrastructure and sustainability.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Systems Engineer (RL)
ML Systems Engineer (RL)

Roc Search Inc. • Greater London

Hybrid
GBP 100,000 - 110,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Xcede • Greater London

Hybrid
GBP 95,000 - 130,000
Machine Learning Operations (MLOps) Engineer
Machine Learning Operations (MLOps) Engineer

Placements24 • Greater London

Hybrid
GBP 70,000 - 100,000
Medical aid
Retirement planning
Hybrid work model
+1
Distributed ML Systems Engineer: Edge & Production Infra
Distributed ML Systems Engineer: Edge & Production Infra

Roc Search Inc. • Greater London

Hybrid
GBP 100,000 - 110,000
Machine Learning Engineer
Machine Learning Engineer

Data Idols • Greater London

Hybrid
GBP 75,000 - 80,000
Hybrid working
Pension & loans
Training funding
+2
AI/ML Engineer
AI/ML Engineer

Anson McCade Pty • Greater London

Hybrid
GBP 50,000 - 70,000
Annual Bonus Scheme
Private Medical Cover
Flexible Hybrid Working
+3
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Dex • Greater London

On-site
GBP 120,000 - 180,000
Staff Machine Learning Engineer
Staff Machine Learning Engineer

Actcareers • United Kingdom

On-site
GBP 110,000 - 170,000
Senior ML Infrastructure Engineer (Research Initiatives) - Systems Integrator
Senior ML Infrastructure Engineer (Research Initiatives) - Systems Integrator

Hamilton Barnes Associates Limited • United Kingdom

Hybrid
GBP 90,000 - 130,000
Significant stock option packages
Remote-first working setup
Fully paid travel and accommodation
+1
MLOps Engineer
MLOps Engineer

Harnham • Greater London

Hybrid
GBP 75,000 - 95,000