Edge ML Systems Engineer – Federated AI for Data Centers

Octaipipe; City Of London; On-site; GBP 90,000 - 130,000; Full time

Job summary

OctaiPipe is seeking an ML Systems Engineer to own the systems engineering behind our edge computing and federated AI platform. You will orchestrate workloads, ensure efficient inference on diverse hardware, and collaborate with scientists to translate ideas into scalable experiments.

You will work with RL and causal models, contribute to staging environments, and help build robust deployment workflows. This is a hands-on role in a fast-growing team creating technology to reduce energy use in

Qualifications

• Strong software engineering fundamentals and Python proficiency.
• Experience building and operating end-to-end ML systems in production.
• Distributed systems experience with state consistency and versioning across unreliable networks.
• Experience coordinating multiple workloads on shared hardware.
• Experience optimising model inference for production.
• Deep working knowledge of the ML training stack (PyTorch or similar).
• Experience building monitoring with Grafana and the Elastic Stack.
• Ability to debug complex failures and work autonomously with scientists.

Responsibilities

• Own workload coordination on the device: RL inference, fine-tuning, LLM explainer and analytics.
• Guarantee model lifecycle correctness across the fleet: versioning, atomic swaps, reconciliation with portal state.
• Build deployment workflows on the central portal: packaging, staged rollout, shadow-mode deployment, rollback.
• Scale staging environment and training systems: distributed training, orchestration, checkpointing, recovery.
• Profile and optimise on-device performance across heterogeneous hardware including LLM inference.
• Develop monitoring and observability on Grafana and Elastic Stack for drift detection.
• Build telemetry and data pipelines for on-device analytics and data lineage.
• Debug failures across the full stack to unblock scientists.
• Raise engineering bar through runbooks and post-mortems.

Skills

Python

Software engineering

Distributed systems

RL/inference optimization

Debugging complex failures

Autonomy

Collaboration with scientists

Tools

PyTorch

Grafana

Elastic Stack

ONNX Runtime

Job description

OctaiPipe is seeking an ML Systems Engineer to own the systems engineering behind our edge computing and federated AI platform. You will orchestrate workloads, ensure efficient inference on diverse hardware, and collaborate with scientists to translate ideas into scalable experiments.

You will work with RL and causal models, contribute to staging environments, and help build robust deployment workflows. This is a hands-on role in a fast-growing team creating technology to reduce energy use in