Applied AI Scientist, Simulation & Reinforcement Learning

locusrobotics; Greater London; Remote; GBP 70,000 - 120,000; Full time

Job summary

Locus Robotics in the United Kingdom is seeking an Applied AI Scientist, Simulation & Reinforcement Learning, to own the discrete-event simulator built on SimPy and drive RL integration with real-world warehouse data.

You will evolve the simulator into a full RL environment, run experiments with Optuna, and collaborate with Applied Data Science to publish and share results. This role mandates remote work from the UK and strong communication across teams.

Qualifications

• PhD in CS/AI/Robotics or MSc + 5+ years of relevant experience.
• Hands-on experience building or validating simulators (discrete-event preferred).
• Experience with reinforcement learning and RL environments.
• Strong Python and software engineering fundamentals.
• Experience in robotics, logistics or operations-heavy domains.
• Publications in major AI/ML/robotics venues.
• Excellent English communication skills.

Responsibilities

• Own and develop our SimPy-based discrete-event simulator, including its logic and design choices.
• Improve test coverage, code quality, reproducibility and tooling.
• Build experiment infrastructure around the simulator: orchestration and study management.
• Generate and maintain site data needed to simulate warehouses.
• Support scenario testing and sensitivity analysis for our order-engine and orchestration teams.
• Define, measure and reduce the sim-to-real gap against real site data.
• Turn the simulator into a RL environment with Gym-style interfaces and training runs.

Skills

PhD in CS

Python

Reinforcement Learning

Simulation

English communication

Education

PhD in CS/AI/Robotics

MSc + 5+ years exp

Tools

SimPy

Gymnasium

Job description

At Locus Robotics, we build AI-powered systems and intelligent robots that keep global supply chains running. Our platform combines advanced AI, real-time decision-making, and autonomous robotics to help leading companies improve efficiency, scale operations, and adapt to constant change.

Locus Robotics is a place to do meaningful work with real-world impact, where your ideas move quickly from concept to deployment. We invest in our people, encourage continuous learning, and give you the opportunity to grow your career while building technology that is used every day at global scale.

As an Applied AI Scientist, Simulation & Reinforcement Learning, you'll own the simulator behind SDL, our programme building a world-first, reinforcement-learning-driven orchestration framework for people and robots. That framework needs a simulator that is trustworthy enough to develop, tune and validate it before it touches a live warehouse.

You will take over day-to-day ownership of our discrete-event simulation (built on SimPy), make it measurably closer to reality, and use it as the training and evaluation ground for learning-based policies. Simulation comes first; reinforcement learning grows to be the larger part of the role as the simulator matures. You'll compare your simulations against live operational data from some of the world's largest fulfilment sites, and your work will decide what is validated and shipped to fleets of robots in customer sites worldwide.

This is not a notebook role. The simulator you own is the foundation that decides what ships to customer sites worldwide. You will work in a small, collaborative team where research meets production, as part of Applied Data Science (ADS), reporting to Oscar Mendez.

-

Location:

This is a remote position based in the United Kingdom. Candidates must reside in the UK.

Right to Work:

Candidates must have the legal right to work in the UK. Locus Robotics is unable to provide visa sponsorship for this position, now or in the future.

Responsibilities

Own the simulator

• Own and develop our SimPy-based discrete-event simulator, including its logic, design choices and the fragile areas that need care.

• Pay down technical debt: improve test coverage, code quality, reproducibility and developer tooling.

• Build the experiment infrastructure around the simulator: orchestration, study management, reporting and automated runs across benchmark sites.

• Generate and maintain site data (e.g. distance files, configs) needed to simulate customer warehouses.

• Support scenario testing and sensitivity analysis for our order-engine and orchestration teams.

Tune and close the sim2real gap

• Define, measure and reduce the sim-to-real gap against real site data.

• Run parameter optimisation and tuning studies (e.g. Optuna), and diagnose anomalies and non-determinism.

• Model warehouse processes such as congestion, picker behaviour and queueing at the right level of fidelity.

• Communicate results and confidence clearly to engineering, product and operations stakeholders.

• Use Optimization, RL & DL to tune the simulator

Grow into reinforcement learning

• Turn the simulator into a proper RL environment (Gymnasium/Gym-style interfaces) with fast, repeatable, scalable training runs.

• Design, train and evaluate RL policies, starting with guidance generation, and benchmark them against current heuristic algorithms.

• Guard against overfitting to simulator artefacts, and design experiments that show what transfers to the real world.

• Prototype, evaluate and productionise learning-based components alongside the wider ML, MLOps and OE teams.

• Stay current with RL, multi-agent systems and simulation research, and assess what is applicable to Locus.

• Contribute to internal technical papers, patents and, where appropriate, publications.

Qualifications

• A PhD in Computer Science, AI/ML, Robotics, Mathematics, Physics, Operations Research or a related quantitative field, or MSc and 5+ years of industry experience applying AI/ML or simulation to real-world problems.

• Hands-on experience building, extending or validating simulators, ideally discrete-event simulation (SimPy or similar).

• Practical experience with reinforcement learning and training simulation-based agents, including simulation for RL and Gym-style environments.

• Strong Python and software engineering fundamentals: testing, code review, maintainable and reproducible code.

• Rigorous experimental and statistical thinking: benchmarking, tuning, ablations, uncertainty.

• Experience in robotics, logistics, warehouse or other operations-heavy domains.

• Publications in major AI, ML, robotics or vision venues (e.g. NeurIPS, ICML, ICLR, AAAI, RSS, CoRL, ICRA, IROS, CVPR, ICCV, ECCV).

• Excellent English communication skills, both written and verbal, with the ability to engage diverse audiences effectively and explain uncertain results clearly to technical and non-technical audiences in a multidisciplinary environment.

The expected base salary range for this role is GBP 70,000 - 120,000based on external market data, plus bonus and equity. Actual offers will depend on factors such as the candidate's experience, education, training, key or critical skills, geographic location, and current market and business conditions.

Additional Information

Locus Robotics is an equal opportunity employer.