Applied AI Scientist, Simulation & Reinforcement Learning

Locus Robotics; Greater London; Remote; GBP 70,000 - 120,000; Full time

Job summary

Locus Robotics in the United Kingdom is seeking an Applied AI Scientist to own the simulator behind SDL, a reinforcement-learning driven orchestration framework for people and robots. You will work at the interface of research and production within the Applied Data Science team, reporting to Oscar Mendez.

The role centers on advancing a discrete-event simulator (SimPy), reducing the sim-to-real gap, and maturing RL-based policies for warehouse operations on a global scale.

Qualifications

• PhD or MSc with significant AI/ML or simulation experience.
• Hands-on with simulators, preferably discrete-event simulation (SimPy).
• Experience with RL and training simulation-based agents.
• Strong Python and software engineering fundamentals.
• Publications in AI/ML/robotics venues are a plus.
• Excellent English communication skills.

Responsibilities

• Own and develop the SimPy-based discrete-event simulator, including its logic and fragile areas.
• Improve test coverage, code quality, reproducibility and tooling.
• Build experiment infrastructure around the simulator: orchestration, study management, reporting and automated runs.
• Generate and maintain site data needed to simulate warehouses.
• Support scenario testing and sensitivity analyses for order-engineering teams.
• Turn the simulator into a RL environment and design, train, evaluate RL policies.
• Prototype and productionise learning components with ML and MLOps teams.

Skills

Python

Reinforcement learning

Simulation

Experiment design

Communication

Education

PhD in CS/AI/ML/Robotics or related field

MSc + 5+ years industry experience

Tools

SimPy

Gymnasium

Python

Job description

Applied AI Scientist, Simulation & Reinforcement Learning

London, England

At Locus Robotics, we build AI-powered systems and intelligent robots that keep global supply chains running. Our platform combines advanced AI, real-time decision-making, and autonomous robotics to help leading companies improve efficiency, scale operations, and adapt to constant change.

Locus Robotics is a place to do meaningful work with real-world impact, where your ideas move quickly from concept to deployment. We invest in our people, encourage continuous learning, and give you the opportunity to grow your career while building technology that is used every day at global scale.

As an Applied AI Scientist, Simulation & Reinforcement Learning, you'll own the simulator behind SDL, our programme building a world-first, reinforcement-learning-driven orchestration framework for people and robots. That framework needs a simulator that is trustworthy enough to develop, tune and validate it before it touches a live warehouse.
You will take over day-to-day ownership of our discrete-event simulation (built on SimPy), make it measurably closer to reality, and use it as the training and evaluation ground for learning-based policies. Simulation comes first; reinforcement learning grows to be the larger part of the role as the simulator matures. You'll compare your simulations against live operational data from some of the world's largest fulfilment sites, and your work will decide what is validated and shipped to fleets of robots in customer sites worldwide.
This is not a notebook role. The simulator you own is the foundation that decides what ships to customer sites worldwide. You will work in a small, collaborative team where research meets production, as part of Applied Data Science (ADS), reporting to Oscar Mendez.

Location: This is a remote position based in the United Kingdom. Candidates must reside in the UK.

Right to Work: Candidates must have the legal right to work in the UK. Locus Robotics is unable to provide visa sponsorship for this position, now or in the future.

Responsibilities
Own the simulator

• Own and develop our SimPy-based discrete-event simulator, including its logic, design choices and the fragile areas that need care.
• Pay down technical debt: improve test coverage, code quality, reproducibility and developer tooling.
• Build the experiment infrastructure around the simulator: orchestration, study management, reporting and automated runs across benchmark sites.
• Generate and maintain site data (e.g. distance files, configs) needed to simulate customer warehouses.
• Support scenario testing and sensitivity analysis for our order-engine and orchestration teams.

Tune and close the sim2real gap

• Define, measure and reduce the sim-to-real gap against real site data.
• Run parameter optimisation and tuning studies (e.g. Optuna), and diagnose anomalies and non-determinism.
• Model warehouse processes such as congestion, picker behaviour and queueing at the right level of fidelity.
• Communicate results and confidence clearly to engineering, product and operations stakeholders.
• Use Optimization, RL & DL to tune the simulator

Grow into reinforcement learning

• Turn the simulator into a proper RL environment (Gymnasium/Gym-style interfaces) with fast, repeatable, scalable training runs.
• Design, train and evaluate RL policies, starting with guidance generation, and benchmark them against current heuristic algorithms.
• Guard against overfitting to simulator artefacts, and design experiments that show what transfers to the real world.
• Prototype, evaluate and productionise learning-based components alongside the wider ML, MLOps and OE teams.
• Stay current with RL, multi-agent systems and simulation research, and assess what is applicable to Locus.
• Contribute to internal technical papers, patents and, where appropriate, publications.

Qualifications

• A PhD in Computer Science, AI/ML, Robotics, Mathematics, Physics, Operations Research or a related quantitative field, or MSc and 5+ years of industry experience applying AI/ML or simulation to real-world problems.
• Hands-on experience building, extending or validating simulators, ideally discrete-event simulation (SimPy or similar).
• Practical experience with reinforcement learning and training simulation-based agents, including simulation for RL and Gym-style environments.
• Strong Python and software engineering fundamentals: testing, code review, maintainable and reproducible code.
• Rigorous experimental and statistical thinking: benchmarking, tuning, ablations, uncertainty.Experience in robotics, logistics, warehouse or other operations-heavy domains.
• Publications in major AI, ML, robotics or vision venues (e.g. NeurIPS, ICML, ICLR, AAAI, RSS, CoRL, ICRA, IROS, CVPR, ICCV, ECCV).
• Excellent English communication skills, both written and verbal, with the ability to engage diverse audiences effectively and explain uncertain results clearly to technical and non-technical audiences in a multidisciplinary environment.

The expected base salary range for this role is GBP 70,000 - 120,000based on external market data, plus bonus and equity. Actual offers will depend on factors such as the candidate's experience, education, training, key or critical skills, geographic location, and current market and business conditions.

Additional Information

Locus Robotics is an equal opportunity employer.

Application Fraud Detection Notice: To help maintain a fair and secure hiring process, Locus Robotics may use AI-assisted and other automated tools to detect suspected fraud, misrepresentation, or misuse of the application process. Hiring decisions are not made solely by automated means unless otherwise disclosed where required by law.