Simulation ML Engineer: Build Testing Infra for AI Agents

Second Talent; United States; Remote; USD 140,000 - 230,000; Full time

Job summary

Second Talent is recruiting an experienced Machine Learning Engineer to join the Environments team. The role centers on building simulation environments for AI coding agents to learn and refine machine learning strategies, while delivering robust testing infrastructure over large-scale ML codebases.

You will create end-to-end tests for RL frameworks, reproduce results from papers in PyTorch or Jax, and automate task and test generation to accelerate development.

Qualifications

• Experience with ML frameworks like PyTorch or Jax and deep hands-on work with ML models.
• Proven track record of training large models on large datasets in multi-GPU environments.
• Ability to learn new technologies and complex codebases rapidly.

Responsibilities

• Write an end-to-end test for a Reinforcement Learning framework to ensure reward function progresses or to detect numerical instabilities.
• Implement research-proposed algorithms (in PyTorch or Jax) and develop a comprehensive test suite to evaluate AI agent performance.
• Build automation tooling to speed up creation of new ML tasks and testing pipelines.

Skills

Python

ML frameworks

Reinforcement Learning

Multi-GPU training

Testing infrastructure

Tools

PyTorch

Jax

Job description

Second Talent is recruiting an experienced Machine Learning Engineer to join the Environments team. The role centers on building simulation environments for AI coding agents to learn and refine machine learning strategies, while delivering robust testing infrastructure over large-scale ML codebases.

You will create end-to-end tests for RL frameworks, reproduce results from papers in PyTorch or Jax, and automate task and test generation to accelerate development.