RL Environments Engineer: Build Realistic Training Tasks

Anysphere; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Anysphere is building the next generation of AI-assisted coding tools. We are seeking a Software Engineer for the RL Environments team at SpaceXAI to turn real-world data into training-ready environments and tasks for reinforcement learning.

You will own platforms and quality layers, collaborate with ML Platform and research teams, and help us ship faster with trustworthy data at scale.

Qualifications

• Strong software engineering fundamentals and experience with data platforms, developer tools, distributed systems, or ML infrastructure.
• Ability to turn data into training-ready environments and tasks.
• Experience building end-to-end platforms for RL environments.
• Collaborate with ML Platform, research teams, and external contributors.

Responsibilities

• Build platforms for complex, realistic RL environments at scale.
• Own end-to-end data-to-environment pipelines and quality checks.
• Create self-serve APIs and tooling for internal and external users.
• Collaborate across research, platform, and external teams to meet model-capability goals.
• Define and apply consistent quality standards across data sources.

Skills

Software engineering fundamentals

Data platforms

Distributed systems

ML infrastructure

Job description

Anysphere is building the next generation of AI-assisted coding tools. We are seeking a Software Engineer for the RL Environments team at SpaceXAI to turn real-world data into training-ready environments and tasks for reinforcement learning.

You will own platforms and quality layers, collaborate with ML Platform and research teams, and help us ship faster with trustworthy data at scale.