Machine Learning Research Engineer (Agent Data Foundation, Enterprise GenAI)

Scale AI; New York (NY); On-site; USD 180,000 - 280,000; Full time

Benefits offered by this job

Health & Wellbeing

Personal & Career Growth

Building Scale Community

Parental Support

Job summary

Scale AI's Enterprise ML Research Lab, based in New York, seeks an ML Researcher on the Data Foundation team to define data flywheels powering enterprise AI.

You will build synthetic data pipelines, create agents from production traces, and contribute to an agent-building framework, training models for deployment to customers.

PhD or MS in CS preferred; 3+ years building with LLMs in production; experience with post-training and evaluation is valued.

Qualifications

• PhD in CS or related field, or equivalent experience.
• 3+ years building with LLMs in production environments.
• Experience deploying ML solutions to enterprise customers.

Responsibilities

• Develop agents and post-training pipelines to improve system performance.
• Build synthetic data pipelines for enterprise RL environments.
• Train state-of-the-art models for deployment to customers.
• Contribute to an agent-building product leveraging proprietary algorithms.

Skills

LLM integration

Agent-building

Reinforcement learning

Education

PhD in Computer Science

Masters in Computer Science

Tools

Python

PyTorch

Job description

• The Enterprise ML Research Lab works on the front lines of this AI revolution
• We are working on an arsenal of proprietary research, tools, and resources that serve all of our enterprise clients
• As MLRE on the Data Foundation team, you’ll work on cutting edge research to define the data flywheel that makes the whole machine move
• This includes research around synthetic environments from task definitions, building agents for trace analysis, and contributing to a cutting edge framework that automatically hill-climbs agent-building from an eval set
• This will involve creating best-in-class Agents that achieve state of the art results through a combination of post-training + agent-building algorithms
• Build synthetic data pipelines to generate enterprise environments to use for RL post-training
• Create agents to convert traces from production into actionable insights to use to improve agents
• Contribute to our agent building product which can construct other agents using coding agents + proprietary algorithms
• Train state of the art models, developed both internally and from the community, to deploy to our enterprise customers

Benefits

• Health & Wellbeing: Our holistic approach to supporting Scaliens includes comprehensive health coverage, dental and vision insurance, mental healthcare services, and more. PTO policies and accommodating schedules ensure you’ll get time off when you need it to relax and recharge. Note that our offerings may vary by region as we strive to respond to the unique needs of Scaliens around the globe.
• Personal & Career Growth: Continuously learn and grow through annual learning & development stipend, attending leadership breakfasts, manager training, speaker series, and joining an ERG.
• Building Scale Community: We welcome guests to our offices, and you can expect to see Scalien families and friends around. Join local happy hours, and accept invites to game nights, book clubs, and many other employee-led community events.
• Parental Support: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life.

Publications in top conferences such as NEURIPS, ICLR, or ICML within the last two years3+ years of building with LLMs in a production environmentClear experiences with constructing high quality data to use to improve an LLM/AgentPhD or Masters in Computer Science or a related field