Senior - Staff Machine Learning Engineer (Multiple Levels)

People In AI; New York (NY); On-site; USD 150,000 - 250,000; Full time

Job summary

An innovative company is seeking a Senior - Staff Machine Learning Engineer to lead the development of intelligent language models. This exciting role involves working on cutting-edge LLM-powered agents, focusing on planning, tool use, and orchestration at scale. Join a dynamic team that is pushing the boundaries of AI technology, ensuring high-quality outputs and scalable solutions. If you're passionate about machine learning and eager to make a significant impact in the field, this is the perfect opportunity for you.

Benefits

Medical Insurance

Child Care Support

Paid Maternity Leave

Paid Paternity Leave

401(k)

Vision Insurance

Qualifications

• Experience in building production ML systems with strong iteration speed.
• Deep familiarity with language models and transformer architectures.

Responsibilities

• Design and implement LLM-based agents for multi-step reasoning.
• Collaborate with product teams to deliver scalable LLM capabilities.

Skills

Machine Learning

Language Models

Transformer Architectures

Prompt Engineering

Systems Thinking

Education

Bachelor's Degree in Computer Science or Related Field

Master's Degree in Machine Learning or AI

Tools

LangChain

ReAct

AutoGPT

Job description

Senior - Staff Machine Learning Engineer (Multiple Levels)

2 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

This range is provided by People In AI. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$150,000.00/yr - $250,000.00/yr

Placing the Top AI and Machine Learning Talent

Senior - Staff Machine Learning Engineer (Multiple Levels) – On-Site (NYC)

$175,000–$250,000 base + equity

5 days/week on-site in NYC

Build the Future of Intelligent Language Agents

My client is hiring Machine Learning Engineers to lead the development of intelligent LLM-powered agents designed for real-world structured workflows. This is a role for someone who wants to live at the frontier of applied language models—working deeply on planning, tool use, memory, and orchestration at production scale.

This team is building infrastructure and systems that push LLMs far beyond chat interfaces. You’ll be part of a fast-moving, technically rigorous group deploying multi-agent language systems with measurable performance in live environments.

Responsibilities:

• Design and implement LLM-based agents capable of autonomous multi-step reasoning and execution
• Build infrastructure for memory, tool use, action planning, and recovery from hallucination or error
• Lead evaluations of LLM output quality, latency, and reliability in production environments
• Contribute to core experimentation frameworks—supporting rapid iteration on agent design
• Stay current with the latest research in multi-agent coordination, RAG, and system-level optimization
• Collaborate closely with product and infra teams to deliver resilient, scalable LLM capabilities

Qualifications:

• Commercial experience in machine learning or applied AI, with a strong focus on language models
• Deep familiarity with transformer architectures, retrieval-augmented generation (RAG), prompt engineering, and LLM fine-tuning
• Experience working with open-source agent frameworks (e.g., LangChain, ReAct, AutoGPT)
• Proven ability to build production ML systems with strong iteration speed and reliability
• Strong systems thinking and comfort in ambiguous, high-ownership environments
• Bonus: prior work with long-context models, memory systems, or model evaluation infrastructure

This is a full-time, in-person role based in New York City (5 days/week on-site). If you're eager to be at the center of LLM innovation and want to push agents beyond the lab and into production, we’d love to connect.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Engineering, Research, and Production

Industries

• Accounting, Financial Services, and Research Services

Referrals increase your chances of interviewing at People In AI by 2x

Inferred from the description for this job

Medical insurance

Child care support

Paid maternity leave

Paid paternity leave

401(k)

Vision insurance

Get notified about new Machine Learning Engineer jobs in New York, United States.

New York, NY $170,000.00-$250,000.00 2 weeks ago

Bethpage, NY $100,246.00-$164,689.00 5 days ago

New York, NY $132,000.00-$184,000.00 2 weeks ago

New York, NY $56.25-$173,000.00 2 weeks ago

Software Engineer (L4) - Ads Measurement

New York, United States $100,000.00-$720,000.00 1 week ago

New York, NY $46.63-$134,000.00 2 weeks ago

New York, NY $140,000.00-$200,000.00 6 months ago

New York, NY $140,000.00-$200,000.00 6 months ago

New York, NY $90,000.00-$140,000.00 11 months ago

Machine Learning Engineer, Stripe Capital

New York, NY $164,000.00-$198,000.00 1 week ago

New York, NY $190,000.00-$320,000.00 2 months ago

New York, NY $95,000.00-$140,000.00 2 months ago

Machine Learning, Software Engineer (Remote)

New York, NY $190,000.00-$240,000.00 1 month ago

New York, NY $190,000.00-$240,000.00 1 month ago

New York, United States $120,000.00-$240,000.00 4 months ago

New York, NY $160,000.00-$280,000.00 11 months ago

New York, NY $150,000.00-$400,000.00 2 months ago

Brooklyn, NY $190,000.00-$220,000.00 1 week ago

New York, NY $180,000.00-$240,000.00 2 weeks ago

New York, NY $114,000.00-$171,000.00 2 weeks ago

New York, NY $110,000.00-$250,000.00 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.