Senior AI/ML Engineer: Scale LLM Infra & Trust

Clutch

New York (NY)

On-site

USD 150,000 - 200,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Clutch is seeking an AI/ML Software Engineer to design, optimize, and deploy ML infrastructure and LLM workflows in a fast-paced startup environment. The role is based in New York, NY on-site, with a salary range of $150k–$200k depending on experience and DOE.

You will build pipelines for automated data labeling, model deployment, and analytical data processing, while partnering with leadership to define technical architecture and standards.

Qualifications

  • 5+ years of production software engineering experience with leadership in technical decision-making.
  • Proven track record of shipping and scaling LLM solutions, models, and AI infrastructure.
  • Strong instinct for model interpretability, evaluation metrics, and debugging AI systems.
  • Experience thriving in fast-paced start-up environments.
  • Excellent communication skills and high standards for technical quality.

Responsibilities

  • Design, optimize, and deploy ML infrastructure and LLM workflows.
  • Establish automated evaluation frameworks to benchmark model performance and bias.
  • Build pipelines for data labeling, model deployment, and analytics processing.
  • Debug model behaviors to ensure trust in mission-critical apps.
  • Collaborate with company leaders to shape architecture and engineering standards.

Skills

Production software engineering
LLM solutions
Model interpretability
Startup environments
Communication skills

Job description

Clutch is seeking an AI/ML Software Engineer to design, optimize, and deploy ML infrastructure and LLM workflows in a fast-paced startup environment. The role is based in New York, NY on-site, with a salary range of $150k–$200k depending on experience and DOE.

You will build pipelines for automated data labeling, model deployment, and analytical data processing, while partnering with leadership to define technical architecture and standards.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Engineer
AI/ML Engineer

Clutch • New York (NY)

On-site
USD 150,000 - 200,000
LLM Systems Engineer & Research
LLM Systems Engineer & Research

Scale AI, Inc. • New York (NY)

On-site
USD 189,000 - 237,000
Comprehensive health coverage
Dental and vision coverage
Retirement benefits
+3
AI/ML Software Engineer
AI/ML Software Engineer

Clutch • New York (NY)

On-site
USD 150,000 - 200,000
AI/ML Infra Engineer: Scale LLM Serving & Pipelines
AI/ML Infra Engineer: Scale LLM Serving & Pipelines

Glean • Mountain View (CA)

Hybrid
USD 175,000 - 270,000
Home office stipend
Education stipend
Wellness stipend
+1
AI Engineer
AI Engineer

scalr • New York (NY)

On-site
USD 200,000 - 300,000
LLM Platform Engineer: Scale AI Infra & Grounded LLMs
LLM Platform Engineer: Scale AI Infra & Grounded LLMs

Apply • California (MO)

On-site
USD 245,000 - 345,000
Flexible time off
Health Insurance
Work From Home Support
+8
Remote AI/ML Engineer: LLMs, RAG & Secure Cloud
Remote AI/ML Engineer: LLMs, RAG & Secure Cloud

YO AI Labs • Illinois

Remote
USD 120,000 - 180,000
LLM Platform Lead — Scalable Training & Inference
LLM Platform Lead — Scalable Training & Inference

Scale AI, Inc. • New York (NY)

On-site
USD 264,000 - 331,000
Comprehensive health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
Tech Lead Manager- MLRE, ML Systems
Tech Lead Manager- MLRE, ML Systems

Scale AI • San Francisco (CA)

On-site
USD 275,000 - 350,000
Health, dental, and vision coverage
Retirement benefits
Learning and development stipend
+2
Senior Applied ML Engineer-Remote, GenAI & LLM Deployments
Senior Applied ML Engineer-Remote, GenAI & LLM Deployments

Upstart • United States

Remote
USD 167,000 - 232,000
401(k) match
ESPP
Health coverage
+1