Senior/Staff Software Engineer, AI/ML

Recruiting from Scratch

United States

Hybrid

USD 220,000 - 300,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Recruiting from Scratch is recruiting a Senior/Staff Software Engineer, AI/ML for a healthcare AI platform. Location: New York, NY / San Francisco, CA / Seattle, WA, with hybrid or remote eligibility.

You will design and deploy AI-powered applications, build LLM systems, and own AI product development from architecture to production. You’ll work with OpenAI APIs, Vertex AI, PyTorch, and TensorFlow, collaborating with product, data, and engineering teams to deliver scalable AI-native healthcare

Qualifications

  • 6-15 years of experience in software engineering or AI/ML engineering roles.
  • Strong Python engineering experience.
  • Experience shipping production AI products from 0-to-1.

Responsibilities

  • Design, build, and deploy end-to-end AI-powered applications and infrastructure.
  • Build production-grade LLM systems using RAG, agent frameworks, orchestration layers, and modern AI tooling.
  • Develop AI-powered chatbots, recommendation engines, search systems, and intelligent workloads.
  • Own AI/ML product development from 0-to-1, from architecture through production deployment.
  • Design scalable ML pipelines for experimentation, fine-tuning, evaluation, and deployment.
  • Work closely with product, data, analytics, and engineering teams to deliver AI-native product experiences.
  • Build backend systems and APIs supporting AI workloads and inference pipelines.
  • Drive technical architecture and engineering best practices across AI systems.
  • Work with modern AI platforms including OpenAI APIs, Vertex AI, PyTorch, TensorFlow, and agent frameworks.
  • Translate healthcare and user data into intelligent, production-ready AI systems.
  • Contribute to AI platform strategy and help shape the company’s long-term AI roadmap.
  • Operate autonomously in a fast-moving, highly ambiguous AI product environment.
  • Balance rapid iteration with scalability, safety, reliability, and performance.
  • Collaborate cross-functionally with product and business stakeholders to identify impactful AI opportunities.
  • Stay current with emerging LLM, RAG, and agentic AI technologies and integrate them into production systems.

Skills

Python
Backend engineering
AI/ML engineering
LLM systems
RAG architectures
Agent frameworks
Production AI
Distributed systems
System design
OpenAI APIs

Tools

Vertex AI
LangChain
LlamaIndex
PyTorch
TensorFlow

Job description

Who is Recruiting from Scratch: Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire. Senior/Staff Software Engineer, AI/ML Location: New York, NY / San Francisco, CA / Seattle, WA (Hybrid or Remote Eligible) Company Stage of Funding: Late-Stage Growth / Series F+ Office Type: Hybrid (NYC 3x/week) or Remote in approved hub cities Salary: $220,000 - $300,000 + Competitive Equity Visa: No sponsorship available

Company Description Our client is building the world’s largest virtual clinic for women and families, serving over 2,000 employers and health plans globally. They are becoming an AI-native healthcare organization and are building foundational AI infrastructure that powers critical experiences across their platform - including chatbots, recommendation engines, search, intelligent workflows, and GenAI-powered healthcare experiences. Backed by top-tier investors including Sequoia, General Catalyst, Dragoneer, and Lux Capital, the company has raised over $425M and is operating at massive scale across fertility, maternity, pediatrics, menopause, and family healthcare. This is an opportunity to join a foundational AI engineering team where you will directly shape the future of AI-powered healthcare products used by millions of users.

What You Will Do
  • Design, build, and deploy end-to-end AI-powered applications and infrastructure
  • Build production-grade LLM systems using RAG, agent frameworks, orchestration layers, and modern AI tooling
  • Develop AI-powered chatbots, recommendation engines, search systems, and intelligent workloads
  • Own AI/ML product development from 0-to-1, from architecture through production deployment
  • Design scalable ML pipelines for experimentation, fine-tuning, evaluation, and deployment
  • Work closely with product, data, analytics, and engineering teams to deliver AI-native product experiences
  • Build backend systems and APIs supporting AI workloads and inference pipelines
  • Drive technical architecture and engineering best practices across AI systems
  • Work with modern AI platforms including OpenAI APIs, Vertex AI, PyTorch, TensorFlow, and agent frameworks
  • Translate healthcare and user data into intelligent, production-ready AI systems
  • Contribute to AI platform strategy and help shape the company’s long-term AI roadmap
  • Operate autonomously in a fast-moving, highly ambiguous AI product environment
  • Balance rapid iteration with scalability, safety, reliability, and performance
  • Collaborate cross-functionally with product and business stakeholders to identify impactful AI opportunities
  • Stay current with emerging LLM, RAG, and agentic AI technologies and integrate them into production systems
Ideal Candidate Background
  • 6-15 years of experience in software engineering or AI/ML engineering roles
  • Strong software engineering foundation with backend-heavy product engineering experience
  • Experience building AI/ML products end-to-end in production environments
  • Hands-on experience with LLMs, RAG systems, and agent frameworks
  • Experience shipping production AI products from 0-to-1
  • Strong Python engineering experience
  • Experience with chatbot systems, recommendation engines, search, or GenAI applications
  • Experience working across the full ML lifecycle including ingestion, preprocessing, training, deployment, and monitoring
  • Strong distributed systems and backend architecture skills
  • Experience collaborating closely with product and cross-functional teams
  • Comfortable operating autonomously in fast-moving startup or high-growth environments
  • Strong builder mentality with high ownership and execution ability
  • Comfortable writing production-grade code without heavy AI tooling dependence
  • Ability to explain AI systems and technical tradeoffs clearly to non-technical stakeholders
  • Strong Signals
  • Experience building production LLM applications at scale
  • Experience with RAG architectures and retrieval pipelines in production
  • Experience with AI agent frameworks and orchestration systems
  • Experience building chatbot, recommendation, or intelligent search systems
  • Strong backend engineering foundation transitioning into AI/ML
  • Experience with OpenAI APIs, Vertex AI, LangChain, LlamaIndex, or similar tooling
  • Healthcare or digital health AI experience
  • Experience handling high-volume production AI workloads
  • Experience measuring production AI system performance and reliability
  • Strong product-minded engineering instincts
  • Experience working at high-growth product companies
  • Experience owning projects from architecture through deployment
  • Experience balancing ML experimentation with production engineering rigor
  • Strong understanding of distributed systems and scalable infrastructure
  • Experience working with PyTorch or TensorFlow
  • Strong coding interview and system design capability
  • Ability to discuss production metrics, scale, and operational performance of AI systems
  • Experience building AI features with meaningful user or business impact
  • Experience working on AI-powered user-facing products instead of purely internal ML infrastructure
Compensation and Benefits
  • Base salary: $220,000 - $300,000
  • Competitive equity package
  • Opportunity to help build foundational AI infrastructure at massive scale
  • Work directly on cutting-edge AI systems impacting millions of healthcare users
  • Exposure to advanced LLM, RAG, and agentic AI deployment challenges
  • Strong technical ownership and autonomy
  • High-growth healthcare AI company trajectory
  • Backed by Sequoia, General Catalyst, and other top-tier investors
  • Collaborative, product-focused AI engineering culture
Why Join

This is an opportunity to join one of the most ambitious AI transformations happening in healthcare today. You'll work on foundational AI systems powering healthcare experiences at massive scale while helping define how AI-native healthcare products get built responsibly and effectively. If you enjoy building production AI systems, shipping 0-to-1 AI products, solving hard engineering problems, and operating at the intersection of backend engineering and modern AI infrastructure, this role offers exceptional scope and impact.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Product
Software Engineer, Product

Recruiting from Scratch • United States

Remote
USD 140,000 - 225,000
Remote-First
Competitive equity
Direct collaboration with engineering/
+1
Software Engineer, AI Agents
Software Engineer, AI Agents

Recruiting from Scratch • United States

Remote
USD 200,000 - 320,000
Remote-First Environment
Visa Sponsorship Available
Competitive Equity
+2
Staff AI Engineer
Staff AI Engineer

Qualified Health PBC • United States

Hybrid
USD 230,000 - 280,000
Equity
Medical/Dental/Vision insurance
Hybrid work options
+1
Senior AI Engineer
Senior AI Engineer

Re:Sourced. • New York (NY)

Hybrid
USD 180,000 - 260,000
Performance bonuses
Fund performance bonus
Group ESOP
+2
Director of Machine Learning (Healthcare AI)
Director of Machine Learning (Healthcare AI)

Nxt Level • United States

Hybrid
USD 150,000 - 200,000
Competitive salary
Meaningful equity
Direct line to CEO
+1
Senior AI Engineer – Agents
Senior AI Engineer – Agents

MiraMace, Inc. • San Francisco (CA)

On-site
USD 150,000 - 210,000
Staff Software Engineer
Staff Software Engineer

Edge Tech • New York (NY)

Hybrid
USD 220,000 - 300,000
Fully paid parental leave
Access to healthcare platform
Professional development stipend
+3
Sr. Staff AI Engineer
Sr. Staff AI Engineer

Qualified Health PBC • United States

Remote
USD 250,000 - 310,000
Equity
Medical insurance
Dental insurance
+3
Sr. Staff AI Engineer
Sr. Staff AI Engineer

Qualified Health PBC • Palo Alto (CA)

Hybrid
USD 250,000 - 310,000
Equity packages
Medical/dental/vision insurance
Flexible working hours
+2
Sr. Staff AI Engineer
Sr. Staff AI Engineer

Qualified Health • Palo Alto (CA)

On-site
USD 250,000 - 310,000
Equity
Medical/dental/vision insurance
Flexible working hours
+1