Senior AI/ML Engineer: Production Systems & LLM Apps

Pivotal Health; Los Angeles (CA); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Competitive compensation with equity

Full health, dental, and vision

401(k) retirement savings plan

Flexible time off

Company-wide events

Job summary

Pivotal Health is seeking a Senior Applied AI/ML Engineer to design, build, and deploy production AI systems addressing healthcare and operational challenges. You will work at the intersection of machine learning, software engineering, product development, and business operations to deliver scalable AI-powered solutions.

This role is an applied AI engineering position focused on end-to-end ownership—from experimentation and model development through deployment, monitoring, and continuous

Qualifications

• 5-8+ years of experience building software systems in production environments.
• Experience building and operating applied AI, machine learning, LLM-powered, or agentic systems in production.
• Strong software engineering background, particularly with Python and backend systems that support production-scale AI applications.
• Experience designing and interpreting experiments, evaluation frameworks, benchmarks, or performance measurement systems.
• Proven ability to translate complex operational requirements and real-world data into reliable, scalable, and shipped products.
• Understanding of production engineering practices, including testing, monitoring, observability, system reliability, and safe rollouts.
• Product-oriented mindset with the ability to navigate ambiguity, make thoughtful technical decisions, and drive initiatives from concept through deployment.
• Strong communication and collaboration skills, with the ability to partner effectively across engineering, product, data, and operational teams.

Responsibilities

• Own and improve production AI systems and end-to-end solutions.
• Build LLM-powered applications, including retrieval, structured generation, tool use, and orchestration.
• Develop intelligent workflow automation to accelerate decision-making.
• Design evaluation frameworks, benchmarks, and feedback loops for model quality and reliability.
• Translate business problems into scalable AI solutions in collaboration with product and operations teams.
• Optimize prompts, retrieval strategies, and model selection for performance and reliability.
• Build reliable AI infrastructure with strong observability and safe rollout practices.

Skills

Python

Backend systems

Applied AI / ML

LLM-powered / agentic systems

Experiment design & evaluation

Production engineering & observability

Product-oriented mindset

Communication & collaboration

Job description

Pivotal Health is seeking a Senior Applied AI/ML Engineer to design, build, and deploy production AI systems addressing healthcare and operational challenges. You will work at the intersection of machine learning, software engineering, product development, and business operations to deliver scalable AI-powered solutions.

This role is an applied AI engineering position focused on end-to-end ownership—from experimentation and model development through deployment, monitoring, and continuous