Senior Real-Time LLM & AI Platforms Engineer

Hispanic Alliance for Career Enhancement; Lansing (MI); On-site; USD 144,200 - 288,400; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Retirement savings options

Paid time off

Wellness programs

Equity awards

Bonus/incentive program

Job summary

CVS Health is seeking a Principal Software Engineer to lead real-time, multi-service clinical platforms on Google Cloud. You’ll personally build critical components, design scalable APIs, and drive ML pipelines end-to-end.

You will mentor engineers across UI, backend and ML, implement strict SLOs, and ensure compliance and data governance while delivering high‑quality software to improve patient care.

Qualifications

• 10+ years of software engineering experience delivering production systems at scale.
• 5+ years as a hands‑on Staff or Principal‑level engineer (actively coding).
• Expert proficiency in Python including performance tuning.
• 5+ years building real‑time distributed systems with latency requirements.
• 5+ years working in a major public cloud (GCP preferred).
• Deep experience with microservices, REST, and resilient systems.
• 3+ years building and operating production ML systems (MLOps).
• 3+ years developing LLM-powered applications in production.

Responsibilities

• Own architecture and execution of a real-time, multi-service platform on GCP.
• Build production‑grade LLM systems with prompt design and evaluation frameworks.
• Deliver high‑performance, sub-second clinician experiences under heavy load.
• Operationalize models on Vertex AI including feature pipelines and drift detection.
• Design scalable APIs, microservices, and data contracts with strong testing and observability.
• Mentor engineers across full‑stack and ML disciplines and promote best practices.
• Translate clinical and business needs into delivered solutions and monitor real‑world performance.
• Collaborate with Data Science, Product, Clinical SMEs, AI Governance, and Security.

Skills

Python

Performance tuning

Concurrency

Distributed systems

Cloud (GCP)

REST APIs

React/Angular

ML / MLOps

LLM systems

CI/CD

Education

Bachelor's in Computer Science

Master's/PhD in CS or ML (plus)

Tools

Vertex AI

GKE

Cloud Run

Pub/Sub

BigQuery

Kubernetes

Vector databases

LLM pipelines

Job description

CVS Health is seeking a Principal Software Engineer to lead real-time, multi-service clinical platforms on Google Cloud. You’ll personally build critical components, design scalable APIs, and drive ML pipelines end-to-end.

You will mentor engineers across UI, backend and ML, implement strict SLOs, and ensure compliance and data governance while delivering high‑quality software to improve patient care.