Lead Real-Time AI & ML Systems Engineer

Hispanic Alliance for Career Enhancement; Annapolis (MD); On-site; USD 144,200 - 288,400; Full time

Job summary

CVS Health is seeking a Principal Software Engineer to lead a real-time, multi‑service clinical platform on Google Cloud. You will personally build critical components, design scalable APIs, and mentor engineers across UI, backend, and ML.

You will deliver production‑grade LLM pipelines, implement robust CI/CD, observability, and strong fault tolerance while ensuring clinical impact and high reliability of systems.

Qualifications

• 10+ years software engineering delivering production systems at scale.
• 5+ years as hands-on Staff or Principal-level engineer.
• Experience with real-time distributed systems with latency requirements.
• Proficient in Python including performance tuning and concurrency.
• Experience with major public clouds (GCP preferred).
• Strong CS fundamentals and API design experience.
• 3+ years operating production ML systems and LLM-powered apps.

Responsibilities

• Own architecture and execution of a real-time multi-service platform on GCP.
• Build production‑grade LLM systems with prompt engineering and evaluation.
• Deliver high‑performance, fault-tolerant distributed services with sub-second latency.
• Operationalize ML with Vertex AI, feature pipelines, drift detection, and CI/CD checks.
• Design scalable APIs, microservices, and robust data contracts.
• Lead code reviews, establish standards for testing, security, and observability.

Skills

Python

Distributed systems

GCP Vertex AI

LLM systems

CI/CD

React/Angular

Latency requirements

Education

Bachelor's in CS or related

Master's/PhD in CS or ML (plus)

Tools

Vertex AI

GKE

Cloud Run

Pub/Sub

BigQuery

Job description

CVS Health is seeking a Principal Software Engineer to lead a real-time, multi‑service clinical platform on Google Cloud. You will personally build critical components, design scalable APIs, and mentor engineers across UI, backend, and ML.

You will deliver production‑grade LLM pipelines, implement robust CI/CD, observability, and strong fault tolerance while ensuring clinical impact and high reliability of systems.