Principal Software Engineer - Real-Time ML & Cloud Systems

baramundi software; Richmond (VA); On-site; USD 144,200 - 288,400; Full time

Benefits offered by this job

Bonus eligibility

Comprehensive benefits

Job summary

CVS Health is seeking a Principal Software Engineer to lead a real-time, multi-service clinical platform on Google Cloud. You will personally build critical components, design scalable LLM pipelines, and ensure high performance with strict SLOs while mentoring engineers across UI, backend, and ML.

You will deploy models on Vertex AI, manage feature pipelines and drift detection, and drive CI/CD quality controls with a focus on reliability and safety for healthcare applications.

Qualifications

• 10+ years of software engineering experience delivering production systems at scale.
• 5+ years as hands-on Staff or Principal‑level engineer (actively coding).
• Expert proficiency in Python including performance tuning, concurrency, and system optimization.
• 5+ years building real-time distributed systems with latency and reliability requirements.
• 5+ years working in a major public cloud (GCP preferred).
• 3+ years building and operating production ML systems (MLOps).
• 3+ years developing LLM-powered applications in production with RAG/vector search.

Responsibilities

• Own architecture and execution of a real-time, multi-service clinical platform on GCP.
• Build production-grade LLM systems including prompt engineering and evaluation frameworks.
• Deliver real-time, high‑performance systems with sub-second latency and strong fault tolerance.
• Operationalize ML with Vertex AI deployment, feature pipelines, drift detection, and CI/CD‑integrated quality controls.
• Design flexible APIs and microservices with robust testing and observability.
• Raise engineering standards through code reviews, testing, security, and observability practices.
• Own outcomes end-to-end, translating clinical needs into delivered solutions.
• Partner with Data Science, Product, Clinical SMEs, AI Governance, and Security.

Skills

Python

LLM systems

Distributed systems

Real-time streaming

REST APIs

CI/CD

Mentoring

UI components (React/Angular)

Concurrency

Performance optimization

Education

Bachelor's degree in Computer Science

Master's or PhD in Computer Science/ML (preferred)

Tools

Vertex AI

GKE

Cloud Run

Pub/Sub

BigQuery

IAM

Job description

CVS Health is seeking a Principal Software Engineer to lead a real-time, multi-service clinical platform on Google Cloud. You will personally build critical components, design scalable LLM pipelines, and ensure high performance with strict SLOs while mentoring engineers across UI, backend, and ML.

You will deploy models on Vertex AI, manage feature pipelines and drift detection, and drive CI/CD quality controls with a focus on reliability and safety for healthcare applications.