Principal Software Engineer, Real-Time ML on GCP

Hispanic Alliance for Career Enhancement; Charleston (WV); On-site; USD 144,200 - 288,400; Full time

Benefits offered by this job

Medical benefits

Dental & Vision

401(k) with company match

Job summary

CVS Health is hiring a Principal Software Engineer to lead a real‑time, multi‑service clinical platform on Google Cloud. You will personally build critical components, design scalable APIs, and mentor engineers across UI, backend, and ML. This hands‑on role emphasizes performance, reliability, and clinical impact.

You will drive ML deployment on Vertex AI, implement CI/CD with quality controls, and collaborate with Data Science, Product, and Security teams to meet enterprise standards.

Qualifications

• 10+ years delivering production systems at scale.
• 5+ years as hands-on Staff or Principal‑level engineer (actively coding).
• Expert proficiency in Python with performance tuning.
• 5+ years building real‑time distributed systems with latency goals.
• 5+ years in major public cloud (GCP preferred).
• Deep experience with microservices, REST APIs, and resilience.
• 3+ years building/operating production ML systems (MLOps).
• 3+ years developing LLM-powered apps in production (RAG, vector search).
• Experience with modern UI components (React/Angular).
• Strong CS fundamentals in distributed systems and concurrency.

Responsibilities

• Own architecture and execution of a real‑time clinical platform on GCP.
• Build production‑grade LLM systems with prompt design and evaluation.
• Deliver high‑performance, fault‑tolerant distributed services.
• Operationalize ML via Vertex AI, with CI/CD and monitoring.
• Design scalable APIs, microservices, and data contracts.
• Lead code reviews, set testing and observability standards.
• Translate clinical/business needs into delivered solutions.
• Collaborate with Data Science, Product, and Security teams.

Skills

Python

Real-time distributed systems

GCP Vertex AI

Microservices

REST APIs

LLM in production

React/Angular

Distributed systems fundamentals

Education

Bachelor's degree in Computer Science or related field

Master's or PhD in CS/ML (plus)

Tools

GCP

BigQuery

CI/CD

Job description

CVS Health is hiring a Principal Software Engineer to lead a real‑time, multi‑service clinical platform on Google Cloud. You will personally build critical components, design scalable APIs, and mentor engineers across UI, backend, and ML. This hands‑on role emphasizes performance, reliability, and clinical impact.

You will drive ML deployment on Vertex AI, implement CI/CD with quality controls, and collaborate with Data Science, Product, and Security teams to meet enterprise standards.