Senior Principal Software Engineer - Real-Time ML & LLM

Hispanic Alliance for Career Enhancement; Columbia (SC); On-site; USD 144,200 - 288,400; Full time

Job summary

CVS Health is seeking a Principal Software Engineer to lead a real-time, multi-service clinical platform on Google Cloud. You will personally build critical components, own architecture, and mentor engineers across UI, backend, and ML.

You will design and operate production-grade LLM pipelines, ensure sub-second latency, and drive reliability, testing, and security in a regulated healthcare environment.

Qualifications

• 10+ years of software engineering experience delivering production systems at scale.
• 5+ years as a hands-on Staff or Principal-level engineer.
• Expert proficiency in Python including performance tuning, concurrency, and optimization.
• 5+ years building real-time distributed systems with latency and reliability requirements.
• 5+ years working in a major public cloud (GCP preferred).
• 3+ years building and operating production ML systems (MLOps).
• 3+ years developing LLM-powered applications in production.
• Experience building modern UI components with React or Angular.

Responsibilities

• Own architecture and execution of a real-time, multi-service clinical platform on GCP.
• Build production-grade LLM systems and prompt engineering.
• Deliver high-performance, fault-tolerant distributed services with sub-second latency.
• Operationalize ML: deployment, monitoring, drift detection, CI/CD quality controls.
• Design scalable APIs, microservices, and data contracts with strong testing and observability.
• Lead code reviews, establish testing/security standards, mentor engineers across UI, backend, and ML.
• Translate clinical and business needs into delivered solutions with ongoing data-driven iteration.
• Collaborate with Data Science, Product, and Security to meet enterprise standards.

Skills

Python

Real-time distributed systems

GCP (Vertex AI, GKE, Cloud Run)

LLM systems & MLOps

Microservices & API design

React/Angular UI

Performance optimization

Distributed systems fundamentals

Education

Bachelor's degree in Computer Science or related

Master's or PhD in Computer Science / ML

Tools

GKE

Pub/Sub

BigQuery

Vertex AI

Job description

CVS Health is seeking a Principal Software Engineer to lead a real-time, multi-service clinical platform on Google Cloud. You will personally build critical components, own architecture, and mentor engineers across UI, backend, and ML.

You will design and operate production-grade LLM pipelines, ensure sub-second latency, and drive reliability, testing, and security in a regulated healthcare environment.