Lead Real-Time ML Platform Engineer (LLM/GCP)

Hispanic Alliance for Career Enhancement; Augusta (ME); On-site; USD 144,200 - 288,400; Full time

Job summary

CVS Health is hiring a Principal Software Engineer to lead a real-time, multi-service clinical platform on Google Cloud. You will personally build critical components, design scalable APIs, and mentor engineers across UI, backend, and ML domains.

The role emphasizes production-grade LLM systems, high performance, strong fault tolerance, and collaboration with Data Science, Product, and Security teams to ensure enterprise standards.

Qualifications

• 10+ years of software engineering delivering production systems at scale.
• 5+ years as a hands-on Staff or Principal-level engineer, coding actively.
• Expert proficiency in Python including performance tuning and concurrency.
• 5+ years building real-time distributed systems with latency requirements.
• 5+ years in a major public cloud (GCP preferred).
• Deep experience with microservices, REST APIs, and resilient systems.
• 3+ years building and operating production ML systems (MLOps).
• 3+ years developing LLM-powered applications in production.
• Experience building modern UI components with React or Angular.
• Strong CS fundamentals in distributed systems, algorithms, concurrency.

Responsibilities

• Own architecture and execution across a real-time, multi-service clinical platform on GCP.
• Build production-grade LLM systems with prompt engineering and retrieval.
• Deliver real-time, high-performance systems with sub-second latency.
• Operationalize machine learning on Vertex AI including CI/CD pipelines.
• Design scalable APIs, microservices, and data contracts.
• Raise engineering bar with testing, CI/CD, security, and observability.
• Own outcomes end-to-end translating clinical and business needs.
• Partner with Data Science, Product, Clinical SMEs, AI Governance, Security.

Skills

Python

Real-time distributed systems

GCP / Vertex AI

Microservices architecture

REST APIs

ML / MLOps

LLM applications

React/Angular UI

CS fundamentals

Education

Bachelor's degree in Computer Science or related field

Master's or PhD in Computer Science / ML

Tools

Vertex AI

GKE

Cloud Run

Pub/Sub

BigQuery

Job description

CVS Health is hiring a Principal Software Engineer to lead a real-time, multi-service clinical platform on Google Cloud. You will personally build critical components, design scalable APIs, and mentor engineers across UI, backend, and ML domains.

The role emphasizes production-grade LLM systems, high performance, strong fault tolerance, and collaboration with Data Science, Product, and Security teams to ensure enterprise standards.