Principal Real-Time AI Platform Engineer

Hispanic Alliance for Career Enhancement; Columbus (OH); On-site; USD 144,200 - 288,400; Full time

Benefits offered by this job

Medical, dental, vision coverage

Paid time off

Wellness programs

Equity award program

Job summary

CVS Health is seeking a Principal Software Engineer in Columbus, OH, to lead a real-time, multi-service clinical platform on Google Cloud. You will architect critical components and mentor engineers across UI, backend, and ML.

The role requires hands-on coding in Python and deep cloud experience. The position focuses on building scalable LLM systems, OCR-based document understanding, and high‑performance services with strong testing, observability, and CI/CD practices.

Qualifications

• 10+ years of software engineering experience with a strong record of delivering production systems at scale.
• 5+ years as a hands-on Staff or Principal-level engineer (actively coding)
• Expert proficiency in Python including performance tuning, concurrency, and system optimization
• 5+ years building real-time distributed systems (event-driven, streaming, Pub/Sub) with latency/reliability requirements
• 5+ years in major public cloud (GCP preferred: Vertex AI, GKE, Cloud Run, Pub/Sub, BigQuery)
• Deep experience with microservices architecture, API design (REST), and resilient systems
• 3+ years building and operating production ML systems (MLOps, monitoring, pipelines)
• 3+ years developing LLM-powered applications in production, including prompt design, RAG/vector search, evaluation
• Experience building UI with React or Angular
• Strong CS fundamentals, distributed systems, algorithms, concurrency

Responsibilities

• Own architecture and execution of a real-time, multi-service clinical platform on GCP
• Build production-grade LLM pipelines with prompt engineering, evaluation, retrieval, OCR-based understanding
• Deliver high-performance distributed services with sub-second clinician experiences under heavy load
• Operationalize ML on Vertex AI including feature pipelines, drift detection, and CI/CD quality controls
• Design scalable APIs and microservices with strong testing, observability, and progressive delivery
• Lead code reviews and establish standards across testing, CI/CD, security, and observability
• Translate clinical/business needs into delivered solutions and monitor real-world performance
• Collaborate with Data Science, Product, Clinical SMEs, AI Governance and Security to meet enterprise standards

Skills

Python

Real-time distributed systems

Public cloud (GCP)

REST APIs

React/Angular

Computer science fundamentals

Education

Bachelor's degree in Computer Science or related field

Master's or PhD in Computer Science / ML is a plus

Tools

Vertex AI

GKE

Cloud Run

Pub/Sub

BigQuery

Job description

CVS Health is seeking a Principal Software Engineer in Columbus, OH, to lead a real-time, multi-service clinical platform on Google Cloud. You will architect critical components and mentor engineers across UI, backend, and ML.

The role requires hands-on coding in Python and deep cloud experience. The position focuses on building scalable LLM systems, OCR-based document understanding, and high‑performance services with strong testing, observability, and CI/CD practices.