Principal Software Engineer - Real-Time ML & Systems Leader

Hispanic Alliance for Career Enhancement

Harrisburg (Dauphin County)

On-site

USD 144,200 - 288,400

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Bonus eligibility

Equity awards

Job summary

CVS Health is seeking a Principal Software Engineer to lead a real‑time, multi‑service clinical platform on Google Cloud. You will personally build critical performance‑sensitive components and mentor engineers across UI, backend, and ML.

The role emphasizes production ML workflows, prompt design, RAG/vector search, and scalable API design amid strict reliability targets. A strong track record in distributed systems and cloud‑native delivery is essential.

Qualifications

10+ years of software engineering experience delivering production systems at scale.
5+ years as hands‑on Staff or Principal‑level engineer.
Expert proficiency in Python including performance tuning and concurrency.
5+ years building real‑time distributed systems with latency requirements.
5+ years in a major public cloud (GCP preferred).
3+ years building/operating production ML systems (MLOps).
3+ years developing LLM‑powered applications in production.

Responsibilities

Own architecture and execution of a real‑time, multi‑service platform on GCP.
Build production‑grade LLM systems with prompt engineering and evaluation frameworks.
Deliver high‑performance, fault‑tolerant, low‑latency systems.
Operationalize ML models on Vertex AI including CI/CD and drift detection.
Design scalable APIs, microservices, and robust data contracts.
Lead code reviews, establish testing standards, and mentor engineers.
Translate clinical/business needs into deployed solutions and monitor outcomes.
Collaborate with Data Science, Product, Clinical SMEs, AI Governance, and Security.