Senior GenAI Platform Engineer (Backend/Infra)

CVS Health Corporation; Austin (TX); On-site; USD 93,000 - 185,000; Full time

Benefits offered by this job

Medical insurance

Dental and vision coverage

Paid time off

Retirement plan

Wellness programs

Job summary

CVS Health is seeking a senior software engineer to lead the design and build of foundational AI/GenAI platform services. You’ll work on LLM routing, cost governance, and internal tooling for AI-assisted software development, focusing on safe, scalable, and compliant GenAI infrastructure.

The team operates at the intersection of platform engineering and applied GenAI. The role emphasizes collaboration with senior engineers, and a passion for exploring new AI tooling while delivering practical

Qualifications

• 5+ years of professional software engineering experience, including 2+ years building production backend services in Python and/or TypeScript/Node.js.
• 2+ years of experience designing and building RESTful APIs or microservices using frameworks such as FastAPI, Flask, Express, or NestJS.
• Experience integrating with one or more LLM/AI provider APIs in a production system.
• Experience with at least one major cloud provider (AWS, Azure, or GCP).
• Experience with Redis, Kafka, and MongoDB in a production environment.
• Experience with OAuth2/OIDC or JWT-based authentication and authorization systems.
• Experience with observability/telemetry tooling (OpenTelemetry, Prometheus, Grafana, Langfuse, Datadog).
• Experience with containerized applications (Docker) and CI/CD pipelines.
• Experience with version control systems (Git) and code review processes.

Responsibilities

• Design and build core platform services across auth, quota/cost management, observability, and routing policy.
• Collaborate with senior engineers to define next-gen AI services for GenAI landscape.
• Help ensure fast, safe, and cost-effective engineering with LLMs in healthcare environments (PHI/PII, HIPAA).

Skills

Python

TypeScript/Node.js

REST APIs

LLM/AI APIs

Cloud (AWS/Azure/GCP)

Docker

CI/CD

Git & code review

Observability tooling

Databases (Redis, Kafka, MongoDB)

Education

Bachelor's degree in CS/Math/Engineering

Master’s degree preferred

Tools

FastAPI

Flask

Express

NestJS

OpenTelemetry

Prometheus

Grafana

Langfuse

Datadog

Job description

CVS Health is seeking a senior software engineer to lead the design and build of foundational AI/GenAI platform services. You’ll work on LLM routing, cost governance, and internal tooling for AI-assisted software development, focusing on safe, scalable, and compliant GenAI infrastructure.

The team operates at the intersection of platform engineering and applied GenAI. The role emphasizes collaboration with senior engineers, and a passion for exploring new AI tooling while delivering practical