Senior Software Engineer - AI & Cloud Platforms

CVS Health; New York (NY); On-site; USD 111,000 - 222,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Paid time off

Retirement savings options

Wellness programs

Job summary

CVS Health is seeking a hands-on senior engineer to drive GenAI and cloud-native software across the enterprise. You will build real-world GenAI solutions, design RAG pipelines, and orchestrate agents using leading frameworks.

Expect collaboration on platform integrations with Azure OpenAI, Vertex AI, OpenAI, Gemini, and more. You will also own front-end and back-end design, craft REST APIs in Python/Java, and ship reliable software in Agile sprints with CI/CD, Kubernetes, and modern tooling.

Qualifications

• 3+ years building enterprise or cloud-based software.
• 3+ years with Python, R and/or Java for data analysis.
• 2+ years with CI/CD (GitHub Actions preferred).
• 2+ years on GCP, Azure, or AWS.
• 2+ years shipping AI/ML or GenAI solutions in production.
• 1+ years with FastAPI, Flask, or Spring Boot.
• 1+ years building UIs with React.
• Hands-on experience calling LLM APIs.
• Hands-on experience in AI orchestration frameworks (LangChain, LangGraph, LlamaIndex, CrewAI, etc.).
• Hands-on experience building RAG pipelines and integrating vector databases.
• Solid prompt engineering skills.
• Docker & Kubernetes deployment experience.

Responsibilities

• GenAI: design and deliver real-world GenAI solutions including chatbots and AI assistants.
• RAG pipelines: implement knowledge retrieval using organization's data.
• Coordinate AI agents with frameworks like LangChain, LangGraph, LlamaIndex, CrewAI, or Semantic Kernel.
• Connect to platforms: Azure OpenAI, Vertex AI, OpenAI, Gemini.
• Prompt engineering: craft prompts and patterns for reliable production LLMs.
• AI governance: monitor quality, safety, and compliance.
• Own the technical design of cloud-native apps, from UI to backend.
• Build responsive UIs using React or Angular; design REST APIs with Python or Java.
• Prototype rapidly for iteration; deploy on Google Cloud using Kubernetes.
• Lead technical discussions; mentor teammates; contribute to CI/CD and best practices.

Skills

Python

Java

R

AI deployment

LLM APIs

Prompt engineering

React

Kubernetes

Docker

LangChain

LangGraph

LlamaIndex

CrewAI

RAG pipelines

Education

Bachelor's degree in Computer Science, Engineering, ML or related discipline

Master's degree preferred

Tools

GitHub Actions

GCP

Azure

AWS

FastAPI

Flask

Spring Boot

Google Cloud Platform (GCP)

Kubernetes (GKE)

LangChain / LangGraph / LlamaIndex

Job description

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health®, you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time.

Do you want to drive the next level of growth for a leading national B2C healthcare brand, impacting millions of prospects and members? We're looking for a hands-on senior engineer who loves building things - smart applications, powerful APIs, and AI-driven solutions that work in production. You'll help shape how we design and deliver software across the enterprise, and you'll play a key role in bringing Generative AI from concept to reality.

Key Responsibilities

• Build with Generative AI
  • GenAI: Design and deliver real-world GenAI solutions - chatbots, document intelligence tools, AI assistants, and more.
  • RAG: Implement Retrieval-Augmented Generation (RAG) pipelines that combine AI reasoning with organization's own data.
  • Agents: Build and coordinate AI agents using frameworks like LangChain, LangGraph, LlamaIndex, CrewAI, or Semantic Kernel.
  • Platforms: Connect to leading AI platforms: Azure OpenAI, Google Vertex AI, Anthropic Claude, OpenAI, or Gemini.
  • Prompt Engineering: Write and refine prompts and design patterns that make LLMs perform reliably in production.
  • AI Governance: Monitor, evaluate, and govern AI systems - tracking quality, safety, and compliance.
• Build & Design Software
  • Own the technical design of cloud-native applications - from front-end interfaces to back-end services and everything in between.
  • Build responsive web UIs using React or Angular that are fast, scalable, and user-friendly.
  • Design and build REST APIs using Python (FastAPI or Flask) or Java (Spring Boot).
  • Build and test prototypes quickly to enable rapid iteration and experimentation.
  • Package and run applications on Google Cloud using containers and Kubernetes (GKE).
• Lead & Collaborate
  • Lead technical conversations and help others grow through code reviews and mentoring.
  • Work in Agile sprints, contribute to CI/CD pipelines (GitHub Actions), and ship reliable software continuously.
  • Guide team on good engineering practices - clean code, security, testing, and architecture.

Required Qualifications

• 3+ years building enterprise or cloud-based software
• 3+ years of experience using with Python/R and/or JAVA for data analysis
• 2+ years with CI/CD (GitHub Actions preferred)
• 2+ years on GCP, Azure, or AWS
• 2+ years shipping AI/ML or GenAI solutions in production
• 1+ years with FastAPI, Flask, or Spring Boot
• 1+ years building UIs with React
• Hands-on experience calling LLM APIs
• Hands-on experience in AI orchestration frameworks (LangChain, LangGraph, LlamaIndex, CrewAI, etc.)
• Hands-on experience building RAG pipelines and integrating vector databases
• Solid prompt engineering skills
• Docker & Kubernetes deployment experience

Preferred Qualifications

• Experience with relational/NoSQL databases and knowledge of GCP cloud stores(Spanner , BigTable)
• Experience with MLOps / LLMOps practices, data engineering, analytics engineering, machine learning, NLP, or transformer model concepts
• Experience with non-relational datastores like BigQuery
• Experience with Claude, Azure OpenAI, Vertex AI, OpenAI, or Gemini
• Experience with multi-agent AI architectures
• Experience with Message Queueing or Pub/Sub systems
• Knowledge of UI design tools such as Figma
• Experience with Scrum/Agile development methodologies

Education

• Bachelor's degree in Computer Science, Engineering, Machine Learning, or related discipline
• Master's degree in above fields preferred

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is:

$111,240.00 - $222,480.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full-time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 11/22/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.