Senior AI Engineer

CVS Health; New York (NY); On-site; USD 111,000 - 222,000; Full time

Job summary

CVS Health is seeking a hands-on senior AI engineer to shape production GenAI features across platforms. You will design chatbots, document intelligence tools, and AI assistants at scale, delivering real-world capabilities with strong governance and security.

You will implement RAG pipelines, coordinate AI agents, and work with LangChain, LangGraph, and other frameworks, while ensuring quality and reliability in production systems.

Qualifications

• 3+ years building enterprise or cloud-based software.
• 3+ years using Python, R, and/or Java for data analysis.
• 2+ years with CI/CD (GitHub Actions preferred).
• 2+ years on GCP, Azure, or AWS.
• 2+ years shipping AI/ML or GenAI in production.
• 1+ years with FastAPI, Flask, or Spring Boot.
• 1+ years building UIs with React.
• Hands-on experience calling LLM APIs.

Responsibilities

• Design and deliver GenAI solutions—chatbots and AI assistants.
• Implement Retrieval-Augmented Generation (RAG) pipelines.
• Build and coordinate AI agents with LangChain, LangGraph, and more.
• Connect to platforms like Azure OpenAI, Vertex AI, OpenAI, or Gemini.
• Lead prompt engineering and governance for production AI.

Skills

Python

Java

React

CI/CD GitHub Actions

GCP

FastAPI/Flask

LLM APIs

Education

Bachelor's degree in CS/Engineering/ML

Master's degree preferred

Tools

LangChain

LangGraph

LlamaIndex

CrewAI

Semantic Kernel

Kubernetes

Docker

GitHub Actions

Job description

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health®, you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time.

Do you want to drive the next level of growth for a leading national B2C healthcare brand, impacting millions of prospects and members? We're looking for a hands‑on senior ai engineer who loves building things - smart applications, powerful APIs, and AI‑driven solutions that work in production. You'll help shape how we design and deliver software across the enterprise, and you'll play a key role in bringing Generative AI from concept to reality.

Key Responsibilities

Build with Generative AI

• GenAI: Design and deliver real-world GenAI solutions - chatbots, document intelligence tools, AI assistants, and more.
• RAG: Implement Retrieval‑Augmented Generation (RAG) pipelines that combine AI reasoning with organization's own data.
• Agents: Build and coordinate AI agents using frameworks like LangChain, LangGraph, LlamaIndex, CrewAI, or Semantic Kernel.
• Platforms: Connect to leading AI platforms: Azure OpenAI, Google Vertex AI, Anthropic Claude, OpenAI, or Gemini.
• Prompt Engineering: Write and refine prompts and design patterns that make LLMs perform reliably in production.
• AI Governance: Monitor, evaluate, and govern AI systems - tracking quality, safety, and compliance.

Build & Design Software

• Own the technical design of cloud-native applications - from front-end interfaces to back-end services and everything in between.
• Build responsive web UIs using React or Angular that are fast, scalable, and user-friendly.
• Design and build REST APIs using Python (FastAPI or Flask) or Java (Spring Boot).
• Build and test prototypes quickly to enable rapid iteration and experimentation.
• Package and run applications on Google Cloud using containers and Kubernetes (GKE).

Lead & Collaborate

• Lead technical conversations and help others grow through code reviews and mentoring.
• Work in Agile sprints, contribute to CI/CD pipelines (GitHub Actions), and ship reliable software continuously.
• Guide team on good engineering practices - clean code, security, testing, and architecture.

Required Qualifications

• 3+ years building enterprise or cloud-based software
• 3+ years of experience using with Python/R and/or JAVA for data analysis
• 2+ years with CI/CD (GitHub Actions preferred)
• 2+ years on GCP, Azure, or AWS
• 2+ years shipping AI/ML or GenAI solutions in production
• 1+ years with FastAPI, Flask, or Spring Boot
• 1+ years building UIs with React
• Hands‑on experience calling LLM APIs
• Hands‑on experience in AI orchestration frameworks (LangChain, LangGraph, LlamaIndex, CrewAI, etc.)
• Hands‑on experience building RAG pipelines and integrating vector databases
• Solid prompt engineering skills
• Docker & Kubernetes deployment experience

Preferred Qualifications

• Experience with relational/NoSQL databases and knowledge of GCP cloud stores(Spanner , BigTable)
• Experience with MLOps / LLMOps practices, data engineering, analytics engineering, machine learning, NLP, or transformer model concepts
• Experience with non-relational datastores like BigQuery
• Experience with Claude, Azure OpenAI, Vertex AI, OpenAI, or Gemini
• Experience with multi-agent AI architectures
• Experience with Message Queueing or Pub/Sub systems
• Knowledge of UI design tools such as Figma
• Experience with Scrum/Agile development methodologies

Education

• Bachelor's degree in Computer Science, Engineering, Machine Learning, or related discipline
• Master's degree in above fields preferred

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is:

• $111,240.00 - $222,480.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 11/22/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.