Senior AI Engineer: Generative AI & RAG Solutions

CVS Health; New York (NY); Hybrid; USD 83,000 - 204,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Paid time off

Retirement savings options

Wellness programs

Job summary

CVS Health is seeking an experienced AI/Generative AI engineer to design, develop, and deploy AI applications across the enterprise. You will build cloud-native services, integrate with data platforms, and ensure compliant, secure AI outcomes.

You will collaborate with product, security, and data teams to deliver scalable solutions using AWS Bedrock, GCP Vertex AI, RAG pipelines, and modern ML frameworks. A strong Python background and SAFe/Agile experience are valued.

Qualifications

• 5+ years of software/machine learning/AI engineering experience.
• 2+ years building, deploying, or supporting AI/ML or Generative AI solutions in production.
• Experience with cloud platforms such as AWS or GCP, including serverless services, APIs, event-driven architectures, or cloud-native application development.
• Proficiency in Python and experience developing scalable applications using modern software engineering practices.
• Experience with LLMs, prompt engineering, RAG architectures, vector databases, agentic workflows, or equivalent AI technologies.
• Adept at problem solving and decision-making skills.
• Adept at collaboration and teamwork.
• Adept at growth mindset (agility and developing yourself and others) skills.
• Adept at execution and delivery (planning, delivering, and supporting) skills.

Responsibilities

• Designs, develops, and deploys AI and Generative AI applications using cloud-native services and modern software engineering practices.
• Builds and maintains AI-powered solutions utilizing technologies such as AWS Bedrock, GCP Vertex AI, large language models (LLMs), and machine learning frameworks.
• Develops Retrieval-Augmented Generation (RAG) systems, including document ingestion, vector search, embeddings, and retrieval pipelines to integrate enterprise knowledge into AI applications.
• Creates, tests, and optimizes prompts, workflows, and agentic AI solutions using technologies such as Bedrock Agents, Vertex AI Agent Builder, LangChain, LangGraph, LlamaIndex, or similar frameworks.
• Develops APIs, microservices, and event-driven integrations that enable scalable and secure AI capabilities across enterprise platforms.
• Collaborates with product owners, engineers, data teams, security teams, and business stakeholders to gather requirements, recommend solutions, and deliver AI capabilities that meet business objectives.
• Writes and executes comprehensive test cases, performs debugging, conducts code reviews, monitors production performance, and resolves issues to ensure reliability and quality.
• Participates in model evaluation, deployment, monitoring, and optimization activities to improve performance, accuracy, latency, scalability, and cost efficiency.
• Implements AI solutions in compliance with security, privacy, governance, and Responsible AI standards, including HIPAA and enterprise data protection requirements.
• Creates and maintains technical documentation, including solution designs, architecture diagrams, implementation guides, and operational runbooks while sharing knowledge with team members.
• Contributes to Agile or SAFe delivery teams by participating in planning sessions, sprint activities, estimation, and continuous improvement initiatives.
• Evaluates new AI technologies, frameworks, and cloud services and recommends opportunities to improve existing solutions and engineering practices.

Skills

AI engineering

Cloud platforms

Python

LLMs

RAG architectures

Collaboration

Agile/SAFe

Education

Bachelor's degree

Tools

AWS Bedrock

GCP Vertex AI

Vector databases

LangChain

Job description

CVS Health is seeking an experienced AI/Generative AI engineer to design, develop, and deploy AI applications across the enterprise. You will build cloud-native services, integrate with data platforms, and ensure compliant, secure AI outcomes.

You will collaborate with product, security, and data teams to deliver scalable solutions using AWS Bedrock, GCP Vertex AI, RAG pipelines, and modern ML frameworks. A strong Python background and SAFe/Agile experience are valued.