Senior Generative AI Engineer - Cloud-Native & RAG

CVS Health; City of Albany (NY); On-site; USD 83,000 - 204,000; Full time

Benefits offered by this job

Comprehensive benefits

Bonus eligibility

Job summary

CVS Health is seeking an experienced AI/ML engineer to design, develop, and deploy Generative AI solutions across the enterprise. You will craft scalable, secure AI applications on cloud platforms, implement RAG pipelines, and collaborate with cross‑functional teams to deliver measurable business value.

Ideal candidates bring 5+ years in software/AI engineering, hands-on cloud experience (AWS/GCP), Python expertise, and a strong foundation in responsible AI practices within healthcare contexts.

Qualifications

• 5+ years of software engineering, machine learning engineering, or AI engineering experience.
• 2+ years of experience building, deploying, or supporting AI/ML or Generative AI solutions in production.
• Experience with cloud platforms such as AWS or GCP, including serverless services, APIs, event-driven architectures, or cloud-native application development.
• Proficiency in Python and experience developing scalable applications using modern software engineering practices.
• Experience with LLMs, prompt engineering, RAG architectures, vector databases, agentic workflows, or equivalent AI technologies.

Responsibilities

• Designs, develops, and deploys AI and Generative AI applications using cloud-native services and modern software engineering practices.
• Builds and maintains AI-powered solutions utilizing technologies such as AWS Bedrock, GCP Vertex AI, large language models (LLMs), and machine learning frameworks.
• Develops Retrieval-Augmented Generation (RAG) systems, including document ingestion, vector search, embeddings, and retrieval pipelines to integrate enterprise knowledge into AI applications.
• Creates, tests, and optimizes prompts, workflows, and agentic AI solutions using technologies such as Bedrock Agents, Vertex AI Agent Builder, LangChain, LangGraph, LlamaIndex, or similar frameworks.
• Develops APIs, microservices, and event-driven integrations that enable scalable and secure AI capabilities across enterprise platforms.
• Collaborates with product owners, engineers, data teams, security teams, and business stakeholders to gather requirements, recommend solutions, and deliver AI capabilities that meet business objectives.
• Writes and executes comprehensive test cases, performs debugging, conducts code reviews, monitors production performance, and resolves issues to ensure reliability and quality.
• Participates in model evaluation, deployment, monitoring, and optimization activities to improve performance, accuracy, latency, scalability, and cost efficiency.
• Implements AI solutions in compliance with security, privacy, governance, and Responsible AI standards, including HIPAA and enterprise data protection requirements.
• Creates and maintains technical documentation, including solution designs, architecture diagrams, implementation guides, and operational runbooks while sharing knowledge with team members.
• Contributes to Agile or SAFe delivery teams by participating in planning sessions, sprint activities, estimation, and continuous improvement initiatives.
• Evaluates new AI technologies, frameworks, and cloud services and recommends opportunities to improve existing solutions and engineering practices.

Skills

Python

LLMs

Cloud platforms

RAG architectures

Prompt engineering

APIs/microservices

Collaboration

Problem solving

Delivery & execution

Security & governance

Education

Bachelor’s degree

Tools

AWS Bedrock

GCP Vertex AI

Azure OpenAI

OpenSearch

Pinecone

FAISS

LangChain

LangGraph

LlamaIndex

Job description

CVS Health is seeking an experienced AI/ML engineer to design, develop, and deploy Generative AI solutions across the enterprise. You will craft scalable, secure AI applications on cloud platforms, implement RAG pipelines, and collaborate with cross‑functional teams to deliver measurable business value.

Ideal candidates bring 5+ years in software/AI engineering, hands-on cloud experience (AWS/GCP), Python expertise, and a strong foundation in responsible AI practices within healthcare contexts.