Senior AI Engineer for LLMs & RAG Pipelines

CVS Health Corporation; Illinois; Hybrid; USD 83,000 - 204,000; Full time

Job summary

CVS Health Corporation is seeking an experienced AI/LLM Engineer to design, develop, and operationalize advanced language model-powered applications for enterprise use cases. You will build text-based reasoning systems, RAG pipelines, and scalable prompt engineering frameworks to improve decision-making, automation, and knowledge discovery across the organization.

You will collaborate with cross-functional teams to translate business requirements into reliable, explainable, and production-ready

Qualifications

• Strong programming experience in Python and familiarity with software engineering best practices.
• Hands-on experience building production-grade AI/ML systems, not just prototypes.
• Experience working with Large Language Models (LLMs) and APIs.
• Solid understanding of NLP fundamentals and machine learning concepts (training, evaluation, overfitting, bias).
• Practical experience with Retrieval-Augmented Generation (RAG) systems, prompt engineering and optimization, embeddings and vector search.
• Experience designing and implementing APIs, microservices, or distributed systems.
• Familiarity with model evaluation techniques and performance metrics.
• Strong debugging and problem-solving skills in complex systems.

Responsibilities

• Design, develop, and operationalize language-model-powered applications for enterprise use cases.
• Build text-based reasoning systems and RAG pipelines to support decision-making and knowledge discovery.
• Collaborate with stakeholders to deliver secure, reliable, explainable AI solutions for the business.

Skills

Python

Production-grade AI/ML

LLMs & APIs

NLP fundamentals

ML concepts

RAG systems

Prompt engineering

Embeddings & vector search

APIs & microservices

Model evaluation

Debugging & problem solving

Education

Bachelor's or Master's in CS/Engineering/Data Science

Tools

OpenAI

Anthropic

Google Vertex AI

LangChain

LlamaIndex

Semantic Kernel

Pinecone

Weaviate

FAISS

MongoDB Atlas Vector Search

Spark

Pandas

FastAPI

Flask

REST/gRPC

AWS

Azure

GCP

Docker

Kubernetes

Job description

CVS Health Corporation is seeking an experienced AI/LLM Engineer to design, develop, and operationalize advanced language model-powered applications for enterprise use cases. You will build text-based reasoning systems, RAG pipelines, and scalable prompt engineering frameworks to improve decision-making, automation, and knowledge discovery across the organization.

You will collaborate with cross-functional teams to translate business requirements into reliable, explainable, and production-ready