Senior AI Software Engineer — Enterprise LLMs

CVS Health Corporation; Hartford (CT); On-site; USD 83,000 - 204,000; Full time

Benefits offered by this job

Medical, dental & vision coverage

Paid time off

Retirement savings options

Wellness programs

Job summary

CVS Health Corporation in Hartford, CT seeks an experienced AI/LLM Engineer to design, develop, and operationalize language-model powered applications for enterprise use cases, including text-based reasoning, RAG pipelines, and scalable prompt engineering.

You will collaborate with business stakeholders to translate requirements into reliable, secure, and production-ready AI solutions, ensuring responsible performance and observability across systems.

Qualifications

• Strong programming experience in Python and familiarity with software engineering best practices.
• Hands‑on experience building production‑grade AI/ML systems, not just prototypes.
• Experience working with Large Language Models (LLMs) and APIs.
• Solid understanding of NLP fundamentals and ML concepts (training, evaluation, overfitting, bias).
• Practical experience with RAG systems, prompt engineering and optimization, embeddings and vector search.
• Experience designing and implementing APIs, microservices, or distributed systems.
• Familiarity with model evaluation techniques and performance metrics.
• Strong debugging and problem‑solving skills in complex systems.

Responsibilities

• Design, develop, and operationalize language-model powered applications for enterprise use cases.
• Build text-based reasoning systems, RAG pipelines, and scalable prompt frameworks.
• Collaborate with stakeholders to translate requirements into reliable, explainable AI solutions for production.
• Ensure security, responsibility, and real-world performance of AI capabilities.

Skills

Python programming

LLMs & APIs

Debugging & problem-solving

Cross-functional collaboration

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field

Tools

LangChain

LlamaIndex

Semantic Kernel

Pinecone

Weaviate

FAISS

MongoDB Atlas Vector Search

Spark

Pandas

FastAPI

Flask

REST/gRPC

AWS

Azure

GCP

Docker

Kubernetes

Job description

CVS Health Corporation in Hartford, CT seeks an experienced AI/LLM Engineer to design, develop, and operationalize language-model powered applications for enterprise use cases, including text-based reasoning, RAG pipelines, and scalable prompt engineering.

You will collaborate with business stakeholders to translate requirements into reliable, secure, and production-ready AI solutions, ensuring responsible performance and observability across systems.