Senior AI Platform Engineer (LLMs & GenAI)

9025 CVS Shared Services Resources LLC; New York (NY); On-site; USD 93,000 - 204,000; Full time

Job summary

CVS Health is seeking a Senior Software Development Engineer to lead design, development, and scaling of AI-powered products and platforms. You will architect, code, test, and collaborate across teams to deliver production-ready AI solutions that enhance customer experience and operational efficiency.

The role emphasizes practical AI application, strong technical judgment, and the ability to translate emerging AI tech into scalable software.

Qualifications

• 5+ years of work experience in software development
• Strong problem solving and decision-making abilities
• Collaborative and team-oriented
• Growth mindset with willingness to develop others
• Execution and delivery on large engineering projects
• Ability to translate requirements into scalable technical solutions
• Mentor engineers in AI, software architecture, and problem solving
• Experience turning customer needs into scalable software solutions

Responsibilities

• Design and implement scalable AI and ML solutions for complex business challenges
• Integrate LLMs, generative AI, and AI agents into enterprise products
• Define technical architecture and infrastructure for application solutions
• Develop and maintain AI platforms for model training, deployment, monitoring, governance
• Optimize inference performance, reliability, and costs
• Implement observability, telemetry, and performance measurement for AI systems
• Enable secure AI deployment through governance and compliance
• Write code and build software components per project requirements
• Collaborate with team and stakeholders on high-level architecture and patterns
• Integrate software components ensuring interoperability
• Conduct code reviews and debugging to ensure quality
• Explore new tools and techniques to drive innovation
• Prepare and share technical documentation for knowledge transfer

Skills

Python

Java

TypeScript

AI/ML Frameworks

PyTorch

TensorFlow

Hugging Face

Pandas

RESTful APIs

Docker

Kubernetes

Cloud (Lambda/ECS/S3)

SQL

GitHub

Mentoring

Education

Bachelor’s degree in Computer Science or related field

Tools

Docker

Kubernetes

REST APIs

Microservices

Cloud services (AWS)

Job description

CVS Health is seeking a Senior Software Development Engineer to lead design, development, and scaling of AI-powered products and platforms. You will architect, code, test, and collaborate across teams to deliver production-ready AI solutions that enhance customer experience and operational efficiency.

The role emphasizes practical AI application, strong technical judgment, and the ability to translate emerging AI tech into scalable software.