Senior Software Development Engineer - LLMs, GenAI

CVS Health; New York (NY); Hybrid; USD 93,000 - 204,000; Full time

Benefits offered by this job

Medical, dental, vision coverage

Paid time off

Retirement savings options

Job summary

CVS Health in New York seeks a Senior Software Development Engineer to lead AI-powered product design, development and scaling, blending software engineering with AI expertise to deliver production-ready solutions.

You will architect scalable AI solutions, integrate LLMs and AI agents, build robust pipelines, and ensure observability, governance and secure deployment, while mentoring engineers to drive innovation and impact.

Qualifications

• 5+ years' work experience
• Adept at problem solving and decision-making
• Adept at collaboration and teamwork
• Adept at growth mindset, agility and developing others
• Adept at execution and delivery, planning and supporting
• Adept at driving large-scale engineering projects with organizational impact
• Adept at mentoring engineers in AI engineering and software architecture
• Adept at translating customer requirements into scalable technical solutions

Responsibilities

• Design and implement scalable AI and ML solutions for complex business challenges.
• Integrate LLMs, generative AI, and AI agents into enterprise products.
• Design and define the technical architecture and infrastructure for solutions.
• Develop and maintain AI platforms for model training, deployment, monitoring, governance, and lifecycle management.
• Optimize inference performance, reliability, and cost; ensure observability and performance metrics.
• Enable secure AI deployment through governance and compliance controls.
• Write code and implement complex functionalities per project requirements.
• Collaborate with team and stakeholders on architectural decisions and scalable designs.
• Integrate disparate components for seamless communication and interoperability.
• Perform code reviews, debugging, and troubleshooting to ensure quality.

Skills

Python

Java

ML frameworks

APIs & microservices

Docker & Kubernetes

Cloud services

Version control

SQL

Leadership

Education

Bachelor's degree in Computer Science / Software Engineering

Tools

GitHub

Azure DevOps

Job description

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health®, you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time.

Senior Software Development Engineer

A Brief Overview

This Senior Software Development Engineer is a highly experienced technical leader responsible for designing, developing, and scaling AI-powered products, platforms, and services. This role combines software engineering expertise with foundational knowledge of artificial intelligence, machine learning and generative artificial intelligence.

Develop and implement application solutions and systems by applying advanced technical expertise to architect and code software applications, conduct system testing and debugging, collaborate with cross-functional teams, and contribute to the overall technical direction and innovation of application engineering products.

The engineer drives the technical direction of complex initiatives, influences engineering strategies across organizations, and delivers intelligent solutions that improve customer experience, operational efficiency, and business outcomes. Success in this role requires strong technical judgment, collaboration across disciplines, and the ability to translate emerging AI technologies into production-ready systems.

What you will do:

• Design and implement scalable AI and machine learning solutions that address complex business and customer challenges.
• Integrate Large Language Models (LLMs), generative AI capabilities, and AI agents into enterprise products and platforms.
• Designs and defines the technical architecture and infrastructure required for application solutions.
• Develop and maintain AI platforms supporting model training, deployment, monitoring, governance, and lifecycle management.
• Optimize inference performance, reliability, scalability, and operational costs.
• Implement observability, telemetry, and performance measurement for AI systems.
• Enable secure and responsible AI deployment through governance controls and compliance frameworks.
• Writes code, develops software components, and implements complex functionalities according to project requirements.
• Collaborates with other members of the development team and stakeholders to make high-level architectural decisions, proposes design patterns, and ensures scalability, performance, and maintainability of application solutions.
• Integrates various software components or systems, ensuring seamless communication and interoperability between different parts of the application solution.
• Conducts code reviews, performs debugging, and troubleshoots issues to ensure the reliability, stability, and high quality of application solutions.
• Explores new tools, frameworks, and techniques to improve application solutions and drive innovation within the development team.
• Creates and maintains technical documentation, including system designs, architecture diagrams, code documentation, and other relevant documentation while sharing their knowledge and expertise with team members, ensuring effective knowledge transfer and collaboration.

For this role you will need Minimum Requirements

• 5+ years' work experience
• Adept at problem solving and decision-making skills
• Adept at collaboration and teamwork
• Adept at growth mindset (agility and developing yourself and others) skills
• Adept at execution and delivery (planning, delivering, and supporting) skills
• Adept at design and delivery of large-scale engineering projects with significant organizational impact
• Adept at technical reviews, design discussions, and strategic technology decisions
• Adept at mentoring engineers and providing guidance on AI engineering, software architecture, and technical problem-solving
• Adept at translating customer requirements and business objectives into scalable technical solutions

Coding Skills:

• Python/Java: Deep fluency in Python; familiarity with secondary languages like TypeScript, JavaScript or Java
• AI/ML Frameworks: Experience with PyTorch, TensorFlow, Hugging Face, and/or Pandas
• APIs & Architecture: Building and consuming RESTful APIs, microservices and containerization tools like Docker and Kubernetes
• Exposure to Cloud platforms and technologies such as Lambda, ECS, S3, RDS, and/or CloudWatch
• Experience in source control such as GIThub, Azure Repo, etc...
• SQL

Preferred Qualifications

• Exposure to automation tools such as UiPath, Playwright, Selenium and/or Cypress
• Exposure to data analytic tools such as Power BI
• Exposure to Power Automate
• Exposure to Generative AI
• Exposure Large Language Models (GPT, Claude, Gemini, Llama, etc.)
• Exposure to Machine Learning Fundamentals
• Creates a culture of innovation, learning, and accountability

Education

• Bachelor's degree in Computer Science, Software Engineering, or related field; advanced degree preferred. One year of relevant work experience may be substituted for each year of college not completed, in addition to the required years of experience.

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is:

$92,700.00 - $203,940.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 10/01/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.