Senior Software Development Engineer - LLMs, GenAI

CVS Health; City of Albany (NY); On-site; USD 102,000 - 204,000; Full time

Benefits offered by this job

Benefits package

Bonus eligibility

Job summary

CVS Health is seeking an experienced Senior Software Development Engineer in Albany to design, build, and scale AI-powered products and platforms. You will fuse software engineering with artificial intelligence knowledge to drive production-ready systems and enterprise capabilities.

You will lead the integration of LLMs and generative AI features, define architectures, and guide cross-functional teams to deliver high-impact solutions with efficiency and security.

Qualifications

• 5+ years of work experience in software development
• Strong problem solving and decision-making skills
• Excellent collaboration and teamwork
• Growth mindset with ability to develop self and others
• Strong execution and delivery skills for large-scale projects
• Experience with design and delivery of engineering solutions with significant impact
• Experience in technical reviews, design discussions, and strategic tech decisions
• Mentorship of engineers in AI engineering, software architecture, and problem solving

Responsibilities

• Design and implement scalable AI and machine learning solutions.
• Integrate LLMs, generative AI capabilities, and AI agents into enterprise products.
• Define technical architecture and infrastructure for applications.
• Develop and maintain AI platforms for model training, deployment, monitoring, governance, and lifecycle management.
• Optimize inference performance, reliability, and cost.
• Implement observability and performance metrics for AI systems.
• Enable secure AI deployment through governance and compliance.
• Write code and build software components as per project needs.
• Collaborate with team and stakeholders on high-level architectural decisions.
• Ensure interoperability between components and systems.
• Conduct code reviews, debugging, and issue resolution.
• Explore new tools and techniques to drive innovation.
• Create and maintain system documentation and knowledge transfer.

Skills

Python/Java

AI/ML Frameworks

APIs & Architecture

Cloud Platforms

Source Control

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

GitHub/Azure DevOps

Job description

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.

Senior Software Development Engineer

A Brief Overview

This Senior Software Development Engineer is a highly experienced technical leader responsible for designing, developing, and scaling AI-powered products, platforms, and services. This role combines software engineering expertise with foundational knowledge of artificial intelligence, machine learning and generative artificial intelligence.

Develop and implement application solutions and systems by applying advanced technical expertise to architect and code software applications, conduct system testing and debugging, collaborate with cross-functional teams, and contribute to the overall technical direction and innovation of application engineering products.

The engineer drives the technical direction of complex initiatives, influences engineering strategies across organizations, and delivers intelligent solutions that improve customer experience, operational efficiency, and business outcomes. Success in this role requires strong technical judgment, collaboration across disciplines, and the ability to translate emerging AI technologies into production-ready systems.

What You Will Do

• Design and implement scalable AI and machine learning solutions that address complex business and customer challenges.
• Integrate Large Language Models (LLMs), generative AI capabilities, and AI agents into enterprise products and platforms.
• Designs and defines the technical architecture and infrastructure required for application solutions.
• Develop and maintain AI platforms supporting model training, deployment, monitoring, governance, and lifecycle management.
• Optimize inference performance, reliability, scalability, and operational costs.
• Implement observability, telemetry, and performance measurement for AI systems.
• Enable secure and responsible AI deployment through governance controls and compliance frameworks.
• Writes code, develops software components, and implements complex functionalities according to project requirements.
• Collaborates with other members of the development team and stakeholders to make high-level architectural decisions, proposes design patterns, and ensures scalability, performance, and maintainability of application solutions.
• Integrates various software components or systems, ensuring seamless communication and interoperability between different parts of the application solution.
• Conducts code reviews, performs debugging, and troubleshoots issues to ensure the reliability, stability, and high quality of application solutions.
• Explores new tools, frameworks, and techniques to improve application solutions and drive innovation within the development team.
• Creates and maintains technical documentation, including system designs, architecture diagrams, code documentation, and other relevant documentation while sharing their knowledge and expertise with team members, ensuring effective knowledge transfer and collaboration.

For This Role You Will Need Minimum Requirements

• 5+ years’ work experience
• Adept at problem solving and decision-making skills
• Adept at collaboration and teamwork
• Adept at growth mindset (agility and developing yourself and others) skills
• Adept at execution and delivery (planning, delivering, and supporting) skills
• Adept at design and delivery of large-scale engineering projects with significant organizational impact
• Adept at technical reviews, design discussions, and strategic technology decisions
• Adept at mentoring engineers and providing guidance on AI engineering, software architecture, and technical problem-solving
• Adept at translating customer requirements and business objectives into scalable technical solutions

Coding Skills

• Python/Java: Deep fluency in Python; familiarity with secondary languages like TypeScript, JavaScript or Java
• AI/ML Frameworks: Experience with PyTorch, TensorFlow, Hugging Face, and/or Pandas
• APIs & Architecture: Building and consuming RESTful APIs, microservices and containerization tools like Docker and Kubernetes
• Exposure to Cloud platforms and technologies such as Lambda, ECS, S3, RDS, and/or CloudWatch
• Experience in source control such as GIThub, Azure Repo, etc…
• SQL

Preferred Qualifications

• Exposure to automation tools such as UiPath, Playwright, Selenium and/or Cypress
• Exposure to data analytic tools such as Power BI
• Exposure to Power Automate
• Exposure to Generative AI
• Exposure Large Language Models (GPT, Claude, Gemini, Llama, etc.)
• Exposure to Machine Learning Fundamentals
• Creates a culture of innovation, learning, and accountability

Education

• Bachelor’s degree in Computer Science, Software Engineering, or related field; advanced degree preferred. One year of relevant work experience may be substituted for each year of college not completed, in addition to the required years of experience.

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The Typical Pay Range For This Role Is

$101,970.00 - $203,940.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great Benefits For Great People

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 09/30/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.