Lead AI Assurance & Evaluations Engineer

The Elevance Health Companies, Inc.; Atlanta (GA); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) + match

Stock purchase plan

Paid holidays & PTO

Wellness programs

Job summary

Elevance Health is seeking an Engineer Lead (FDE) for AI Assurance and Evaluations in a hybrid role. The position requires in-office presence 1–2 days weekly with flexibility for remote work within commuting distance.

You will lead end-to-end system development, gather requirements, and coordinate across teams including Web and Marketing to strengthen product platforms. The role emphasizes testing, CI pipelines, and data analytics throughout AI workflows.

Qualifications

• Requires a BA/BS in Information Technology, Computer Science or related field and 7+ years of experience.
• Proficiency with Python for building evaluation utilities, test harnesses, data pipelines, and automation scripts.
• Experience with API testing (REST/JSON), including authentication patterns, contract validation, negative testing, and performance/smoke testing.

Responsibilities

• Maintains active relationships with customers to determine business requirements and leads requirements gathering meetings.
• Leads requirements gathering meetings and reviews designs with the business.
• Leads efforts with Web and marketing team to increase the presence of web products.
• May implement improvements in stability, performance, and scalability across major business-critical systems.
• Owns the change request process and coordinates with other teams as necessary.
• Develops and owns list of final enhancements.

Skills

Python

API testing

Test automation

LLM concepts

Prompting/evaluation

Data analytics

Mentoring others

Requirements gathering

Education

BA/BS in Information Technology or Computer Science

Tools

CI pipelines

Job description

Elevance Health is seeking an Engineer Lead (FDE) for AI Assurance and Evaluations in a hybrid role. The position requires in-office presence 1–2 days weekly with flexibility for remote work within commuting distance.

You will lead end-to-end system development, gather requirements, and coordinate across teams including Web and Marketing to strengthen product platforms. The role emphasizes testing, CI pipelines, and data analytics throughout AI workflows.