Engineer Lead (FDE) - AI Assurance and Evaluations

The Elevance Health Companies, Inc.; Atlanta (GA); Hybrid; USD 140,000 - 170,000; Full time

Benefits offered by this job

Merit increases

Paid holidays

401(k) + match

Stock purchase plan

Job summary

Elevation Health is seeking an Engineer Lead (FDE) for AI assurance and evaluations, based in the United States. The role emphasizes end-to-end delivery of enterprise platforms, requirements gathering, and leading cross-functional design reviews.

Responsibilities include improving system stability, coordinating with multiple teams, and driving test automation and CI/CD integration. A BA/BS in IT/CS and 7+ years of related experience are required.

Qualifications

• Requires BA/BS in IT or CS or related field with 7+ years of experience.
• Experience with multi-platform and enterprise systems preferred.
• Ability to mentor others and support troubleshooting.

Responsibilities

• Leads end-to-end delivery of medium enterprise platforms.
• Gathers requirements and aligns designs with business needs.
• Collaborates with Web and Marketing to enhance web product presence.
• Oversees changes, tests, and deployment activities.

Skills

Python

API testing

Test automation

LLM basics

Prompting frameworks

Data analytics

Mentoring

Education

BA/BS degree in Information Technology, Computer Science or related field of study

Tools

CI pipelines

Job description

Job Description

Position Title: Engineer Lead (FDE) - AI Assurance and Evaluations

Engineer Lead (FDE) – AI Assurance and Evaluations

Location

This role requires associates to be in-office 1 - 2 days per week, fostering collaboration and connectivity, while providing flexibility to support productivity and work-life balance.

Alternate locations may be considered if candidates reside within a commuting distance from an office.

Please note that per our policy on hybrid/virtual work, candidates not within a reasonable commuting distance from the posting location(s) will not be considered for employment, unless an accommodation is granted as required by law.

The Engineer Lead will be responsible for full delivery of end to end system development and maintenance on medium Enterprise wide technology platforms.

How you will make an impact:

• Maintains active relationships with customers to determine business requirements and leads requirements gathering meetings.
• Primary duties may include, but are not limited to.
• Leads requirements gathering meetings and reviews designs with the business.
• Leads efforts with Web and marketing team to increase the presence of web products.
• May implement improvements in stability, performance, and scalability across major business-critical systems.
• May implement process to reduce barriers and roadblocks in projects, services, and processes in order to operate more efficiently.
• Owns the change request process and coordinates with other teams as necessary.
• Develops and owns list of final enhancements.
• Develops and defines application scope and objectives and supervises the preparation of technical and/or functional specifications from with programs will be written.
• Performs technical design reviews and code reviews.
• Ensures unit test is completed and meets the test plan requirements, system testing is completed and system is implemented according to plan.
• Responsible for delivery of application technology solutions and data information planning effort.
• Coordinates and manages on-call support and owns the system monitoring process.
• Owns the technical development environment and works on the Enterprise team.
• Leads multiple or large projects and facilitates large group JAD sessions for requirements, modeling in several disciplines.
• Leads vendor evaluation and analysis.

Minimum Requirements:

• Requires an BA/BS degree in Information Technology, Computer Science or related field of study and a minimum of 7 years related experience; multi-platform, multi-dimensional experience, and expert level experience with business and technical applications; or any combination of education and experience, which would provide an equivalent background.

Preferred Skills, Capabilities and Experiences:

• Proficiency with Python for building evaluation utilities, test harnesses, data pipelines, and automation scripts.
• Experience with API testing (REST/JSON), including authentication patterns, contract validation, negative testing, and performance/smoke testing.
• Hands-on test automation experience (unit/integration/end-to-end), including building repeatable regression suites and integrating tests into CI pipelines.
• LLM basics, including core concepts such as tokens/context windows, temperature/top-p sampling, embeddings, retrieval-augmented generation (RAG) fundamentals, and common failure modes (hallucinations, prompt injection, bias).
• Familiarity with prompting and evaluation frameworks (prompt versioning, test cases, golden datasets, automated scoring), including qualitative + quantitative evaluation approaches.
• Data analytics skills to measure model/application quality and operational performance (e.g., KPI definition, experiment analysis, dashboards; comfort with SQL and basic statistical concepts preferred).
• Experience mentoring others and provide troubleshooting support strongly preferred.

Job Level

Non-Management Exempt

Workshift

1st Shift (United States of America)

Job Family

IFT > Engineering/Dev

Elevance Health only accepts resumes for compensation from agencies that have a signed agreement with Elevance Health. Any unsolicited resumes, including those submitted to hiring managers, are deemed to be the property of Elevance Health.

Benefits and Total Rewards

• merit increases
• paid holidays
• Paid Time Off
• incentive bonus programs (unless covered by a collective bargaining agreement)
• medical
• dental
• vision
• short and long term disability benefits
• 401(k) +match
• stock purchase plan
• life insurance
• wellness programs
• financial education resources
• to name a few

Elevance Health operates in a Hybrid Workforce Strategy. Unless specified as primarily virtual by the hiring manager, associates are required to work at an Elevance Health location at least once per week, and potentially several times per week. Specific requirements and expectations for time onsite will be discussed as part of the hiring process.

Elevance Health requires all new candidates in certain patient/member-facing roles to become vaccinated against COVID-19 and Influenza. If you are not vaccinated, your offer will be rescinded unless you provide an acceptable explanation.

Elevance Health is an Equal Employment Opportunity employer, and all qualified applicants will receive consideration for employment without regard to age, citizenship status, color, creed, disability, ethnicity, genetic information, gender (including gender identity and gender expression), marital status, national origin, race, religion, sex, sexual orientation, veteran status or any other status or condition protected by applicable federal, state, or local laws.

Applicants who require accommodation to participate in the job application process should submit the following form: Accessibility Accommodation Request Form and a member of the team will be in contact.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws, including, but not limited to, the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act.

Prospective employees required to be screened under Florida law should review the education and awareness resources at HB531 | Florida Agency for Health Care Administration.

Please visit the Contract Worker Community Page.

Elevance Health is an Equal Opportunity Employer/Disability/Veterans.