L4/L5 Software Engineer

Ethereum Technologies LLC; Austin (TX); On-site; USD 150,000 - 210,000; Full time

Job summary

ETHEREUM TECHNOLOGIES LLC is seeking a senior software validation leader in Austin, TX to architect and implement advanced test frameworks and benchmarking systems. The role focuses on evaluating model responses for quality, efficiency, and security, while improving code quality across human and AI-generated code.

The candidate will lead validation initiatives, mentor engineers, and collaborate with researchers, ML engineers, and product managers to continuously advance our evaluation

Qualifications

• Bachelor's or Master's degree in Computer Science or related STEM field.
• 7+ years of hands-on software development with significant Test Engineering/SET experience.

Responsibilities

• Architect, develop, and implement test harnesses, automated test suites, and benchmarking systems to evaluate quality, correctness, efficiency, and security of code responses.
• Drive code quality by analyzing and improving both human-written and AI-generated code, defining metrics that matter.
• Technical leadership: act as tech lead for code evaluation initiatives, mentor engineers, ensure robust, scalable systems.
• Cross-functional collaboration: partner with research scientists, ML engineers, and product managers to drive continuous improvement in our code-generating models.

Skills

Test Automation

Code Quality Metrics

Technical Leadership

Cross-Functional Collaboration

Education

Bachelor's or Master's in Computer Science

Job description

• Build Validation Frameworks:Architect, develop, and implement sophisticated test harnesses, automated test suites, and benchmarking systems to rigorously evaluate the quality, correctness, efficiency, and security of code responses from our models.
• Drive Code Quality:Analyze and improve the quality of both human-written and AI-generated code. Define and implement metrics for code quality that matter.
• Technical Leadership:Act as a tech lead for code evaluation initiatives, setting technical direction, mentoring engineers, and ensuring the delivery of robust, scalable systems.
• Cross-Functional Collaboration:Partner closely with research scientists, ML engineers, and product managers to integrate feedback, define requirements, and drive continuous improvement in our code-generating models.

Required Skills & Qualifications

• Bachelor's or Master's degree in Computer Science or a related STEM field.
• 7+ years of proven, hands-on software development experience, with a significant portion in Test Engineering, Software Engineering in Test (SET), or building complex validation systems.

ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract