Senior Python AI Benchmarking & Evaluation Engineer

Lifted (an Upwork Company); United States; Remote; USD 110,000 - 138,000; Full time

Job summary

Lifted (an Upwork Company) is seeking senior Python developers to design benchmarks, analyze AI-generated code, and build scalable data pipelines for AI evaluation. You will work on frontiers of AI model reasoning, generation, and evaluation, contributing to high-quality Python software and robust testing practices.

The role emphasizes solving complex technical problems, collaborating across teams, and delivering reliable, well-documented Python solutions for evaluating AI systems.

Qualifications

• 4+ years of professional software engineering experience.

Responsibilities

• Design and develop coding benchmarks used to evaluate frontier AI models.
• Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.
• Build and maintain scalable data pipelines that support AI evaluation workflows.
• Create structured programming scenarios to test reasoning, debugging, and code quality.
• Work with large codebases and multi-language software environments.
• Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
• Write clean, maintainable, and well-tested Python code following software engineering best practices.

Skills

Python expert

4+ years experience

CI/CD pipelines

Testing frameworks

Multi-language: JS/Go/C++

Code review & debugging

Education

Bachelor's degree in CS or related

Tools

CI/CD tooling

pytest

Mocha

JUnit

Job description

Lifted (an Upwork Company) is seeking senior Python developers to design benchmarks, analyze AI-generated code, and build scalable data pipelines for AI evaluation. You will work on frontiers of AI model reasoning, generation, and evaluation, contributing to high-quality Python software and robust testing practices.

The role emphasizes solving complex technical problems, collaborating across teams, and delivering reliable, well-documented Python solutions for evaluating AI systems.