Senior Python AI Benchmarking Engineer - Remote

Lifted (an Upwork Company)

Argentina

Remote

ARS 167,063,000 - 208,829,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote contract
Weekly payments
Flexible workload 10–39 hours

Job summary

Lifted (an Upwork Company) seeks experienced Senior Python Developers to help build the next generation of AI evaluation systems. You will design benchmarks, assess AI-generated code, and improve model reasoning, reliability and performance across large, multi-language codebases.

The role is fully remote, with workload expectations of 10–39 hours per week and weekly payments for completed work, focusing on high-growth AI platforms and open collaboration with cross-functional teams.

Qualifications

  • 4+ years of professional software engineering experience.
  • Expert-level proficiency in Python.
  • Experience at a high-growth tech company or top-tier software organization.
  • Proficiency in at least one additional language such as JavaScript, Go, or C++.
  • Experience with CI/CD and automated testing frameworks.

Responsibilities

  • Design and develop coding benchmarks to evaluate frontier AI models.
  • Analyze AI-generated code for correctness, reliability, and edge cases.
  • Build and maintain scalable data pipelines for AI evaluation workflows.
  • Create structured programming scenarios to test reasoning, debugging, and code quality.
  • Work with large codebases in multi-language environments.
  • Collaborate to improve how AI models understand, generate, and evaluate software.
  • Write clean, maintainable Python code following best practices.

Skills

Python
CI/CD
Code quality

Tools

pytest
Mocha
JUnit

Job description

Lifted (an Upwork Company) seeks experienced Senior Python Developers to help build the next generation of AI evaluation systems. You will design benchmarks, assess AI-generated code, and improve model reasoning, reliability and performance across large, multi-language codebases.

The role is fully remote, with workload expectations of 10–39 hours per week and weekly payments for completed work, focusing on high-growth AI platforms and open collaboration with cross-functional teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Copy of Senior Python Developer (AI Evaluation & Benchmarking)

Lifted (an Upwork Company) • Argentina

Remote
ARS 167,063,000 - 208,829,000
Fully remote contract
Weekly payments
Flexible workload 10–39 hours
Remote Python Engineer - Flexible, Project-Based Work
Remote Python Engineer - Flexible, Project-Based Work

Anyone AI Inc. • Comisión de Fomento de Perú

Hybrid
ARS 90,953,000 - 181,906,000
Python Developer
Python Developer

Anyone AI Inc. • Comisión de Fomento de Perú

Hybrid
ARS 90,953,000 - 181,906,000
Senior Python AI Engineer - Remote, Production LLM Systems
Senior Python AI Engineer - Remote, Production LLM Systems

BairesDev • Comisión de Fomento de Perú

Remote
ARS 181,747,000 - 272,620,000
100% remote
USD compensation
Hardware setup for you to work from h​
Impactful AI Systems Architect (Python) | Remote & Flexible
Impactful AI Systems Architect (Python) | Remote & Flexible

BairesDev • Comisión de Fomento de Perú

Remote
ARS 181,904,000 - 272,855,000
100% remote work
USD or local currency compensation
Hardware and software setup for home
+4
Remote Senior Backend Engineer – Java/Python, AI-Driven
Remote Senior Backend Engineer – Java/Python, AI-Driven

Anyone Ai Inc. • Neuquén

Remote
ARS 151,925,000 - 243,080,000
Remote work from LATAM
Company-provided laptop and equipment
Generous PTO and regional holidays
Remote Python Full-Stack AI Engineer
Remote Python Full-Stack AI Engineer

Pyyne Llc. • Buenos Aires

Remote
ARS 136,430,000 - 197,065,000
Flexible remote working environment
Career development opportunities in a 
Remote Native-Language AI Benchmark Engineer
Remote Native-Language AI Benchmark Engineer

Lilt • Argentina

Remote
ARS 124,818,000 - 249,637,000
Remote work
Flexible schedule
Prompt payments
Remote Part-Time Senior Full-Stack Engineer for AI Projects
Remote Part-Time Senior Full-Stack Engineer for AI Projects

YO AI Labs • Ciudad de Mendoza

Remote
ARS 83,158,000 - 166,317,000
Remote Senior Full-Stack Engineer for AI Code Review
Remote Senior Full-Stack Engineer for AI Code Review

YO AI Labs • Córdoba

Remote
ARS 124,737,000 - 207,896,000