Copy of Senior Python Developer (AI Evaluation & Benchmarking)

Liftedanupworkcompany

Brasil

Remote

BRL 637,000 - 796,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Liftedanupworkcompany is seeking a senior Python engineer for a fully remote contract focused on AI model evaluation and benchmarking. You will design benchmarks, review AI-generated code, and build data pipelines to support evaluation workflows.

The role requires expert Python skills, experience with CI/CD and automated testing, and the ability to work across multi-language codebases. Expect 10–39 hours per week with weekly payments in USD.

Qualifications

  • 4+ years of professional software engineering experience.
  • Expert-level proficiency in Python.
  • Experience at a high-growth technology company or top-tier software organization.
  • Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
  • Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
  • Strong understanding of software engineering best practices, debugging, and code quality.
  • Excellent analytical and problem-solving skills.

Responsibilities

  • Design and develop coding benchmarks to evaluate frontier AI models.
  • Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.
  • Build and maintain scalable data pipelines that support AI evaluation workflows.
  • Create structured programming scenarios to test reasoning, debugging, and code quality.
  • Work with large codebases and multi-language software environments.
  • Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
  • Write clean, maintainable, and well-tested Python code following software engineering best practices.

Skills

Python
Code reviews
Debugging
CI/CD
Automated testing (pytest, Mocha, JUn

Tools

pytest
Mocha
JUnit

Job description

This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.

What You'll Do:
  • Design and develop coding benchmarks used to evaluate frontier AI models.
  • Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
  • Create structured programming scenarios to test reasoning, debugging, and code quality.
  • Work with large codebases and multi-language software environments.
  • Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
  • Write clean, maintainable, and well-tested Python code following software engineering best practices.
Requirements:
  • 4+ years of professional software engineering experience (required).
  • Expert-level proficiency in Python.
  • Experience working at a high-growth technology company or top-tier software organization.
  • Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
  • Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
  • Strong understanding of software engineering best practices, debugging, and code quality.
  • Excellent analytical and problem-solving skills.
Nice to Haves:
  • Experience with AI/ML evaluation, model benchmarking, or Generative AI.
  • Background in security engineering.
  • Significant contributions to open-source software projects.
  • Experience working with large-scale distributed systems or enterprise software platforms.

Fully remote contract opportunity.

Compensation ranges from $80-$100 USD per hour .

Expected workload is 10-39 hours per week , depending on project needs.

Weekly payments for approved work completed during the previous week.

Work volume may fluctuate throughout the duration of the engagement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer (Remote | $100–$150/hr)
Senior Software Engineer (Remote | $100–$150/hr)

Synthires • Brazil

Remote
BRL 701,000 - 1,052,000
Senior Software Engineer - AI Code Quality
Senior Software Engineer - AI Code Quality

Braintrust • Brazil

Remote
BRL 809,000 - 1,156,000
Python Developer | $25/task
Python Developer | $25/task

Codefeast • Brazil

Remote
BRL 156,000 - 223,000
Python Developer - Remote in Brazil
Python Developer - Remote in Brazil

Anyone AI Inc. • São Paulo

Remote
BRL 173,000 - 414,000
Principal Python Engineer — ML Infrastructure
Principal Python Engineer — ML Infrastructure

Alignerr Corp. • São Paulo

Remote
BRL 460,000 - 920,000
Fully remote
Flexible schedule
Backend Developer (Brazil)
Backend Developer (Brazil)

Anyone AI Inc. • Brazil

Remote
BRL 96,000 - 152,000
Backend Developer (Brazil)
Backend Developer (Brazil)

Anyone AI • São Paulo

Remote
BRL 83,000 - 165,000
Freelance AI Evaluation Engineer (Python/Full-Stack)
Freelance AI Evaluation Engineer (Python/Full-Stack)

Mindrift • Brazil

Remote
BRL 101,581 - 144,676
Software Engineer - Python (Advanced)
Software Engineer - Python (Advanced)

Alignerr Corp. • Brazil

Remote
BRL 83,000 - 138,000
Software Engineering AI Trainer (Brazil)
Software Engineering AI Trainer (Brazil)

Anyone AI Inc. • Brazil

Remote
BRL 165,000 - 303,000