Copy of Senior Python Developer (AI Evaluation & Benchmarking)

Liftedanupworkcompany

India

Remote

INR 10,309,000 - 12,887,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote contract

Job summary

Liftedanupworkcompany is seeking a senior software engineer with expert Python skills to design benchmarks for frontier AI models and to analyze AI-generated code for correctness and efficiency.

You will build scalable data pipelines, create testing scenarios, and collaborate across teams to improve model understanding, generation, and evaluation of software. Strong CI/CD and multi-language experience are valued.

Qualifications

  • 4+ years of professional software engineering experience.
  • Expert-level proficiency in Python.
  • Proficiency in at least one additional language (JavaScript/Go/C++).
  • Experience with CI/CD pipelines and automated testing frameworks (pytest/Mocha/JUnit).
  • Strong understanding of software engineering best practices, debugging, and code quality.
  • Excellent analytical and problem-solving skills.

Responsibilities

  • Design and develop coding benchmarks used to evaluate frontier AI models.
  • Analyze AI-generated code for correctness, reliability, efficiency, and edge cases; build scalable data pipelines to support AI evaluation workflows.
  • Create structured programming scenarios to test reasoning, debugging, and code quality.
  • Work with large codebases and multi-language software environments.
  • Collaborate with teams to improve how AI models understand, generate, and evaluate software.
  • Write clean, maintainable Python code following software engineering best practices.

Skills

Python
4+ years
JavaScript
Go
CI/CD
pytest

Tools

pytest
Mocha
JUnit

Job description

This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.

What You'll Do:
  • Design and develop coding benchmarks used to evaluate frontier AI models.
  • Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
  • Create structured programming scenarios to test reasoning, debugging, and code quality.
  • Work with large codebases and multi-language software environments.
  • Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
  • Write clean, maintainable, and well-tested Python code following software engineering best practices.
Requirements:
  • 4+ years of professional software engineering experience (required).
  • Expert-level proficiency in Python.
  • Experience working at a high-growth technology company or top-tier software organization.
  • Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
  • Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
  • Strong understanding of software engineering best practices, debugging, and code quality.
  • Excellent analytical and problem-solving skills.
Nice to Haves:
  • Experience with AI/ML evaluation, model benchmarking, or Generative AI.
  • Background in security engineering.
  • Significant contributions to open-source software projects.
  • Experience working with large-scale distributed systems or enterprise software platforms.

Fully remote contract opportunity.

Compensation ranges from $80-$100 USD per hour .

Expected workload is 10-39 hours per week , depending on project needs.

Weekly payments for approved work completed during the previous week.

Work volume may fluctuate throughout the duration of the engagement.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer — AI Evaluation & Benchmarks
Senior Software Engineer — AI Evaluation & Benchmarks

Alignerr Corp. • India

Remote
INR 1,653,000 - 4,133,000
Fully remote
3-month contract
Potential extension
Senior Software Engineer (Remote | $60–$120/hr)
Senior Software Engineer (Remote | $60–$120/hr)

Synthires • Bengaluru

Remote
INR 7,761,000 - 15,522,000
Python Engineer - 17852
Python Engineer - 17852

Turing • Bengaluru

Remote
INR 10,075,531 - 14,349,999
Remote & Flexible Work
Career Development in AI
High-Impact Work
Python Developer - 17852
Python Developer - 17852

Turing • Coimbatore District

Remote
INR 10,075,531 - 14,349,999
Flexible work schedule
High-impact AI projects
Remote work opportunity
Python AI Engineer - 17852
Python AI Engineer - 17852

Turing • Chennai District

Remote
INR 10,084,471 - 14,362,732
Fully remote work
Flexible scheduling
Competitive pay
Copy of Software Developer – AI Coding Assistant Evaluation
Copy of Software Developer – AI Coding Assistant Evaluation

Lifted, an Upwork Company™ • Hyderabad

Remote
INR 7,761,000 - 12,935,000
Fully remote
Weekly payments
Worldwide applicants
Senior Software Engineer (Remote | $100–$150/hr)
Senior Software Engineer (Remote | $100–$150/hr)

Synthires • Bengaluru

Remote
INR 12,887,000 - 19,330,000
Fully remote
Strategic Project Lead – Software Engineering | AI Programs
Strategic Project Lead – Software Engineering | AI Programs

Philodesign Technologies Inc • India

Remote
INR 13,095,000 - 19,643,000
AI Evaluator - Python (Freelance Opportunity)
AI Evaluator - Python (Freelance Opportunity)

Biz Tech Consultants • New Delhi

On-site
INR 1,200,000 - 2,400,000
Remote Python AI Engineer - 17852
Remote Python AI Engineer - 17852

Turing • Hyderabad

Remote
INR 1,751,313 - 3,940,455