Senior Python Engineer - AI Testing Project (Freelance, Mindrift)

Mindrift; Town of Florida (NY); Remote; USD 82,656 - 110,208; Part time

Benefits offered by this job

Freelance project-based collaboration

Fully remote and flexible participation

Task-based compensation up to $80/hour

Opportunity to contribute to innovative AI projects

Supportive global community

Job summary

A project-based AI opportunity provider is looking for a Senior Python developer with extensive experience in functional testing and Docker skills. The role involves creating and managing tests for large codebases, utilizing modern Python tools, and collaborating on innovative AI projects. Ideal candidates will have a strong background in reading various coding languages and working with LLMs. This fully remote position offers flexible participation with task-based compensation of up to $80/hour based on performance.

Qualifications

• 5+ years of experience as a Software Engineer, primarily in Python.
• Deep experience with pytest and designing black-box functional tests.
• Expert-Level Docker skills and debugging inside containers.

Responsibilities

• Create functional black box tests for large codebases.
• Manage Docker environments for reproducible builds and tests.
• Monitor code coverage and configure automated scoring criteria.

Skills

Python

Functional testing

Docker

Linux

Bash scripting

LLMs (Claude Code, Roo Code)

Reading code in multiple languages (C, C++, Rust, Go)

Tools

pytest

Git

Dockerfiles

coverage.py

Job description

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

About The Role

This project is suited for a Senior Python developer with deep functional testing experience, strong Linux and Docker skills, the ability to read code across multiple languages with the support of LLMs (e.g., C, Rust, Go) and translate requirements for migration tasks, and confidence using tools like Roo Code or Claude Code to accelerate iterative development.

Key Responsibilities

• Create functional black box tests for large codebases in various source languages
• Create and manage Docker environments to ensure 100% reproducible builds and test execution across different platforms
• Monitor code coverage and configure automated scoring criteria to meet industry benchmark‑level standards
• Leverage LLMs (Roo Code, Claude) to accelerate development cycles, automate repetitive tasks, and improve overall code quality

Requirements

• 5+ years of experience as a Software Engineer (primarily Python)
• Deep experience with pytest (fixtures, session‑scoped, timeouts) and designing black‑box functional tests for CLI tools
• Expert‑level Docker skills (reproducible Dockerfiles, user contexts, secure workspaces)
• Strong Linux & Bash scripting skills and comfort debugging inside containers
• Proficiency with modern Python tooling (uv, pyproject.toml, packaging)
• Ability to read and understand with LLM many coding languages (for example C, C++, Rust, or Go)
• Experience using LLMs (Claude Code, Roo Code, Cursor) to accelerate iterative development and test‑case generation
• English language - B2 or higher

Additional Requirements

• Prior experience with agent evaluation platforms and MCP CLI

Tools and Technologies

Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.

Benefits

• Freelance project‑based collaboration via the Mindrift platform (powered by Toloka AI)
• Fully remote and flexible participation — choose when and how much to contribute (20-30 hours per week)
• Task‑based compensation, equivalent to up to $80/hour* depending on performance and volume
• Opportunity to contribute to innovative AI projects for leading tech companies
• Supportive global community
• Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non‑core project phases. Payment details are shared per project