Senior Python Infra Engineer - AI Model Evaluation (Remote)

Alignerr Corp.; New York (NY); Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Job summary

Alignerr is seeking a Senior Python Infrastructure Engineer to design data pipelines, evaluation harnesses, and annotation tooling for AI model evaluation. This remote, hourly contract role focuses on production-grade Python systems powering data workflows and model benchmarking.

You will work with ML teams to ensure reliability, observability, and scalable performance. The role requires 3-5+ years of Python experience, full-stack capabilities, and the ability to commit 20-40 hours weekly.

Qualifications

• 3-5+ years of professional experience writing production-grade Python
• Full-stack developer with a strong systems programming background
• Experience building evaluation harnesses for ML models and integrating with inference frameworks
• Strong grasp of observability, metrics collection, and system reliability practices
• Able to commit 20-40 hours per week with consistent availability

Responsibilities

• Design, build, and optimize high-performance Python systems supporting AI data pipelines and model evaluation workflows
• Develop full-stack tooling and backend services for large-scale data annotation, validation, and quality control
• Build and maintain evaluation harnesses that integrate with inference frameworks and benchmarking pipelines
• Improve reliability, performance, and safety across existing Python codebases
• Instrument systems with observability tooling and metrics collection to monitor model performance and system health
• Identify bottlenecks and edge cases in data and system behavior, and implement scalable, maintainable fixes
• Collaborate with data, research, and engineering teams through synchronous design reviews and async communication

Skills

Python

Observability

Metrics collection

Systems programming

Full-stack development

Collaboration

Production-grade software

Tools

Inference frameworks

Data annotation tooling

Distributed systems

Job description

Alignerr is seeking a Senior Python Infrastructure Engineer to design data pipelines, evaluation harnesses, and annotation tooling for AI model evaluation. This remote, hourly contract role focuses on production-grade Python systems powering data workflows and model benchmarking.

You will work with ML teams to ensure reliability, observability, and scalable performance. The role requires 3-5+ years of Python experience, full-stack capabilities, and the ability to commit 20-40 hours weekly.