Senior Software Engineer – Python / TypeScript | AI Evaluation

eDataBae; United States; Remote; USD 140,000 - 180,000; Full time

Job summary

eDataBae is seeking experienced Senior Software Engineers to support a technical AI evaluation project involving data pipelines, evaluation workflows, and quality control for preference data.

You will design and maintain pipelines, review and label data, analyze findings, and collaborate with researchers to translate qualitative judgments into scalable processes. Strong Python, or TypeScript/Golang/JavaScript skills and 5+ years experience are required.

Qualifications

• 5+ years of professional software engineering experience.
• Proficiency in Python, building and maintaining pipelines or infrastructure.
• Experience with TypeScript, Golang, or JavaScript.
• Hands-on experience with preference data collection and/or rubric creation.
• Strong debugging, analytical, and problem-solving skills.
• Excellent written and verbal communication.

Responsibilities

• Design, refine, and maintain evaluation rubrics and criteria for preference data.
• Review and label data with a strong focus on quality and consistency.
• Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.
• Analyze findings and communicate clear technical recommendations.
• Collaborate with researchers and engineers to turn qualitative judgments into scalable processes.

Skills

5+ years software engineering

Python

TypeScript

Golang

JavaScript

Data pipelines

Preference data collection

Rubric creation

Debugging

Communication

Large codebases

Job description

We are looking for experienced Senior Software Engineers to support a technical AI evaluation project involving data pipelines, evaluation workflows, and preference-data quality.

What You'll Do

• Design, refine, and maintain evaluation rubrics and criteria for preference data
• Review and label data with a strong focus on quality and consistency
• Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation
• Analyze findings and communicate clear technical recommendations
• Collaborate with researchers and engineers to turn qualitative judgments into scalable processes

Required Skills

• 5+ years of professional software engineering experience
• Strong proficiency in Python, particularly building and maintaining pipelines or infrastructure
• OR strong experience with TypeScript, Golang, or JavaScript
• Experience navigating or contributing to large codebases is a plus
• Hands-on experience with preference data collection and/or rubric creation
• Strong debugging, analytical, and problem-solving skills
• Excellent written and verbal communication
• Ability to evaluate technical quality and clearly explain why an implementation or output is effective

Engagement Details

Country: United States

Approved States: Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Texas, Virginia, Wisconsin, Wyoming