Remote Open-Source LLM Evaluation Engineer

Ragas; United States; Remote; USD 60,000 - 180,000; Full time

Benefits offered by this job

Remote role

Equity: 0.5–2.5%

Competitive compensation

Job summary

Ragas is seeking a Python-focused engineer to build and maintain an open-source library that helps developers evaluate applications powered by large language models. The role blends feature development with active user support to make evaluation workflows more capable.

This remote position offers a compensation range of $60,000–$180,000 per year plus equity and the chance to contribute to meaningful open-source tooling at an early-stage company.

Qualifications

• Proficiency in Python.
• Passion for open-source software and developer tools.
• Experience building or maintaining open-source projects, or significant contributions.

Responsibilities

• Develop features to help users evaluate language model applications.
• Maintain and improve the open-source library.
• Respond to user issues and feature requests.
• Investigate and fix bugs.

Skills

Python proficiency

Open-source passion

Open-source experience

Interest in early-stage startups

Job description

Ragas is seeking a Python-focused engineer to build and maintain an open-source library that helps developers evaluate applications powered by large language models. The role blends feature development with active user support to make evaluation workflows more capable.

This remote position offers a compensation range of $60,000–$180,000 per year plus equity and the chance to contribute to meaningful open-source tooling at an early-stage company.