Senior Backend Engineer - AI/LLM Training & Evaluation

Kake Group; United States; Remote; USD 125,000 - 180,000; Full time

Job summary

Kake Group seeks a Senior Software Engineer to contribute to AI training data development and evaluation for AI agents and LLMs. You will work at the intersection of software engineering and artificial intelligence, writing prompts, delivering reference-quality code solutions, and evaluating model outputs to produce structured signals for smarter AI systems.

This role is not a traditional engineering position but a chance to shape how next-gen AI understands and reasons about code, alongside

Qualifications

• At least 5+ years of professional software engineering experience.
• Proficiency in Python, NodeJS + TypeScript, and FastAPI.
• Hands-on experience with Linux, Docker, and Git in development workflows.
• Strong experience writing functional and integration tests.

Responsibilities

• Develop and evaluate AI training data for AI agents and LLMs.
• Write prompts and produce reference-quality code solutions.
• Evaluate model outputs and provide structured human signals.
• Collaborate with AI labs and companies to improve safety and capability.

Skills

5+ years experience

Python

NodeJS

TypeScript

FastAPI

Testing experience

Tools

Linux

Docker

Git

Job description

Kake Group seeks a Senior Software Engineer to contribute to AI training data development and evaluation for AI agents and LLMs. You will work at the intersection of software engineering and artificial intelligence, writing prompts, delivering reference-quality code solutions, and evaluating model outputs to produce structured signals for smarter AI systems.

This role is not a traditional engineering position but a chance to shape how next-gen AI understands and reasons about code, alongside