Applied AI Engineer: Real-World ML Systems Builder

Appen Limited; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Appen Limited is seeking an Applied Research Engineer to build practical AI research assets supporting Frontier lab initiatives and customer engagements. This is an implementation-focused role for turning research concepts into working systems.

You will develop RL environments, LLM pipelines, evaluation harnesses, and deploy models for evaluation, inference, and automation, documenting experiments for reproducibility and sharing reusable assets with cross-functional teams.

Qualifications

• Bachelor’s, Master’s, or PhD in Computer Science, Engineering, Machine Learning, or a related technical field.
• 3+ years of professional engineering or relevant industry experience in AI/ML or software engineering.
• Strong software engineering skills and experience building reliable, maintainable AI systems.
• Hands‑on experience building agentic systems, reinforcement learning environments, LLM pipelines, or similar AI systems.
• Experience building evaluation harnesses, benchmarks, or model testing pipelines.
• Ability to work independently on technical problems and move quickly from an idea or research question to a working solution.
• Strong understanding of experimentation, reproducibility, and technical documentation.

Responsibilities

• Build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.
• Develop benchmarks and evaluation harnesses to measure model and data quality across areas such as accuracy, robustness, safety, latency, and cost.
• Build LLM pipelines and agentic systems that support research, evaluation, and customer trials.
• Run fine-tuning, adapter, and other model experiments to evaluate how data and methods influence model behavior.
• Deploy local or self-hosted models for evaluation, inference, and automation workflows.
• Document experiments, configurations, data, results, and known limitations so other engineers can reproduce and build on your work.
• Partner with the GenAI Research team and cross-functional stakeholders to turn technical work into reusable assets for customer engagements.

Skills

AI/ML experience

Software engineering

Agentic systems

LLM pipelines

Evaluation harnesses

Experimentation & docs

Independent problem solving

Synthetic data generation (nice tohave

Published research (nice to have)

SWE-bench familiarity

Open-weight model deployment (nice to)

Education

Advanced degree in CS/ML or related field

Tools

SWE-bench

Job description

Appen Limited is seeking an Applied Research Engineer to build practical AI research assets supporting Frontier lab initiatives and customer engagements. This is an implementation-focused role for turning research concepts into working systems.

You will develop RL environments, LLM pipelines, evaluation harnesses, and deploy models for evaluation, inference, and automation, documenting experiments for reproducibility and sharing reusable assets with cross-functional teams.