Lead AI Platform Engineer - Remote, Observability

Jobgether SRL; Australia; Remote; AUD 219,000 - 268,000; Full time

Benefits offered by this job

Annual cash compensation of $170,000 N

Equity grants

35 days paid time off per year

Fully remote work environment

Global, distributed team

Job summary

Jobgether SRL is seeking a Lead Engineer, AI Platform based in Australia. You will lead the engineering foundation for reliable, scalable AI-powered features, building evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI agents.

The role blends hands-on software development with technical leadership and people management. You will work in a highly remote and asynchronous environment, collaborating with AI engineering teams to shape the technical direction

Qualifications

• Proven ability to lead and manage an AI/ML engineering team.
• Experience shipping production software with measurable quality.
• Strong English communication skills at a fluent level.
• Experience with evaluating AI systems and experiments at scale.
• Comfortable working in a fast-paced, ambiguous environment.

Responsibilities

• Design, build, and own evaluation infrastructure for AI agents and multi-turn conversations.
• Develop observability and diagnostic capabilities across planning, tool use, and agent trajectories.
• Investigate failures and translate findings into actionable projects for AI teams.
• Expand datasets via human annotation, AI-generated data, and simulated conversations.
• Create structured experimentation frameworks for prompts, models, and agent harnesses.
• Identify cost and latency optimization opportunities in AI systems.
• Set technical direction and manage day-to-day priorities for the AI Quality team.
• Collaborate with AI Core teams to measure impact of changes on product quality.
• Establish engineering practices supporting reliable, scalable production AI.

Skills

Technical leadership

People management

English proficiency

Analytical thinking

Experimentation

Tools

Ruby on Rails

Python

LangSmith

Job description

Jobgether SRL is seeking a Lead Engineer, AI Platform based in Australia. You will lead the engineering foundation for reliable, scalable AI-powered features, building evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI agents.

The role blends hands-on software development with technical leadership and people management. You will work in a highly remote and asynchronous environment, collaborating with AI engineering teams to shape the technical direction