AI Platform Engineer - LLM Runtime & Observability

Nimbly Pty Ltd.; Sydney; On-site; AUD 100,000 - 150,000; Full time

Job summary

Nimbly Pty Ltd. is seeking a talented developer to build and operate a multi-tenant agentic runtime for Agent360. You will be responsible for optimizing observability, evaluations, and guardrails across our LLM call paths, as well as integrating with platforms like Bedrock and Azure AI Foundry.

The ideal candidate should have strong skills in Node.js and TypeScript, and production experience with leading LLM providers. Familiarity with vector stores and observability tooling is essential for this role.

Qualifications

• Strong Node.js and TypeScript development skills.
• Production experience with major LLM providers.
• Comfortable with vector stores and RAG architectures.

Responsibilities

• Build and operate the multi-tenant agentic runtime for Agent360.
• Own observability, evals, and guardrails across LLM call paths.
• Integrate with Bedrock, Azure AI Foundry, and open-weight models.
• Codify patterns into reusable platform primitives.

Skills

Node.js

TypeScript

LLM integration

Observability tooling

Tools

Pinecone

pgvector

OpenLLMetry

LangSmith

Job description

Nimbly Pty Ltd. is seeking a talented developer to build and operate a multi-tenant agentic runtime for Agent360. You will be responsible for optimizing observability, evaluations, and guardrails across our LLM call paths, as well as integrating with platforms like Bedrock and Azure AI Foundry.

The ideal candidate should have strong skills in Node.js and TypeScript, and production experience with leading LLM providers. Familiarity with vector stores and observability tooling is essential for this role.