AI Engineer - Inference

Security Engineer, Application - Greenhouse

Sydney

On-site

AUD 140,000 - 190,000

Full time

4 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Firmus Technologies, a global AI infrastructure leader, seeks a Senior AI Engineer (Inferencing) to enhance our AI factory's inference capabilities. You will build reliable, secure, scalable endpoints for internal and external use, aligning with our Model-to-Grid roadmap.

You will define model onboarding, deployment, benchmarking, and lifecycle management, enabling predictable performance while controlling cost and data handling. Join a founder-led team moving fast with a direct line to outcomes.

Responsibilities

  • Build, operate, and continuously improve self-hosted AI inference services for internal applications, customer-facing products, and future Inference-as-a-service offerings.
  • Define and implement standard model-onboarding workflows covering model intake, compatibility validation, packaging, runtime selection, optimization, deployment, endpoint registration, testing, release, and lifecycle management.

Job description

Firmus Technologies

Firmus Technologies is a global leader pioneering the development and operation of efficient AI infrastructure across Asia Pacific.

Founded in Australia in 2019, our mission is to create the most efficient AI infrastructure by combining cutting‑edge technology with a steadfast commitment to sustainability.

At Firmus, we are unique in our approach. We design, build, and operate a new class of digital infrastructure - the AI Factory. Through our model-to-grid technology approach, we have pushed the boundaries of multi-generational liquid cooling systems, energy management, AI software orchestration, and construction. For our customers, this approach allows us to make every watt count and deliver low-cost AI tokens globally.

Firmus AI Cloud

Our large-scale GPU cloud platform, Firmus AI Cloud, is purpose-built to deliver energy-efficient AI compute at scale to customers.

It empowers developers, enterprises, educational institutions, and government users to train and deploy AI models with unmatched efficiency and cost savings. With an ever-growing suite of services and applications, we are committed to delivering a cloud experience that is market‑leading, proprietary, and built to scale.

Why Firmus?

As an NVIDIA Cloud and Engineering partner in Asia Pacific, you will gain skills, experience, and exposure across the AI industry and be part of shaping what this industry looks like for decades to come.

We are founder‑led, not a big corporate. Decisions happen fast, our leaders are accessible, and there's minimum bureaucracy between you and the work. Ownership comes early. Whatever your role, you will have a direct line to outcomes, helping shape how the business grows as we scale nationally across a long‑term, large‑scale roadmap.

Work alongside founders and experts in AI infrastructure, energy systems and next‑generation compute.

What we build here has impact beyond the business. Our AI Factories are designed to operate as assets to the energy grid to actively strengthen the communities and regions they operate in rather than drawing from them.

Considering applying? You don't need a perfect background to join our team. If you're driven and curious, there's a path for you. We back our people to grow into new domains and take on challenges beyond their previous experience.

ROLE SUMMARY

The Senior AI Engineer (Inferencing) will build and improve the AI & Applications team's inference capability, making models available as reliable, secure, scalable, and high-performance endpoints for internal products, external customers, and future Inference-as-a-service offerings.

The role will establish the engineering foundation for self-hosted model serving in the organization's AI-factory environment. This includes model onboarding, deployment, endpoint provisioning, runtime selection, performance benchmarking and optimization, observability, capacity management, security, and operational lifecycle management. The objective is to provide users with predictable and efficient access to models while maintaining control over performance, cost, data handling, deployment configuration, and infrastructure utilization.

The role is a key contributor to the Model-to-Grid product and agentic applications roadmap. It will convert model and runtime characteristics into benchmarked, repeatable inference recipes and endpoint profiles that can inform workload scheduling, topology‑aware placement, capacity planning, performance recommendations, and operational decision‑making. It will also provide the governed and fit‑for‑purpose model endpoints needed by agentic systems for reasoning, retrieval, tool use, diagnosis, recommendation, and controlled automation.

KEY RESPONSIBILITIES
  • Build, operate, and continuously improve self-hosted AI inference services for internal applications, customer‑facing products, and future Inference-as-a-service offerings.
  • Define and implement standard model‑onboarding workflows covering model intake, compatibility validation, packaging, runtime selection, optimization, deployment, endpoint registration, testing, release, and lifecycle management.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Inference Engineer — Self-Hosted Endpoints
Senior AI Inference Engineer — Self-Hosted Endpoints

Security Engineer, Application - Greenhouse • Sydney

On-site
AUD 140,000 - 190,000
Senior AI Security Engineer
Senior AI Security Engineer

Security Engineer, Application - Greenhouse • Sydney

On-site
AUD 180,000 - 240,000
Site Reliability Engineer, AI Infrastructure
Site Reliability Engineer, AI Infrastructure

Firmus Technologies • City of Melbourne

On-site
AUD 120,000 - 180,000
Site Reliability Engineer, AI Infrastructure
Site Reliability Engineer, AI Infrastructure

Firmus • City of Melbourne

On-site
AUD 120,000 - 160,000
Site Reliability Engineer
Site Reliability Engineer

Matchbox • City of Launceston

On-site
AUD 110,000 - 170,000
Senior AI Security Engineer
Senior AI Security Engineer

Firmus Technologies • Sydney

On-site
AUD 180,000 - 240,000
Senior Software Engineer, AI Job Orchestration
Senior Software Engineer, AI Job Orchestration

Matchbox • Sydney

On-site
AUD 150,000 - 210,000
Site Reliability Engineer
Site Reliability Engineer

Firmus Technologies • City of Launceston

On-site
AUD 90,000 - 120,000
Principal AI Infrastructure Engineer, Kubernetes
Principal AI Infrastructure Engineer, Kubernetes

Firmus Technologies • Sydney

On-site
AUD 170,000 - 210,000
Compliance & GRC Lead for AI Infrastructure
Compliance & GRC Lead for AI Infrastructure

Firmus Technologies • Sydney

On-site
AUD 140,000 - 190,000