Inference Performance Engineer - Benchmarking & Capacity

Bitdeer Technologies Group

Singapore

On-site

SGD 120,000 - 170,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Welfare benefits
Training and mentoring

Job summary

Bitdeer Technologies Group in Singapore seeks an Inference Performance Engineer to align MaaS benchmarks with real production workloads. You will characterize traffic shapes, keep benchmarking honest, and convert results into capacity plans and unit-cost economics for the business.

The role requires a data-first mindset, experience with GPU-backed inference workloads, and collaboration with infrastructure and finance to ensure metrics and costs reflect reality.

Qualifications

  • 5+ years of experience in performance engineering or applied ML systems on large-scale, latency-sensitive distributed services.
  • Experience characterizing production traffic statistically — distributions of request rate, prompt/output lengths, concurrency, burstiness.
  • Knowledge of modern LLM inference internals and serving frameworks.
  • Experience designing, running, or auditing load-testing and benchmarking tooling and reconciling output with live telemetry.
  • Fluency with observability stacks and metric definitions used across engineering, product, and leadership dashboards.

Responsibilities

  • Characterize production traffic and build models of prompt/output lengths, concurrency, and burstiness.
  • Own validation loop between load-testing and live production behavior; update benchmarks as production shifts.
  • Translate workload data into capacity forecasts and cost models for GPU utilization and pricing.
  • Define canonical metric definitions (latency percentiles, throughput, utilization) across teams.
  • Build dashboards and reports to give leadership a trusted view of performance and cost trends.

Skills

Performance engineering
Capacity planning
Applied ML systems
LLM inference workloads

Tools

Python/Pandas
SQL
Spark
k6
Locust

Job description

Bitdeer Technologies Group in Singapore seeks an Inference Performance Engineer to align MaaS benchmarks with real production workloads. You will characterize traffic shapes, keep benchmarking honest, and convert results into capacity plans and unit-cost economics for the business.

The role requires a data-first mindset, experience with GPU-backed inference workloads, and collaboration with infrastructure and finance to ensure metrics and costs reflect reality.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Inference Performance Engineer
AI Inference Performance Engineer

Bitdeer Technologies Group • Singapore

On-site
SGD 180,000 - 280,000
Welfare benefits
Training & mentoring
Inference Performance Engineer - MaaS
Inference Performance Engineer - MaaS

Bitdeer Technologies Group • Singapore

On-site
SGD 180,000 - 280,000
Welfare benefits
Training & mentoring
Senior LLM Performance & Benchmark Engineer
Senior LLM Performance & Benchmark Engineer

Bitdeer (NASDAQ: BTDR) • Singapore

On-site
SGD 120,000 - 180,000
Senior LLM Inference Performance Engineer
Senior LLM Inference Performance Engineer

Bitdeer (NASDAQ: BTDR) • Singapore

On-site
SGD 120,000 - 180,000
Welfare benefits
Training and mentoring
Senior AI Platform Reliability Engineer (Kubernetes + GPU)
Senior AI Platform Reliability Engineer (Kubernetes + GPU)

BITDEER AI PTE. LTD. • Singapore

On-site
SGD 180,000 - 260,000
Training & mentoring
Competitive benefits
Growth opportunities
AI Benchmark Engineer
AI Benchmark Engineer

Clera • Singapore

On-site
SGD 128,000 - 218,000
Visa sponsorship
Senior InfiniBand GPU Cloud Network Architect
Senior InfiniBand GPU Cloud Network Architect

Bitdeer • Singapore

On-site
SGD 90,000 - 130,000
Senior LLM Inference Performance Engineer
Senior LLM Inference Performance Engineer

Bitdeer Group • Singapore

On-site
SGD 150,000 - 210,000
Senior InfiniBand & RoCE Network Architect (GPU Cloud)
Senior InfiniBand & RoCE Network Architect (GPU Cloud)

Bitdeer Technologies Group • Singapore

On-site
SGD 120,000 - 180,000
Training and mentoring
Senior LLM Performance & Evaluation Engineer
Senior LLM Performance & Evaluation Engineer

Bitdeer Group • Singapore

On-site
SGD 120,000 - 180,000