Senior AI Observability & Telemetry Engineer

Bitdeer (NASDAQ: BTDR); Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Bitdeer, a leading Bitcoin mining and AI cloud company headquartered in Singapore, is seeking a Senior Telemetry Engineer to scale observability across HPC clusters.

You will architect high-cardinality telemetry, integrate hardware exporters, develop eBPF tooling, and drive real-time dashboards and billing metrics, while mentoring a growing team in a fast‑paced environment.

Qualifications

• 6+ years of software or site reliability engineering experience (Prometheus/OpenTelemetry)
• Deep hands-on Go and Kubernetes metric exporters
• Experience with kernel-level tracing tools (eBPF/BCC) and Linux performance tuning
• Familiarity with AI hardware metrics and high-performance network telemetry
• Strong technical leadership and cross-functional collaboration

Responsibilities

• Architect and scale a high-cardinality telemetry infrastructure using time-series databases
• Integrate hardware exporters into the Kubernetes observability stack
• Build eBPF-based diagnostic tools to trace bottlenecks across the cluster
• Develop automated dashboards and alerting pipelines for proactive remediation
• Design metric pipelines for real-time GPU and network utilization billing
• Collaborate with GPU Systems to create observability standards for AI workloads
• Lead design reviews for observability architecture and mentor team members

Skills

Go

Prometheus/OpenTelemetry

Kubernetes

eBPF / kernel tracing

Leadership & mentorship

Communications

Education

Bachelor's or Master’s in Computer Science or related field

Tools

VictoriaMetrics/Thanos/Mimir

Custom Kubernetes metric exporters

Kernel tracing tools (eBPF/BCC)

Job description

About Bitdeer

Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.

About Bitdeer

Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This includes equipment procurement, transport logistics, datacenter design and construction, equipment management, and network and facility operations. Bitdeer also offers advanced cloud capabilities to customers with a high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer operates globally with a diversified 3 GW energy portfolio, and deploys Bitcoin mining and HPC datacenters in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia.

What You Will Be Responsible For

• Architect and scale a high-cardinality telemetry infrastructure using highly available time-series databases (e.g., VictoriaMetrics, Thanos, or Mimir) capable of handling massive ingestion rates.
• Integrate complex hardware-level exporters (NVIDIA DCGM, network switch telemetry, IPMI/Redfish) directly into the Kubernetes observability stack to provide a unified view of the cluster.
• Build eBPF-based diagnostic tools to trace network congestion, kernel-level I/O latency, and distributed training bottlenecks across the cluster.
• Develop automated dashboards and alerting pipelines that trigger proactive cordoning of degraded hardware before it impacts customer training jobs.
• Design the metric pipelines required for accurate, multi-tenant consumption billing based on real-time GPU and network utilization metrics.
• Collaborate with the GPU Systems and Scheduling teams to create observability standards for "AI-native" workloads, ensuring deep insight into job efficiency and resource utilization.
• Lead technical design reviews for observability architecture, mentoring team members on best practices for high-performance telemetry collection and analysis.

How You Will Stand Out

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
• 6+ years of software or site reliability engineering, with deep, hands‑on expertise in the Prometheus/OpenTelemetry ecosystem.
• Advanced proficiency in Go and extensive experience writing custom Kubernetes metric exporters and operators.
• Hands‑on experience with kernel-level tracing tools (eBPF, BCC) and deep performance tuning of Linux systems.
• Strong familiarity with AI hardware metrics (GPU power states, SM utilization, memory bandwidth) and high-performance network telemetry.
• Proven track record of operating, debugging, and scaling large-scale telemetry stacks in high-performance computing or cloud environments.
• Strong technical leadership skills; ability to influence architectural decisions and align cross-functional teams around observability standards.
• Excellent communication skills, with the ability to translate complex system requirements into manageable engineering milestones.
• Experience working in high-velocity, high-growth engineering environments is strongly preferred.

What You Will Experience Working With Us

• A culture that values authenticity and diversity of thoughts and backgrounds;
• An inclusive and respectable environment with open workspaces and exciting start-up spirit;
• Fast‑growing company with the chance to network with industrial pioneers and enthusiasts;
• Ability to contribute directly and make an impact on the future of the digital asset industry;
• Involvement in new projects, developing processes/systems;
• Personal accountability, autonomy, fast growth, and learning opportunities;
• Attractive welfare benefits and developmental opportunities such as training and mentoring.

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, colour, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.