Principal Observability Engineer: AI/ML Telemetry

Roblox Corporation; San Mateo (CA); Hybrid; USD 295,000 - 345,000; Full time

Benefits offered by this job

Hybrid in San Mateo HQ

Onsite Tue-Thu presence

Job summary

Roblox Corporation in San Mateo, CA, is seeking a Principal Software Engineer for the Observability team. You will own end-to-end visibility across telemetry, tracing, and logs, partnering with business teams to shape the roadmap and deliver scalable, reliable infrastructure for AI/ML systems.

You will mentor engineers, evolve a next-generation observability platform handling PBs of data daily, and report to the Engineering Manager of Observability.

Qualifications

• 8+ years of working experience building, maintaining and evolving large-scale distributed systems.
• Experience owning end-to-end availability and performance of critical services.
• Proven ability to mentor junior engineers and lead teams.

Responsibilities

• Lead end-to-end observability projects and roadmaps.
• Develop novel monitoring solutions for AI/ML systems across lifecycle.
• Own and evolve observability infrastructure for scale and reliability.
• Architect next‑gen observability platform handling PBs of data daily.

Skills

Distributed systems

Open Source contributions

Mentoring

Learning mindset

Education

BS in Computer Science

Masters degree

Job description

Roblox Corporation in San Mateo, CA, is seeking a Principal Software Engineer for the Observability team. You will own end-to-end visibility across telemetry, tracing, and logs, partnering with business teams to shape the roadmap and deliver scalable, reliable infrastructure for AI/ML systems.

You will mentor engineers, evolve a next-generation observability platform handling PBs of data daily, and report to the Engineering Manager of Observability.