Remote LLM Observability Engineer (Early-Career)

Remote; San Francisco (CA); Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Unlimited PTO

Equity program

Remote home office stipend

Full benefits

Parental leave 16 weeks

Development allowance

Job summary

Honeycomb is a fully distributed company building observability for AI. You’ll deliver end-to-end AI observability, working on both backend (Go/Python) and frontend (TypeScript/React), and collaborating with product managers and designers to ship features customers rely on.

You’ll join a small, cross-functional team responsible for production-ready tooling, with on-call rotation after ~90 days, and a culture that values experimentation and rapid feedback.

Qualifications

• 3+ years of software engineering experience.
• Experience shipping customer-facing features at a SaaS company.
• Proficiency across the full stack: Go or Python backend and TypeScript/React frontend.
• Ability to work with product managers and designers.
• Regular use of AI tools in engineering work.
• Experience being on‑call.
• Ability to navigate ambiguity in a fast-moving environment.
• Bonus: experience building LLM or agent-powered features in production.
• Bonus: experience with observability tools like OpenTelemetry.

Responsibilities

• Deliver AI observability capabilities end to end, from ingestion to in-product visualizations.
• Contribute to data model and infrastructure to observe agents and ecosystems.
• Build systems that analyze AI signals such as cost, token usage, errors, and anomalies.
• Collaborate with product and design to ensure usable, intuitive features.
• Share learnings about AI system behavior across conversations and workloads.
• Iterate with fast feedback loops and experimentation, sharing wins and failures.

Skills

Software engineering

SaaS features

Go/Python backend

TypeScript/React frontend

PM/designer collaboration

AI tools usage

On-call experience

Ambiguity navigation

LLM features (bonus)

Observability tools (OpenTelemetry)

Job description

Honeycomb is a fully distributed company building observability for AI. You’ll deliver end-to-end AI observability, working on both backend (Go/Python) and frontend (TypeScript/React), and collaborating with product managers and designers to ship features customers rely on.

You’ll join a small, cross-functional team responsible for production-ready tooling, with on-call rotation after ~90 days, and a culture that values experimentation and rapid feedback.