Senior AI Backend Engineer — Observability & ML

Software 3.0 LLC; Northern (KY); Remote; USD 125,000 - 225,000; Full time

Benefits offered by this job

Equity package

Medical, dental, vision

401(k)

Unlimited PTO

Parental leave

Mental health support

WFH stipend

Office options in NYC/SF

Job summary

Arize AI seeks a Backend Engineer to join a remote-first team building and scaling a leading ML observability platform. You will develop high‑performance services in Go, Python, Java, and TypeScript, contributing to analytics, APIs, and distributed systems.

You’ll work with cloud-native stacks, OLAP databases, and real‑time evaluation tools while collaborating with product and customer engineering teams to deliver robust solutions for enterprise clients.

Qualifications

• 5+ years of experience working with high-performance backend systems.
• Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
• Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
• Previous work building and operating highly complex SaaS platforms/systems.
• Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Responsibilities

• Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
• Build high-volume and highly available analytics systems.
• Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
• Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
• Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
• Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
• Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
• Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
• Contribute to the build our own in-house AI Agents

Skills

Go

Python

TypeScript/Node

Java

Cloud platforms

Kubernetes

AI/LLM ecosystem

Tools

Kafka

Gazette

Prometheus

OLAP databases

Job description

Arize AI seeks a Backend Engineer to join a remote-first team building and scaling a leading ML observability platform. You will develop high‑performance services in Go, Python, Java, and TypeScript, contributing to analytics, APIs, and distributed systems.

You’ll work with cloud-native stacks, OLAP databases, and real‑time evaluation tools while collaborating with product and customer engineering teams to deliver robust solutions for enterprise clients.