Senior Backend Engineer — AI Platform & LLM Infra

Menlo Ventures; New York (NY); On-site; USD 190,000 - 261,250; Full time

Benefits offered by this job

Comprehensive benefits

Annual performance bonus

Equity opportunities

Job summary

A leading data and AI firm is seeking a skilled engineer to build LLM infrastructure that powers trillions of tokens weekly. The ideal candidate will have over 8 years in backend or infrastructure engineering, with strong skills in Scala, Go, or Python. Responsibilities include improving the efficiency of distributed AI workloads and collaborating with various teams. Databricks offers a competitive salary range of $190,000 to $261,250 USD, plus additional benefits.

Qualifications

• 8+ years of experience in backend or infrastructure engineering.
• Strong programming skills in Scala, Go, or Python.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with service-oriented architecture, deployment pipelines, and system observability.

Responsibilities

• Build LLM infrastructure powering trillions of tokens per week.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams to deliver seamless experiences.
• Shape how developers and data scientists build and interact with AI.

Skills

Scala

Go

Python

Backend engineering

Infrastructure engineering

Distributed systems

Scalable APIs

Cloud-native infrastructure

Service-oriented architecture

Job description

A leading data and AI firm is seeking a skilled engineer to build LLM infrastructure that powers trillions of tokens weekly. The ideal candidate will have over 8 years in backend or infrastructure engineering, with strong skills in Scala, Go, or Python. Responsibilities include improving the efficiency of distributed AI workloads and collaborating with various teams. Databricks offers a competitive salary range of $190,000 to $261,250 USD, plus additional benefits.