Senior Backend Engineer, AI Platform Infra & LLM

Databricks; New York (NY); On-site; USD 190,000 - 261,250; Full time

Job summary

A leading data and AI infrastructure company in New York is seeking an experienced engineer to join their AI Platform team. The ideal candidate will have over 8 years in backend or infrastructure engineering, with strong skills in Scala, Go, or Python. Responsibilities include building LLM infrastructure and improving AI workload efficiency. This role offers a competitive salary ranging from $190,000 to $261,250, committed to fostering a diverse and inclusive environment.

Qualifications

• 8+ years of experience in backend or infrastructure engineering.
• Strong programming skills in Scala, Go, or Python.
• Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
• Familiarity with service-oriented architecture, deployment pipelines, and system observability.
• Strong product and ownership mindset.

Responsibilities

• Build LLM infrastructure powering trillions of tokens per week.
• Improve reliability, latency, and efficiency of AI workloads.
• Collaborate to deliver seamless end-to-end experiences.
• Shape developer interactions with AI on Databricks.

Skills

Backend or infrastructure engineering

Programming in Scala, Go, or Python

Distributed systems knowledge

Scalable APIs

Cloud-native infrastructure

Service-oriented architecture

Deployment pipelines

System observability

Product ownership mindset

Job description

A leading data and AI infrastructure company in New York is seeking an experienced engineer to join their AI Platform team. The ideal candidate will have over 8 years in backend or infrastructure engineering, with strong skills in Scala, Go, or Python. Responsibilities include building LLM infrastructure and improving AI workload efficiency. This role offers a competitive salary ranging from $190,000 to $261,250, committed to fostering a diverse and inclusive environment.