Remote Staff Engineer – AI Inference Platform

servescale.ai; Italia; Remote; EUR 70,000 - 110,000; Full time

Job summary

servescale.ai is seeking a Member of Technical Staff to design, build, and maintain core components of our AI inference platform. You will focus on scalability, reliability, and cost efficiency while collaborating with product, infra, and data teams to optimize model placement and resource utilization across cloud and on‑prem environments.

You will implement backend services and APIs, enhance observability, participate in code reviews, and contribute to technical design and documentation.

Qualifications

• Desire to experiment with AI in the software development process; openness to using AI tools such as CODEX or Claude Code to support and enhance the development process.

Responsibilities

• Design, build, and maintain core components of our AI inference platform with emphasis on scalability, reliability, and cost efficiency.
• Collaborate with product, infrastructure, and data teams to architect solutions that optimize model placement, resource utilization, and performance across cloud and on‑prem environments.
• Implement backend services and APIs, improve system observability, participate in code reviews, and contribute to technical design discussions and documentation.
• Help troubleshoot production issues, refine deployment pipelines, and support new feature rollouts for enterprise customers.

Skills

Python/Go/Java

Distributed systems

Cloud infra

Docker

Kubernetes

CI/CD

Git

Observability

AI/ML platforms

Team communication

Education

Bachelor's or Master’s in CS/Engineering

Tools

Docker

Kubernetes

Git

CI/CD pipelines

Job description

servescale.ai is seeking a Member of Technical Staff to design, build, and maintain core components of our AI inference platform. You will focus on scalability, reliability, and cost efficiency while collaborating with product, infra, and data teams to optimize model placement and resource utilization across cloud and on‑prem environments.

You will implement backend services and APIs, enhance observability, participate in code reviews, and contribute to technical design and documentation.