Senior Backend Engineer: Machine Learning Infrastructure

Lever, Inc.; Germany (OH); Remote; EUR 71,000 - 106,000; Full time

Benefits offered by this job

Fully remote work

Unlimited vacation

Home-office stipend

Apple laptop provided

Annual training budget

Parental leave

Stock options

Team offsites

Job summary

Lever, Inc. is seeking a Senior Backend Engineer: Machine Learning Infrastructure based in Germany. You will design and operate high-load backend services and data pipelines that support ML workloads and LLMs. The role emphasizes ownership, scalable design, and close collaboration with ML and product teams.

You will work in a remote-first environment with autonomy to evolve platform capabilities, ensuring observability, reliability, and performance across services used by ML teams.

Qualifications

• 5+ years of backend/platform engineering experience.
• Proficiency in Python and building distributed services.
• Experience with public clouds (AWS, GCP, Azure) or self-managed Kubernetes.

Responsibilities

• Design, build, deploy, and operate high-load distributed backend services and APIs for ML infra.
• Own core ML services and data pipelines end-to-end from design to deployment.
• Build scalable infrastructure components simplifying ML workloads for teams.

Skills

Backend engineering

Python

Cloud platforms

Distributed systems

System design

AI tooling

Ownership

Communication

Rust/C/C++/Go

ML platforms

Vector databases

LLMs

Terraform

Tools

Terraform

Kubernetes

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Backend Engineer: Machine Learning Infrastructure based in Germany.

As a Senior Backend Engineer, you’ll help build the infrastructure that enables machine learning teams to develop, deploy, and operate models reliably at scale.
You’ll own critical backend services, data pipelines, and platform capabilities supporting workloads ranging from traditional machine learning to LLMs.
The role combines distributed systems engineering, cloud infrastructure, API development, observability, and platform design.
You’ll work closely with ML and product teams to understand their needs and turn them into reusable, self-service infrastructure.
You’ll have significant autonomy to make technical decisions, evaluate trade-offs, and take solutions from design through continuous improvement.
The environment is remote-first, collaborative, and strongly oriented toward ownership, thoughtful engineering, and modern AI-assisted development.
This is an opportunity to have a direct impact on how teams build and operate machine learning products at scale.

Accountabilities

• Design, build, deploy, and operate high-load distributed backend services and APIs that support machine learning infrastructure.
• Take end-to-end ownership of core ML services and associated data pipelines, from system design and implementation through deployment, observability, maintenance, and continuous improvement.
• Build reliable, scalable, and reusable infrastructure components that make machine learning workloads easier for product and ML teams to run and operate.
• Partner closely with ML and product engineers to understand their requirements and translate them into effective platform capabilities and services.
• Make and communicate technical decisions by evaluating architectural options, trade-offs, scalability, reliability, and operational requirements.
• Maintain a high standard for service reliability, performance, observability, and maintainability.
• Proactively identify technical and operational problems and take ownership of resolving them rather than allowing issues to remain unaddressed.
• Use modern AI-assisted development tools thoughtfully while maintaining strong ownership of system design, engineering decisions, and code quality.
• Contribute to a collaborative engineering culture by sharing knowledge, supporting teammates, and helping others solve technical challenges.

Requirements

• 5+ years of professional experience in backend engineering, platform engineering, or a closely related discipline.
• Extensive professional experience with Python, the primary programming language used in the environment.
• Hands-on experience developing and operating software on a public cloud platform such as AWS, GCP, or Azure, or working with self-managed Kubernetes; experience with AWS is particularly relevant.
• Strong experience designing and building distributed, high-load services and APIs.
• Solid understanding of data structures, algorithms, and the trade-offs involved in selecting and implementing them.
• Strong system-design mindset, with the ability to design solutions before implementation and understand the architectural implications of technical decisions.
• Experience working effectively with modern AI-assisted coding and development tools, combined with the judgment to understand their appropriate use and limitations.
• High level of ownership, initiative, and accountability, with a proactive approach to identifying and solving problems.
• Strong communication and collaboration skills, with a friendly and supportive approach to working with teammates and cross-functional partners.
• Experience with Rust, C, C++, or Go is a strong advantage.
• Previous experience developing or contributing to ML platforms or machine learning infrastructure is highly valued.
• Experience setting up and operating vector databases such as Qdrant, Milvus, Weaviate, OpenSearch, or pgvector is a plus.
• Experience with model serving or inference infrastructure, including LLM workloads, is advantageous.
• Experience with Infrastructure as Code tools such as Terraform is a plus.

Benefits

• Fully remote working environment, allowing you to choose where you live.
• Unlimited vacation time, with employees strongly encouraged to take at least three weeks of vacation each year.
• Home-office stipend to help you create a productive and comfortable remote workspace.
• Apple laptop provided for new employees.
• Annual training and professional development budget.
• Maternity and paternity leave for eligible employees.
• Competitive base salary of $80,000–$120,000 USD, depending on knowledge, skills, experience, and interview results.
• Stock options offered in addition to the base salary.
• Regular team offsites providing opportunities for collaboration and connection.
• Opportunity to work with experienced colleagues and contribute to meaningful, technically challenging projects.