Senior Backend Engineer: Machine Learning Infrastructure

Lever, Inc.

Netherlands

Remote

EUR 71,000 - 106,000

Full time

2 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Fully remote environment
Unlimited vacation
Home-office stipend
Apple laptop provided
Annual training budget
Parental leave
Stock options

Job summary

Lever, Inc. invites applications for a Senior Backend Engineer: Machine Learning Infrastructure based in the Netherlands.

You will own backend services and data pipelines for ML infrastructure, focusing on scalable, reliable systems that support ML workloads including LLMs. You will collaborate with ML and product teams, design end-to-end platform capabilities, and drive improvements from design through deployment with a strong ownership mindset.

Qualifications

  • 5+ years in backend/platform engineering roles with distributed systems focus.
  • Proficient in Python; cloud exposure (AWS/GCP/Azure) or self-managed Kubernetes.
  • Strong data-structure and algorithm knowledge; solid system design mindset.
  • Experience with ML platforms/infrastructure and AI-assisted tools.
  • Shows ownership, initiative, and communication across teams.

Responsibilities

  • Design, build, deploy, and operate high-load backend services for ML infra.
  • Own core ML services and data pipelines end-to-end, including observability.
  • Create scalable, reusable infrastructure components for ML workloads.
  • Collaborate with ML and product engineers to meet requirements.
  • Make architectural decisions with emphasis on scalability and reliability.
  • Maintain high reliability, performance, and maintainability.
  • Proactively identify and resolve technical issues.
  • Leverage AI-assisted tools while preserving strong design ownership.
  • Share knowledge and help teammates solve technical challenges.

Skills

5+ years backend engineering
Python
Cloud experience (AWS/GCP/Azure)
Distributed systems
System design
AI-assisted development tools
Ownership and accountability
Communication and collaboration
Rust / C / C++ / Go (advantage)
ML platforms / ML infrastructure
Vector databases (Qdrant, Milvus, Weav
Model serving / inference infra
Terraform / IaC

Tools

Kubernetes
Terraform
OpenSearch
Qdrant
Milvus
Weaviate
pgvector

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Backend Engineer: Machine Learning Infrastructure based in Netherlands.

As a Senior Backend Engineer, you’ll help build the infrastructure that enables machine learning teams to develop, deploy, and operate models reliably at scale.
You’ll own critical backend services, data pipelines, and platform capabilities supporting workloads ranging from traditional machine learning to LLMs.
The role combines distributed systems engineering, cloud infrastructure, API development, observability, and platform design.
You’ll work closely with ML and product teams to understand their needs and turn them into reusable, self-service infrastructure.
You’ll have significant autonomy to make technical decisions, evaluate trade-offs, and take solutions from design through continuous improvement.
The environment is remote-first, collaborative, and strongly oriented toward ownership, thoughtful engineering, and modern AI-assisted development.
This is an opportunity to have a direct impact on how teams build and operate machine learning products at scale.

Accountabilities
  • Design, build, deploy, and operate high-load distributed backend services and APIs that support machine learning infrastructure.
  • Take end-to-end ownership of core ML services and associated data pipelines, from system design and implementation through deployment, observability, maintenance, and continuous improvement.
  • Build reliable, scalable, and reusable infrastructure components that make machine learning workloads easier for product and ML teams to run and operate.
  • Partner closely with ML and product engineers to understand their requirements and translate them into effective platform capabilities and services.
  • Make and communicate technical decisions by evaluating architectural options, trade-offs, scalability, reliability, and operational requirements.
  • Maintain a high standard for service reliability, performance, observability, and maintainability.
  • Proactively identify technical and operational problems and take ownership of resolving them rather than allowing issues to remain unaddressed.
  • Use modern AI-assisted development tools thoughtfully while maintaining strong ownership of system design, engineering decisions, and code quality.
  • Contribute to a collaborative engineering culture by sharing knowledge, supporting teammates, and helping others solve technical challenges.
Requirements
  • 5+ years of professional experience in backend engineering, platform engineering, or a closely related discipline.
  • Extensive professional experience with Python, the primary programming language used in the environment.
  • Hands-on experience developing and operating software on a public cloud platform such as AWS, GCP, or Azure, or working with self-managed Kubernetes; experience with AWS is particularly relevant.
  • Strong experience designing and building distributed, high-load services and APIs.
  • Solid understanding of data structures, algorithms, and the trade-offs involved in selecting and implementing them.
  • Strong system-design mindset, with the ability to design solutions before implementation and understand the architectural implications of technical decisions.
  • Experience working effectively with modern AI-assisted coding and development tools, combined with the judgment to understand their appropriate use and limitations.
  • High level of ownership, initiative, and accountability, with a proactive approach to identifying and solving problems.
  • Strong communication and collaboration skills, with a friendly and supportive approach to working with teammates and cross-functional partners.
  • Experience with Rust, C, C++, or Go is a strong advantage.
  • Previous experience developing or contributing to ML platforms or machine learning infrastructure is highly valued.
  • Experience setting up and operating vector databases such as Qdrant, Milvus, Weaviate, OpenSearch, or pgvector is a plus.
  • Experience with model serving or inference infrastructure, including LLM workloads, is advantageous.
  • Experience with Infrastructure as Code tools such as Terraform is a plus.
Benefits
  • Fully remote working environment, allowing you to choose where you live.
  • Unlimited vacation time, with employees strongly encouraged to take at least three weeks of vacation each year.
  • Home-office stipend to help you create a productive and comfortable remote workspace.
  • Apple laptop provided for new employees.
  • Annual training and professional development budget.
  • Maternity and paternity leave for eligible employees.
  • Competitive base salary of $80,000–$120,000 USD, depending on knowledge, skills, experience, and interview results.
  • Stock options offered in addition to the base salary.
  • Regular team offsites providing opportunities for collaboration and connection.
  • Opportunity to work with experienced colleagues and contribute to meaningful, technically challenging projects.

We appreciate your interest and wish you the best!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Machine Learning Engineer (AI)
Senior Machine Learning Engineer (AI)

Bond Personnel Group • Rotterdam, Amsterdam

On-site
EUR 65,000 - 85,000
Flexible working hours
Dedicated time for passion projects
Supportive, learning-focused startup environment
Machine Learning Engineer
Machine Learning Engineer

KickstartAI • Randstad

On-site
EUR 65,000 - 85,000
Competitive salary package
15% pension contribution
26 weeks fully paid parental leave
+8
(Senior) Product Engineer (Backend)
(Senior) Product Engineer (Backend)

Lever, Inc. • Netherlands

On-site
EUR 70,000 - 100,000
Remote-first working model
In-person team events Berlin/STuttgart
EU remote flexibility
+5
Senior Backend Engineer, ML Infra — Remote & Unlimited PTO
Senior Backend Engineer, ML Infra — Remote & Unlimited PTO

Lever, Inc. • Netherlands

Remote
EUR 71,000 - 106,000
Fully remote environment
Unlimited vacation
Home-office stipend
+4
Data & ML Infrastructure Engineer
Data & ML Infrastructure Engineer

Optics11 • Netherlands

On-site
EUR 90,000 - 130,000
Machine Learning Engineer
Machine Learning Engineer

A2G Consulting BV (A2G Technologies) • Amsterdam

Hybrid
EUR 90,000 - 130,000
Visa sponsorship
Bonus potential
Certification reimbursement
+2
Senior Infrastructure Engineer
Senior Infrastructure Engineer

Jobgether • Netherlands

Remote
EUR 90,000 - 130,000
Fully remote work
(Senior or Staff) Backend Engineer, AI tooling
(Senior or Staff) Backend Engineer, AI tooling

Lever, Inc. • Netherlands

On-site
EUR 120,000 - 150,000
RSUs
25 days annual leave
Remote work option in Romania
+2
Senior Applied AI Solutions Engineer
Senior Applied AI Solutions Engineer

Jobgether • Netherlands

On-site
EUR 174,000 - 304,000
Competitive compensation
Flexible working arrangements
International environment
+1
Senior Data Engineer
Senior Data Engineer

Anchormen • Amsterdam

On-site
EUR 70,000 - 110,000
8% Holiday allowance
Bonus
Pension
+3