Senior Backend Engineer (AI Platform) - Scale Pipelines

Similarweb LTD; United States; Hybrid; USD 140,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

5 weeks vacation

Birthday day off

3 sick days

Multisport

MacBook Pro M5

Dual monitors

Standing desks

Team events

Equity

Career growth

Office in Prague

Job summary

Similarweb is building a centralized AI Platform and seeks a Senior Backend Engineer (AI Platform) to design and implement high-availability services powering AI workloads across the company. You will work on distributed orchestration, state persistence, and a fast Python SDK to support production-grade workflows.

You will architect scalable tool services, low-latency model gateways, and robust security/governance with cross-functional teams.

Qualifications

• 5+ years of software engineering experience in backend development.
• Strong system design background with asynchronous microservices and API design.
• Experience with distributed state management, containers, and CI/CD pipelines.

Responsibilities

• Core Systems Design: architect high-availability agent platform with distributed orchestration.
• API & Integration Architecture: design scalable MCP servers, gRPC/REST endpoints, secure data store wrappers.
• Low-Latency Model Infrastructure: build model gateways, routing, caching, and rate-limiting.
• Security & Governance: implement zero-trust patterns, RBAC/ABAC, data boundaries, audit logging.
• Reliability & Performance Engineering: optimize distributed execution, observability with tracing and metrics.

Skills

Python

System design

Backend architecture

REST/gRPC APIs

Distributed systems

CI/CD pipelines

Asynchronous microservices

Redis

Kafka

AWS

Kubernetes

Tools

Kafka

Redis

PostgreSQL

NoSQL

Docker

Kubernetes

AWS

Job description

Similarweb is building a centralized AI Platform and seeks a Senior Backend Engineer (AI Platform) to design and implement high-availability services powering AI workloads across the company. You will work on distributed orchestration, state persistence, and a fast Python SDK to support production-grade workflows.

You will architect scalable tool services, low-latency model gateways, and robust security/governance with cross-functional teams.