Generative AI Engineer

Few&Far; Berlin; Vor Ort; EUR 75.000 - 130.000; Vollzeit

Benefits dieser Stelle

Founding team role

Exceptional ownership and autonomy

Competitive salary

Zusammenfassung

A fast-growing tech startup in Berlin is seeking a Senior AI Platform / LLM Ops Engineer to drive the core infrastructure and AI operations. This role offers exceptional ownership, with responsibilities including setting up AWS foundations and implementing observability for AI systems. The position offers a competitive salary of €75k–130k and requires experience in managing production workloads and deploying secure CI/CD processes.

Qualifikationen

• Experience with production AI/LLM workloads with SLAs.
• Ability to manage budget and latency constraints.
• Hands-on experience with AWS and EKS infrastructure.
• Proficiency in implementing secure CI/CD processes.
• Familiarity with multi-tenant isolation and throttling mechanisms.
• Knowledge of observability tools like LangSmith.

Aufgaben

• Set up AWS/EKS foundation using Terraform.
• Build intelligent request routing across model providers.
• Implement end-to-end observability for the AI system.
• Establish a secure CI/CD pathway for model deployments.
• Design scalable architecture for startup to enterprise transition.
• Collaborate with cross-functional teams to create a production system.

Kenntnisse

Production AI/LLM workloads handling

AWS + EKS/Kubernetes infrastructure ownership

CI/CD implementation

Authentication/authorization patterns knowledge

Observability and guardrail stacks for LLM systems

Tools

Terraform

Jobbeschreibung

Principal Consultant | Building Platform teams for start‑ups & scale‑ups @ Few&Far

A fast‑growing European startup is on a mission to bring enterprise‑grade cloud efficiency to startups and SMEs. They’ve built an AI DevOps agent that automatically identifies and fixes wasted spend in AWS environments — delivering 20% savings from day one.

Backed by leading European VCs, they’re now expanding their founding engineering team (<5 people) to build and scale the platform from the ground up.

🔧 The Role

As a Senior AI Platform / LLM Ops Engineer, you’ll take ownership of the core infrastructure and AI execution layer powering the product.

Responsibilities

• Set up the initial AWS/EKS foundation (Terraform, workloads, queues, workers)
• Build intelligent request routing across multiple model providers with retries, fallback logic, and budget controls
• Implement full end‑to‑end observability: traces, logs, token usage, latency, answer quality
• Establish a safe CI/CD pathway for shipping prompts, tools, and model integrations
• Design scalable architecture that can support the journey from startup → enterprise
• Collaborate with DevOps, AI, backend, and frontend teams to turn the AI agent into a world‑class production system

This is a role where you’ll influence every key technical decision and have huge ownership from day one.

Qualifications

• Operated production AI/LLM workloads with SLAs
• Handled per‑tenant budget and latency constraints
• Owned AWS + EKS/Kubernetes infrastructure using Terraform
• Implemented CI/CD with gated approvals, canaries, secure releases
• Experience with authentication/authorization patterns (Cognito/OIDC, multi‑tenant isolation, per‑workspace throttling)
• Built observability and guardrail stacks for LLM systems (e.g., LangSmith, tracing, metrics, token spend tracking, audit logs)

You thrive in fast‑moving environments, want meaningful ownership, and enjoy turning ambiguity into architecture.

✨ What’s on Offer

• Founding team role (<5 engineers)
• Exceptional ownership and autonomy
• Competitive salary: €75k–130k (flexible for exceptional candidates)
• On‑site in Berlin or Munich

Seniority Level

Mid‑Senior level

Employment Type

Full‑time

Job Function

Information Technology

Industries

Staffing and Recruiting

Referrals increase your chances of interviewing at Few&Far by 2x

Get notified about new Generative AI Engineer jobs in Berlin, Germany.