Senior GenAI Platform Engineer: Build Scalable ML Infra

Preply; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Preply is seeking a Senior ML Platform Engineer to design and build the systems behind production GenAI workloads. You will drive the evolution of our GenAI Platform and turn recurring engineering needs into reliable self-service capabilities.

This hands-on role offers broad technical influence and the chance to shape system architecture, platform direction, and cross‑functional collaboration with Applied Science, Data, Product, Security and Engineering teams.

Responsibilities

• Architect unified gateway with automated routing, quota controls, and resilient fallback systems across model vendors.
• Drive system efficiency and low latency via dynamic traffic management, response caching, token budgeting, and cost allocation controls.
• Establish robust evaluation mechanisms to guarantee high precision, stability, and safety in model outputs.
• Deliver system observability, providing deep tracing, performance telemetry, cost analytics, continuous monitoring, and alerting across GenAI lifecycles.
• Standardize prompt engineering workflows with automated versioning, automated testing, governance, and CI/CD integrations for production delivery.
• Embed platform guardrails alongside Security and

Skills

Production code

Platform architecture

CI/CD

Observability

GenAI

Job description

Preply is seeking a Senior ML Platform Engineer to design and build the systems behind production GenAI workloads. You will drive the evolution of our GenAI Platform and turn recurring engineering needs into reliable self-service capabilities.

This hands-on role offers broad technical influence and the chance to shape system architecture, platform direction, and cross‑functional collaboration with Applied Science, Data, Product, Security and Engineering teams.