Senior AI Platform Engineer: Scalable Infra & AI Tools

Plum Fintech; Ohio; Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Stock options

Private health insurance

Annual training budget

Plum Premium access

Flexible remote work: 2 days/week in L

Team breakfasts and team lunches

25 days holiday + holidays

45 work-from-anywhere days

2 weeks sabbatical after 4 years

Enhanced parental leave

Volunteering day

Annual team trip

Job summary

Plum Fintech is seeking an experienced AI Platform Engineer to build scalable infrastructure for AI-powered products. You will own core platform components and collaborate with multiple product squads to deliver reliable, cost-efficient services.

You'll design internal frameworks, implement guardrails, and drive best practices in prompt engineering and observability. This role demands autonomy and a strong background in backend and cloud-native systems.

Qualifications

• 5+ years in Software/Backend/Platform Engineering.
• Experience building backend systems and distributed services.
• Designing developer platforms and internal tooling for multiple squads.
• Hands-on AI-powered apps using modern LLM frameworks.
• Knowledge of LLMs, RAG, prompt engineering and guardrails.
• Experience with ADK, LangChain, LangGraph or CrewAI.
• Cloud experience (GCP preferred; AWS/Azure also acceptable).
• Strong observability, monitoring, and incident management basics.
• Infra as Code and cloud-native architectures.

Responsibilities

• Design and maintain a scalable AI Platform for the org.
• Develop internal frameworks and services used by multiple squads.
• Promote best practices for prompt engineering and guardrails.
• Build platform capabilities for safe deployment and monitoring of AI apps.
• Configure tracing, monitoring and incident management for reliability.
• Collaborate with product and engineering teams on scalable solutions.
• Improve developer experience and platform adoption.

Skills

5+ years software/backend/platform eng

Backend systems design

Developer platforms & internal tooling

AI-powered apps development

LLMs, RAG, prompt engineering

AI evaluation frameworks

ADK/LangChain/LangGraph

Go/Cloud platforms (GCP/AWS/Azure)

Reliability, observability, SRE basics

Infrastructure as Code

Tools

ADK

LangChain

LangGraph

CrewAI

GCP

AWS

Azure

Job description

Plum Fintech is seeking an experienced AI Platform Engineer to build scalable infrastructure for AI-powered products. You will own core platform components and collaborate with multiple product squads to deliver reliable, cost-efficient services.

You'll design internal frameworks, implement guardrails, and drive best practices in prompt engineering and observability. This role demands autonomy and a strong background in backend and cloud-native systems.