Senior GenAI Platform Engineer — Remote/Flexible

Talanto; Union, Northern (NJ, KY); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Flexible working format

Competitive salary

Professional development

Job summary

Talanto is seeking a Senior AI Platform Engineer to design, build and operate the shared GenAI infrastructure that product teams rely on. You will work hands-on with LLM APIs, implement async workflows, ensure security, and contribute directly inside a client squad as an individual contributor.

The role emphasizes building scalable GenAI tooling, MCP gateway, observability, and cross-team collaboration to raise the overall quality of AI services across the organization.

Qualifications

• Must design/build/operate shared GenAI infrastructure (LLM routing, vector search, RAG).
• Strong distributed-systems fundamentals: async workflows, idempotency, failure design.
• Hands-on production experience with LLM APIs.
• AI-security mindset: prompt injection, PII in logs, credential handling.

Responsibilities

• Design, build and operate shared GenAI infrastructure: LLM routing, vector search and RAG infrastructure, MCP gateway, and AI observability/evaluation tooling.
• Apply strong distributed-systems fundamentals: async workflows, idempotency, failure design.
• Work hands-on with LLM APIs in production.
• Embed directly into a client squad as a hands-on IC.

Skills

Kotlin or Python

LLM routing

Vector search & RAG

Distributed systems

LLM APIs production

AI security

Agent & harness engineering

Claude Code

GitHub Copilot

Tools

Claude Code

GitHub Copilot

Job description

Talanto is seeking a Senior AI Platform Engineer to design, build and operate the shared GenAI infrastructure that product teams rely on. You will work hands-on with LLM APIs, implement async workflows, ensure security, and contribute directly inside a client squad as an individual contributor.

The role emphasizes building scalable GenAI tooling, MCP gateway, observability, and cross-team collaboration to raise the overall quality of AI services across the organization.