Senior AI/ML Engineer - LLM & Agent Orchestration

Socotra, Inc.; Hinoba-an; Hybrid; PHP 7,528,000 - 11,292,000; Full time

Benefits offered by this job

Health insurance

Hybrid work

Lunch provided

Office swap program

Job summary

TrueFoundry is seeking a Senior AI/ML Engineer: LLM & Agent Stack to design and own core components for production agentic AI, including multi-step agent orchestration, model routing, observability, and policy enforcement.

You’ll integrate LangGraph, LangChain, vector stores, and LLM runtimes, build scalable distributed systems, and mentor engineers while engaging with strategic customers to translate complex needs into product features.

Qualifications

• 4–10 years in software engineering with distributed systems, infra, or ML platforms.
• Deep practical experience deploying LLMs in production (RAG, embeddings pipelines).
• Hands-on with agent orchestration frameworks (LangGraph / LangChain) or custom runtimes.
• Proven observability, cost controls, and policy enforcement for production services.

Responsibilities

• Architect and implement scalable agent orchestration patterns (graph-based executors, state management, multi-agent coordination) for production workloads.
• Own critical integrations: model adapters, LLM gateway hooks, vector DBs, tools & external APIs, and the platform’s LLMops flows.
• Build and improve tracing, benchmarking and observability for LLMs and agents, token/cost accounting, latency p95, throughput, and correctness checks.
• Drive design for safety/guardrails: moderation hooks, human-in-the-loop checkpoints, replayable audit trails and policy enforcement.
• Mentor junior engineers, run design reviews, and improve engineering practices (testing, CI/CD, chaos testing for agents).
• Work directly with strategic customers to prototype complex agentic solutions and translate them into product features.

Skills

Distributed systems

LLM deployment

Agent orchestration

Observability

Security governance

Mentoring

Tools

LangGraph

LangChain

Vector stores

LLM runtimes

Model adapters

MCP gateway

Job description

TrueFoundry is seeking a Senior AI/ML Engineer: LLM & Agent Stack to design and own core components for production agentic AI, including multi-step agent orchestration, model routing, observability, and policy enforcement.

You’ll integrate LangGraph, LangChain, vector stores, and LLM runtimes, build scalable distributed systems, and mentor engineers while engaging with strategic customers to translate complex needs into product features.