Senior AI/ML Architect — Multi-Agent Production Systems

AKIVA AI, LLC; Northern (KY); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Professional development

401(k) with company match

Medical Insurance

Vision Insurance

Short-Term & Long-Term Disability

Job summary

AKIVA AI, LLC is seeking a senior engineer to lead development of production multi-agent systems and custom AI frameworks. You will architect distributed inference pipelines and mentor engineers on RLHF and agent evaluation.

You will partner with research and product teams to translate novel techniques into deployable systems for commercial and government clients, with a long-term contract engagement and opportunities for impact.

Qualifications

• 5+ years building and shipping production ML systems.
• Deep expertise in transformer internals, attention mechanisms, and modern inference optimization.
• Experience with at least one of: vLLM, TensorRT-LLM, custom CUDA/Triton kernels, distributed training (DeepSpeed/FSDP).
• Production experience with multi-agent frameworks (LangGraph, AutoGen, CrewAI) or equivalent custom orchestration.
• Strong software engineering fundamentals: Python, type-safe APIs, testing, observability.

Responsibilities

• Architect and ship multi-agent orchestration systems (planner/executor, tool-use, reflection loops).
• Design and optimize custom inference stacks: kernel-level work (CUDA/Triton), quantization (GPTQ/AWQ/FP8), speculative decoding, paged attention, KV-cache engineering.
• Lead model serving infrastructure on vLLM, TensorRT-LLM, or equivalent at production scale.
• Mentor engineers on reinforcement learning, RLHF/DPO, and agent evaluation methodology.
• Partner with research and product to translate novel techniques into shippable systems.

Skills

Production ML systems

Transformer internals

Inference optimization

vLLM

TensorRT-LLM

CUDA kernels

Distributed training

LangGraph

AutoGen

CrewAI

Python

Testing

Observability

Education

PhD in CS/ML

Tools

CUDA

Triton

DeepSpeed

FSDP

Job description

AKIVA AI, LLC is seeking a senior engineer to lead development of production multi-agent systems and custom AI frameworks. You will architect distributed inference pipelines and mentor engineers on RLHF and agent evaluation.

You will partner with research and product teams to translate novel techniques into deployable systems for commercial and government clients, with a long-term contract engagement and opportunities for impact.