Senior AI Engineer - Production-Grade AI Systems

BlueAlly; California (MO); On-site; USD 180,000 - 200,000; Full time

Job summary

BlueAlly is hiring a Senior AI Engineer to design, build, and operate enterprise AI systems across client portfolios. You will own end-to-end AI stacks—from inference engines and platform infrastructure to application-level engineering—mentoring juniors and serving as the technical authority for production AI outcomes.

You will engage directly with client architects, data scientists, and executives, leading workstreams, tuning LLM stacks, implementing MLOps pipelines, and ensuring security,

Qualifications

• 7+ years of software, data, or infrastructure engineering, with 3+ years specifically working with modern AI / LLM systems.
• Production-quality Python at engineering level—testing, code review, version control fluency, and shipping code that other engineers depend on.
• Deep production Linux experience, including system internals, performance tuning, and troubleshooting.
• Docker — image build, registry management, runtime tuning, and container security.
• Strong server-platform skills including CPU/GPU topologies, PCIe, BMC management, BIOS/firmware lifecycle.
• Hands-on experience deploying and operating HPE PCAI, Dell AI Factory, or Nutanix Enterprise AI.
• Production experience deploying, tuning, and operating vLLM.
• Knowledge of multiple inference and model-serving frameworks beyond vLLM.
• Storage and networking for AI workloads — RDMA, parallel/object storage, KV cache management, Dynamo-style serving.
• MLOps tooling — model registries, deployment pipelines, GitOps, lineage, rollback.
• Vector databases and RAG pipelines—application-level engineering.
• Prompt engineering and tool-using LLM patterns.
• LLM evaluation harnesses—golden sets, regression suites, quality/cost metrics.
• Client-facing skills—engaging with stakeholders, presenting recommendations.

Responsibilities

• Lead end-to-end design, build, and operation of AI systems across client engagements.
• Engineer and tune LLM inference serving stacks for latency, throughput, and cost targets.
• Architect and operate MLOps pipelines covering model lifecycle, registries, deployment, rollback, and observability.
• Design and engineer RAG applications on vector databases and retrieval tuning.
• Build and tune prompt-engineering patterns at production scale.
• Design and maintain LLM evaluation harnesses with golden sets and regression suites.
• Operate Kubernetes clusters underpinning AI workloads and install monitoring and CI/CD pipelines.
• Mentor junior engineers and lead client knowledge transfer and enablement sessions.

Skills

Python

Linux

Docker

Kubernetes

LLM

MLOps

Vector databases

RAG pipelines

Prompt engineering

Client communication

Tools

HPE PCAI

Dell AI Factory

Nutanix Enterprise AI

Job description

BlueAlly is hiring a Senior AI Engineer to design, build, and operate enterprise AI systems across client portfolios. You will own end-to-end AI stacks—from inference engines and platform infrastructure to application-level engineering—mentoring juniors and serving as the technical authority for production AI outcomes.

You will engage directly with client architects, data scientists, and executives, leading workstreams, tuning LLM stacks, implementing MLOps pipelines, and ensuring security,