Senior AI Architect for DoD-Grade GenAI Systems

Interactive Process Technology; Austin (TX); On-site; USD 140,000 - 210,000; Full time

Job summary

IPT Associates (IPTA) in Austin, TX seeks a Senior AI Engineer to architect, build, and deploy production-grade Generative AI apps and RAG systems for Army decision support. You will own AI architecture and AI Ops, focusing on accuracy, speed, and cost controls within a secure environment.

The role emphasizes operationalizing foundation models, deterministic software wiring to non-deterministic LLMs, and integrating AI nodes into data transformation and visualization pipelines.

Qualifications

• DoD Secret clearance required.
• Deep knowledge of Generative AI architectures and foundation models.
• Proven experience building ontology-driven AI pipelines in production (e.g., Palantir Foundry, Palantir Maven).
• 5+ years of Python and TypeScript with solid software engineering fundamentals.
• Strong grounding in LangChain and LangGraph; Palantir AIP experience is a plus.
• Experience indexing and querying vector databases (pgvector, OpenSearch, Pinecone, Qdrant).
• Experience with LLM tracing/evaluation tools (Langfuse, Arize Phoenix, Ragas, TruLens).

Responsibilities

• Design and orchestrate multi-step autonomous AI agents using Palantir AIP.
• Lead architecture translating theory of attention, embeddings, and reasoning into production software.
• Build deterministic-stochastic backends with validation, retries, and strict schemas.
• Scale RAG pipelines across Army datasets; implement hybrid search and advanced chunking.
• Own LLMOps, implement regression tests and evaluation pipelines for AI outputs.
• Enforce data isolation, RBAC, PII redaction and prompt-injection safeguards in a secure DoD setting.
• Optimize context windows, latency, and model routing per accuracy>speed>cost.

Skills

Python

TypeScript

Foundation Models

CoT reasoning

AI architecture

Tools

Palantir Foundry

Palantir Maven

Palantir AIP

LangChain

LangGraph

Langfuse

Arize Phoenix

Ragas

TruLens

pgvector

OpenSearch

Pinecone

Qdrant

Job description

IPT Associates (IPTA) in Austin, TX seeks a Senior AI Engineer to architect, build, and deploy production-grade Generative AI apps and RAG systems for Army decision support. You will own AI architecture and AI Ops, focusing on accuracy, speed, and cost controls within a secure environment.

The role emphasizes operationalizing foundation models, deterministic software wiring to non-deterministic LLMs, and integrating AI nodes into data transformation and visualization pipelines.