Senior AI Engineer

Interactive Process Technology; Austin (TX); On-site; USD 140,000 - 210,000; Full time

Job summary

IPT Associates (IPTA) in Austin, TX seeks a Senior AI Engineer to architect, build, and deploy production-grade Generative AI apps and RAG systems for Army decision support. You will own AI architecture and AI Ops, focusing on accuracy, speed, and cost controls within a secure environment.

The role emphasizes operationalizing foundation models, deterministic software wiring to non-deterministic LLMs, and integrating AI nodes into data transformation and visualization pipelines.

Qualifications

• DoD Secret clearance required.
• Deep knowledge of Generative AI architectures and foundation models.
• Proven experience building ontology-driven AI pipelines in production (e.g., Palantir Foundry, Palantir Maven).
• 5+ years of Python and TypeScript with solid software engineering fundamentals.
• Strong grounding in LangChain and LangGraph; Palantir AIP experience is a plus.
• Experience indexing and querying vector databases (pgvector, OpenSearch, Pinecone, Qdrant).
• Experience with LLM tracing/evaluation tools (Langfuse, Arize Phoenix, Ragas, TruLens).

Responsibilities

• Design and orchestrate multi-step autonomous AI agents using Palantir AIP.
• Lead architecture translating theory of attention, embeddings, and reasoning into production software.
• Build deterministic-stochastic backends with validation, retries, and strict schemas.
• Scale RAG pipelines across Army datasets; implement hybrid search and advanced chunking.
• Own LLMOps, implement regression tests and evaluation pipelines for AI outputs.
• Enforce data isolation, RBAC, PII redaction and prompt-injection safeguards in a secure DoD setting.
• Optimize context windows, latency, and model routing per accuracy>speed>cost.

Skills

Python

TypeScript

Foundation Models

CoT reasoning

AI architecture

Tools

Palantir Foundry

Palantir Maven

Palantir AIP

LangChain

LangGraph

Langfuse

Arize Phoenix

Ragas

TruLens

pgvector

OpenSearch

Pinecone

Qdrant

Job description

Senior AI Engineer

Austin, TX

At IPT Associates (IPTA), we enjoy solving real-world problems with technology. We work closely with our customers, teammates, experts, and partners to come up with practical solutions that make a difference. Whether it's a government or business organization, we focus on understanding the need and building something that works.

As a Senior AI Engineer, you are at the heart of our team's AI mission. You will architect, build, and deploy production-grade Generative AI applications, autonomous agent workflows, and retrieval-augmented generation (RAG) systems for Army decision support products.

This is not a traditional ML modeling role, nor is it merely an LLMOps coding position. We require an engineer who possesses a deep theoretical and practical understanding of Foundation Models (FMs), reasoning architectures, and the mechanics underpinning modern AI systems. You will focus on operationalizing FMs, wiring deterministic software systems to non-deterministic LLM reasoning engines, and integrating these nodes directly into data transformation, visualization, and business process pipelines.

Working alongside a dedicated mission team, you will take ownership of the AI architecture and AI Ops for your projects to ensure our systems meet strict operational standards where accuracy is the highest priority, followed by speed, and then cost.

Our Team

At IPTA, everything starts with our people. We're big believers that when you invest in your team, great things happen. That's why we encourage learning, growth, and trying new things-even if you don't have all the answers yet.

Our culture is rooted in fierce determination, fearless integrity, and passionate service-but we also like to keep things collaborative, supportive, and down-to-earth.

We're looking for people who:

• Are curious and excited about technology
• Like solving problems and figuring things out
• Can take initiative but also enjoy working with a team
• Want to keep learning, growing, and challenging themselves

If you're someone who's eager to jump in, learn something new, and make an impact-you'll fit right in here.

Responsibilities:

• Agentic System Architecture: Design and orchestrate multi-step autonomous AI agents primarily using Palantir AIP. Apply deep theoretical knowledge to implement reliable function calling, state machines, and human-in-the-loop (HITL) checkpoints
• Theoretical & Applied Architecture: Serve as the team's intellectual lead on modern AI systems. Translate the underlying theory of attention mechanisms, vector embeddings, and reasoning frameworks into practical, production-ready software architecture
• Deterministic-Stochastic Bridging: Architect resilient stateful backends that safely wrap probabilistic LLM outputs with deterministic validation, retry policies, strict JSON/Pydantic schemas, and structured error handling
• RAG & Pipeline Integration: Build and scale production RAG pipelines across structured and unstructured Army datasets. Implement hybrid search, advanced chunking, metadata filtering, and re-ranking layers to feed directly into decision support products and visualizations within Foundry
• AI Ops & Evaluation (LLMOps): Take complete ownership of project LLMOps. Implement automated regression testing and continuous evaluation pipelines for LLM outputs (e.g., faithfulness, semantic relevancy, hallucination detection) to guarantee deterministic accuracy
• Safety, Security & Governance: Enforce guardrails around context boundaries, data isolation, multi-tenant RBAC, PII redaction, and mitigation against prompt injection/model evasion within a secure DoD environment
• Performance & Cost Optimization: Manage context window budgets, token consumption metrics, latency profiling, and model routing strategies, strictly adhering to the priority matrix of Accuracy > Speed > Cost

Requirements:

• Security Clearance: Must hold a current, active DoD Secret clearance
• Theoretical & Systems Depth: Deep theoretical and practical understanding of Generative AI architectures, foundation models, context management, and advanced prompt engineering (e.g., Chain-of-Thought reasoning)
• Enterprise AI Experience: Proven experience building ontology-driven workflows or AI pipelines within Palantir Foundry, Palantir Maven, or other mature production systems. (Note: Extensive Army Vantage experience is not strictly required if you possess strong analogous production experience)
• Programming & Systems Integration: 5+ years of experience with advanced proficiency in Python and TypeScript, featuring strong software engineering fundamentals (OOP, microservices, async programming, API design)
• Agentic Framework Proof Points: Strong working knowledge of frameworks such as LangChain and LangGraph. While Palantir AIP is the primary platform, experience with these frameworks serves as a critical proof point of your architectural capabilities and will support future needs
• Vector Search & Data Engineering: Proven experience indexing and querying vector databases/extensions (e.g., pgvector, OpenSearch, Pinecone, Qdrant) alongside relational and document datastores
• Evaluation & Observability: Practical experience using LLM tracing and evaluation tools (e.g., Langfuse, Arize Phoenix, Ragas, TruLens) to diagnose multi-turn agent failures and latency bottlenecks

Preferred Qualifications:

• Active Top Secret (TS) Clearance
• Experience operating within DoD Impact Level 5/6 (IL5/IL6) secure network environments
• Industry Certifications: Recognized applied AI certifications (e.g., Google Cloud Professional Machine Learning Engineer/Generative AI Developer, Claude Architect, AWS Certified Generative AI Developer - Professional, Microsoft Azure AI Engineer Associate)
• Cloud & Infrastructure: Demonstrated experience consuming model endpoints over REST/gRPC, deploying asynchronous worker queues, and integrating serverless compute/microservices

IPTA is an Equal Opportunity Employer. All employment decisions are based on individual merit, including qualifications, experience, performance, and business needs, consistent with applicable federal laws and federal contracting requirements. IPTA provides equal opportunity and utilizes merit-based principles to make employment-related decisions.

#clearance