Staff AI Platform Architect—LLMs, RAG, Vector AI

Teradata; Frankfort (KY); On-site; USD 169,000 - 254,000; Full time

Job summary

Teradata seeks a Staff AI Engineer to lead the design, evolution, and scaling of our enterprise AI platforms. You will own architecture decisions for agentic AI, RAG pipelines, vector stores, and AI orchestration, partnering with product and architecture leadership across teams.

You will drive reliability, performance, and governance for production AI systems, mentor engineers, and shape the roadmaps with deep technical insight.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• 8+ years of experience building backend services, distributed systems, or data/AI platforms.
• Strong proficiency in Java, Go, or Python, with experience building largescale services.
• Deep understanding of distributed system design, scalability, fault tolerance, and cloud native architectures.
• Proven experience designing and operating production systems with SQL and NoSQL data stores.

Responsibilities

• Lead the design and evolution of largescale, distributed AI systems that power Teradata’s AI platform and AI native products.
• Own end-to-end architecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.
• Drive technical strategy and architectural consistency across multiple engineering teams.
• Design and implement production grade AI systems using LLMs, embeddings, vector databases, and agent based architectures.
• Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle.
• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.
• Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions.
• Influence roadmap decisions by providing deep technical insight, tradeoff analysis, and long-term platform thinking.
• Act as a technical escalation point for complex system design, performance, and reliability challenges.
• Drive best practices for testing, observability, evaluation, and production readiness of AI systems.
• Identify systemic performance bottlenecks and lead efforts to optimize distributed systems and AI pipelines.
• Establish engineering standards that improve development velocity, quality, and operational resilience.
• Mentor Senior and Staff level engineers, providing guidance on architecture, design reviews, and technical decision making.
• Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing.
• Lead by example through hands on contributions to the most complex and business critical problems.

Skills

Java/Go/Python

Distributed systems

Backend services

LLMs / AI platforms

Education

Bachelor's degree in Computer Science or equivalent

Tools

Kubernetes

Docker

CI/CD pipelines

Job description

Teradata seeks a Staff AI Engineer to lead the design, evolution, and scaling of our enterprise AI platforms. You will own architecture decisions for agentic AI, RAG pipelines, vector stores, and AI orchestration, partnering with product and architecture leadership across teams.

You will drive reliability, performance, and governance for production AI systems, mentor engineers, and shape the roadmaps with deep technical insight.