Staff AI Engineer

Teradata Group; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

Teradata is seeking a Staff AI Engineer to lead the design, evolution, and scaling of its enterprise AI platforms. You will own architecture decisions, set technical standards, and drive cross-team alignment to deliver reliable, scalable AI capabilities across the stack.

You will partner closely with product and architecture leadership to translate business needs into robust solutions, guiding initiatives spanning agentic AI, LLM platforms, retrieval augmented generation, vector stores, and

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• 8+ years of experience building backend services, distributed systems, or data/AI platforms.
• Strong proficiency in Java, Go, or Python, with experience building large-scale services.
• Deep understanding of distributed system design, scalability, fault tolerance, and cloud-native architectures.

Responsibilities

• Lead the design and evolution of large-scale, distributed AI systems powering Teradata’s AI platform and AI native products.
• Own end-to-end architecture for agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.
• Drive technical strategy and architectural consistency across multiple engineering teams.
• Design and implement production-grade AI systems using LLMs, embeddings, vector databases, and agent-based architectures.
• Build scalable, secure platform services and APIs supporting AI workloads across the software development lifecycle.
• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.
• Mentor Senior and Staff engineers, providing guidance on architecture, design reviews, and technical decision-making.

Skills

Java

Go

Python

Distributed systems

SQL

NoSQL

Education

Bachelor’s degree in CS/Engineering or equivalent

Tools

Kubernetes

Docker

CI/CD

Observability

Job description

Our company

At Teradata, we believe that people thrive when empowered with better information. Teradata Autonomous Knowledge Platform activates enterprise intelligence by unifying data, knowledge and business context to achieve tangible outcomes. With Teradata, organizations can provide agents with full context for impact when it matters. Our solution lets businesses connect and scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI.

What You’ll Do

As aStaff AI Engineer, you will be a senior technical leader responsible for designing, evolving, and scaling Teradata’s enterprise AI platforms and capabilities. This role goes beyond feature delivery—you will ownarchitecture level decisions, influenceAI platform strategy, and lead complex initiatives spanning agentic AI, LLM platforms, retrieval augmented generation (RAG), vector stores, and developer facing AI systems.

You willoperatewith a high degree of autonomy, partner closely with product and architecture leadership, and raise the technical bar across multiple teams.

Key Responsibilities

Technical Leadership & Architecture

• Lead the design and evolution of largescale, distributed AI systems that power Teradata’s AI platform andAI nativeproducts.


• Ownend-to-endarchitecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.


• Drive technical strategy and architectural consistency across multiple engineering teams.

AI Systems & Platform Development

• Design and implementproduction gradeAI systems using LLMs, embeddings, vector databases, andagent basedarchitectures.


• Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle.


• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.

Cross Functional Influence

• Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions.


• Influence roadmap decisions byprovidingdeep technical insight, tradeoff analysis, andlong-termplatform thinking.


• Act as a technical escalation point for complex system design, performance, and reliability challenges.

Quality, Performance & Operational Excellence

• Drive best practices for testing, observability, evaluation, and production readiness of AI systems.


• Identifysystemic performance bottlenecks and lead efforts tooptimizedistributed systems and AI pipelines.


• Establish engineering standards that improve development velocity, quality, and operational resilience.

Mentorship & Org Level Impact

• Mentor Senior and Stafflevel engineers, providing guidance on architecture, design reviews, and technical decisionmaking.


• Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing.


• Lead by example through handson contributions to the most complex andbusinesscriticalproblems.

Who You’ll Work With

You will partner closely with product and architecture leadership, and raise the technical bar across multiple teams.

What Makes You a Qualified Candidate

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.


• 8+ yearsof experience building backend services, distributed systems, or data/AI platforms.


• StrongproficiencyinJava, Go, or Python, with experience building largescale services.


• Deep understanding of distributed system design, scalability, fault tolerance, andcloudnativearchitectures.


• Proven experience designing and operating production systems withSQL and NoSQL data stores.

What You’ll Bring

• Experience withLLMs, embeddings, vector databases, and AI orchestration frameworks.


• Exposure toagentic AI patterns such as tool calling, planning, memory, and multi-step reasoning.


• Experience building or operating AI systems in cloud environments (AWS, Azure, or GCP).


• Familiarity with Kubernetes, Docker, CI/CD pipelines, and production-grade observability.

Why We Think You'll Love Teradata

We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are committedto actively workingto foster an inclusive environment that celebrates peoplefor all of who they are.

#LI-SK1