Staff AI Engineer

Teradata Group; San Jose (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Teradata is seeking a Staff AI Engineer to design, evolve, and scale enterprise AI platforms. You will own architecture decisions, lead complex initiatives in LLMs, RAG, and vector stores, and drive AI strategy with product and leadership.

You will work autonomously with multiple teams to deliver production-grade AI systems, ensuring reliability, governance, and operational excellence across cloud-native services, databases, and workflows.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8+ years building backend services, distributed systems, or data/AI platforms.
• Strong proficiency in Java, Go, or Python; experience with large-scale services.

Responsibilities

• Lead the design and evolution of large-scale AI systems powering Teradata’s platform.
• Own end-to-end architecture for AI capabilities like agentic workflows and RAG pipelines.
• Collaborate with product, architecture, research, and cloud teams to translate requirements into scalable AI solutions.
• Establish engineering standards for reliability, safety, governance, and cost control in AI systems.
• Mentor senior engineers and raise the engineering bar through reviews and knowledge sharing.

Skills

Java

Go

Python

Distributed systems

Education

Bachelor's degree in Computer Science, Engineering, or equivalent

Tools

Kubernetes

Docker

CI/CD pipelines

Observability

Job description

Our company

At Teradata, we believe that people thrive when empowered with better information. Teradata Autonomous Knowledge Platform activates enterprise intelligence by unifying data, knowledge and business context to achieve tangible outcomes. With Teradata, organizations can provide agents with full context for impact when it matters. Our solution lets businesses connect and scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI.

What You’ll Do

As aStaff AI Engineer, you will be a senior technical leader responsible for designing, evolving, and scaling Teradata’s enterprise AI platforms and capabilities. This role goes beyond feature delivery—you will ownarchitecture level decisions, influenceAI platform strategy, and lead complex initiatives spanning agentic AI, LLM platforms, retrieval augmented generation (RAG), vector stores, and developer facing AI systems.

You willoperatewith a high degree of autonomy, partner closely with product and architecture leadership, and raise the technical bar across multiple teams.

Key Responsibilities

Technical Leadership & Architecture

• Lead the design and evolution of largescale, distributed AI systems that power Teradata’s AI platform andAI nativeproducts.


• Ownend-to-endarchitecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.


• Drive technical strategy and architectural consistency across multiple engineering teams.

AI Systems & Platform Development

• Design and implementproduction gradeAI systems using LLMs, embeddings, vector databases, andagent basedarchitectures.


• Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle.


• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.

Cross Functional Influence

• Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions.


• Influence roadmap decisions byprovidingdeep technical insight, tradeoff analysis, andlong-termplatform thinking.


• Act as a technical escalation point for complex system design, performance, and reliability challenges.

Quality, Performance & Operational Excellence

• Drive best practices for testing, observability, evaluation, and production readiness of AI systems.


• Identifysystemic performance bottlenecks and lead efforts tooptimizedistributed systems and AI pipelines.


• Establish engineering standards that improve development velocity, quality, and operational resilience.

Mentorship & Org Level Impact

• Mentor Senior and Stafflevel engineers, providing guidance on architecture, design reviews, and technical decisionmaking.


• Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing.


• Lead by example through handson contributions to the most complex andbusinesscriticalproblems.

Who You’ll Work With

You will partner closely with product and architecture leadership, and raise the technical bar across multiple teams.

What Makes You a Qualified Candidate

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.


• 8+ yearsof experience building backend services, distributed systems, or data/AI platforms.


• StrongproficiencyinJava, Go, or Python, with experience building largescale services.


• Deep understanding of distributed system design, scalability, fault tolerance, andcloudnativearchitectures.


• Proven experience designing and operating production systems withSQL and NoSQL data stores.

What You’ll Bring

• Experience withLLMs, embeddings, vector databases, and AI orchestration frameworks.


• Exposure toagentic AI patterns such as tool calling, planning, memory, and multi-step reasoning.


• Experience building or operating AI systems in cloud environments (AWS, Azure, or GCP).


• Familiarity with Kubernetes, Docker, CI/CD pipelines, and production-grade observability.

Why We Think You'll Love Teradata

We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are committedto actively workingto foster an inclusive environment that celebrates peoplefor all of who they are.

#LI-SK1