Staff AI Engineer

Teradata; Atlanta (GA); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Teradata is seeking a Staff AI Engineer to lead the architecture and scaling of its enterprise AI platforms. You will design and own critical AI capabilities, collaborating with product and architecture leadership to drive strategic decisions and ensure robust, secure systems.

You will guide multiple engineering teams, implement production-grade AI pipelines, and raise the bar for reliability, governance, and cost control in enterprise AI workloads.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• 8+ years of experience building backend services, distributed systems, or data/AI platforms.
• Strong proficiency in Java, Go, or Python, with experience building largescale services.
• Deep understanding of distributed system design, scalability, fault tolerance, and cloud native architectures.
• Proven experience designing and operating production systems with SQL and NoSQL data stores.

Responsibilities

• Lead the design and evolution of largescale, distributed AI systems powering Teradata’s AI platform.
• Own end-to-end architecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, and AI orchestration frameworks.
• Drive technical strategy and architectural consistency across multiple engineering teams.
• Mentor Senior and Staff engineers, guiding architecture reviews and technical decisions.
• Partner with product management and architecture leadership to translate business needs into scalable AI solutions.

Skills

Java

Go

Python

Distributed systems

AI platforms

Cloud architecture

Observability

Backend services

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent

Tools

Kubernetes

Docker

CI/CD

SQL

NoSQL

LLMs

Vector databases

Job description

Our Company

At Teradata, we believe that people thrive when empowered with better information. Teradata Autonomous Knowledge Platform activates enterprise intelligence by unifying data, knowledge and business context to achieve tangible outcomes. With Teradata, organizations can provide agents with full context for impact when it matters. Our solution lets businesses connect and scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI.

Our Company

At Teradata, we believe that people thrive when empowered with better information. Teradata Autonomous Knowledge Platform activates enterprise intelligence by unifying data, knowledge and business context to achieve tangible outcomes. With Teradata, organizations can provide agents with full context for impact when it matters. Our solution lets businesses connect and scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI.

What You’ll Do

As a Staff AI Engineer, you will be a senior technical leader responsible for designing, evolving, and scaling Teradata’s enterprise AI platforms and capabilities. This role goes beyond feature delivery—you will own architecture level decisions, influence AI platform strategy, and lead complex initiatives spanning agentic AI, LLM platforms, retrieval augmented generation (RAG), vector stores, and developer facing AI systems. You will operate with a high degree of autonomy, partner closely with product and architecture leadership, and raise the technical bar across multiple teams.

Key Responsibilities

Technical Leadership & Architecture

• Lead the design and evolution of largescale, distributed AI systems that power Teradata’s AI platform and AI native products.
• Own end-to-end architecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.
• Drive technical strategy and architectural consistency across multiple engineering teams.

AI Systems & Platform Development

• Design and implement production grade AI systems using LLMs, embeddings, vector databases, and agent based architectures.
• Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle.
• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.

Cross Functional Influence

• Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions.
• Influence roadmap decisions by providing deep technical insight, tradeoff analysis, and long-term platform thinking.
• Act as a technical escalation point for complex system design, performance, and reliability challenges.

Quality, Performance & Operational Excellence

• Drive best practices for testing, observability, evaluation, and production readiness of AI systems.
• Identify systemic performance bottlenecks and lead efforts to optimize distributed systems and AI pipelines.
• Establish engineering standards that improve development velocity, quality, and operational resilience.

Mentorship & Org Level Impact

• Mentor Senior and Staff level engineers, providing guidance on architecture, design reviews, and technical decision making.
• Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing.
• Lead by example through hands on contributions to the most complex and business critical problems.

Who You’ll Work With

You will partner closely with product and architecture leadership, and raise the technical bar across multiple teams.

What Makes You a Qualified Candidate

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• 8+ yearsof experience building backend services, distributed systems, or data/AI platforms.
• Strong proficiency inJava, Go, or Python, with experience building largescale services.
• Deep understanding of distributed system design, scalability, fault tolerance, and cloud native architectures.
• Proven experience designing and operating production systems withSQL and NoSQL data stores.

What You’ll Bring

• Experience withLLMs, embeddings, vector databases, and AI orchestration frameworks.
• Exposure to agentic AI patterns such as tool calling, planning, memory, and multi-step reasoning.
• Experience building or operating AI systems in cloud environments (AWS, Azure, or GCP).
• Familiarity with Kubernetes, Docker, CI/CD pipelines, and production-grade observability.

Why We Think You'll Love Teradata

We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are committed to actively working to foster an inclusive environment that celebrates people for all of who they are.

Why We Think You’ll Love Teradata

We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are an anti-racist company because our dedication to Diversity, Equity, and Inclusion is more than a statement. It is a deep commitment to doing the work to foster an equitable environment that celebrates people for all of who they are.
Teradata invites all identities and backgrounds in the workplace. We work with deliberation and intent to ensure we are cultivating collaboration and inclusivity across our global organization. We are proud to be an equal opportunity and affirmative action employer. We do not discriminate based upon race, color, ancestry, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related conditions), national origin, sexual orientation, age, citizenship, marital status, disability, medical condition, genetic information, gender identity or expression, military and veteran status, or any other legally protected status.