Senior AI Platform Architect

Teradata Corporation (SE); Providence (RI); On-site; USD 200,000 - 299,000; Full time

Benefits offered by this job

Healthcare benefits

401(k) retirement savings plan

Time-off programs

Job summary

Teradata seeks a Senior Staff AI Engineer to lead the design, evolution, and scaling of its enterprise AI platforms. You will own architecture decisions, influence AI strategy, and drive complex initiatives across agentic workflows, RAG pipelines, and vector stores.

You will collaborate with product and architecture leadership, deliver secure, scalable AI services, and mentor other engineers while shaping platform standards and governance. Strong backend and cloud experience are essential.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• 12+ years of experience building backend services, distributed systems, or data/AI platforms.
• Strong proficiency in Java, Go, or Python, with experience building large-scale services.
• Deep understanding of distributed system design, scalability, fault tolerance, and cloud-native architectures.
• Proven experience designing and operating production systems with SQL and NoSQL data stores.
• Experience with LLMs, embeddings, vector databases, and AI orchestration frameworks.
• Exposure to agentic AI patterns such as tool calling, planning, memory, and multi-step reasoning.
• Experience building or operating AI systems in cloud environments (AWS, Azure, or GCP).
• Familiarity with Kubernetes, Docker, CI/CD pipelines, and production-grade observability.

Responsibilities

• Lead the design and evolution of largescale, distributed AI systems that power Teradata’s AI platform and AI native products.
• Own end-to-end architecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks.
• Drive technical strategy and architectural consistency across multiple engineering teams.
• Design and implement production grade AI systems using LLMs, embeddings, vector databases, and agent based architectures.
• Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle.
• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems.
• Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions.
• Influence roadmap decisions by providing deep technical insight, tradeoff analysis, and long-term platform thinking.
• Act as a technical escalation point for complex system design, performance, and reliability challenges.
• Drive best practices for testing, observability, evaluation, and production readiness of AI systems.
• Identify systemic performance bottlenecks and lead efforts to optimize distributed systems and AI pipelines.
• Establish engineering standards that improve development velocity, quality, and operational resilience.
• Mentor Senior and Staff level engineers, providing guidance on architecture, design reviews, and technical decision making.
• Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing.
• Lead by example through hands on contributions to the most complex and business critical problems.

Skills

Backend services

Distributed systems

Java/Go/Python

SQL/NoSQL

LLMs/AI orchestration

Kubernetes/Docker/CI/CD

Cloud platforms (AWS/Azure/GCP)

Education

Bachelor’s degree in CS/Engineering or equivalent

Tools

Kubernetes

Docker

CI/CD pipelines

Job description

Teradata seeks a Senior Staff AI Engineer to lead the design, evolution, and scaling of its enterprise AI platforms. You will own architecture decisions, influence AI strategy, and drive complex initiatives across agentic workflows, RAG pipelines, and vector stores.

You will collaborate with product and architecture leadership, deliver secure, scalable AI services, and mentor other engineers while shaping platform standards and governance. Strong backend and cloud experience are essential.