Senior AI Engineer

Teradata; Bengaluru; Hybrid; INR 1,200,000 - 2,100,000; Full time

Benefits offered by this job

Equity

Flexible working arrangements

Comprehensive benefits

Job summary

Teradata Bengaluru-based team is building an AI-powered data catalog service that ingests metadata from diverse data sources and exposes it to an intelligent query agent. You will contribute across architecture and implementation, designing ingestion pipelines and the catalog API while partnering with the AI/ML group to surface signals for routing queries.

You will work on architecture, pipelines, and service delivery in a highly collaborative environment, touching cloud and on-prem deployments

Qualifications

• 3+ years of software engineering experience producing production services.
• Strong experience with Go or Python for backend services.
• Hands-on data pipeline development and metadata management at scale.
• Experience with Kubernetes in production.
• Experience with cloud environments (AWS/GCP/Azure).

Responsibilities

• Design, build, and operate a highly available data catalog collection service ingesting schema and metadata from diverse sources.
• Develop robust data pipelines for catalog extraction, normalization, and tagging to power AI-driven routing.
• Build and maintain RESTful and/or gRPC APIs exposing catalog data to an AI query agent.
• Deploy and manage services on Kubernetes, including helm charts and multi-cluster operations.
• Ensure service reliability with SLOs, circuit breakers, retries, and distributed tracing.
• Collaborate with AI/ML engineers to refine metadata schema and routing interfaces.
• Participate in on-call rotations and incident response, postmortems, and reliability improvements.
• Contribute to CICD pipelines and infrastructure-as-code (Terraform/Helm).

Skills

Go

Python

Java

Rust

Kubernetes

Tools

Kubernetes

REST APIs

Apache Kafka

OpenMetadata

Cloud Platforms (AWS/GCP/Azure)

Job description

Our Company

At Teradata, we believe that people thrive when empowered with better information. Teradata Autonomous Knowledge Platform activates enterprise intelligence by unifying data, knowledge and business context to achieve tangible outcomes. With Teradata, organizations can provide agents with full context for impact when it matters. Our solution lets businesses connect and scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI.

At Teradata, we believe that people thrive when empowered with better information. Teradata Autonomous Knowledge Platform activates enterprise intelligence by unifying data, knowledge and business context to achieve tangible outcomes. With Teradata, organizations can provide agents with full context for impact when it matters. Our solution lets businesses connect and scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI.

OUR TEAM

This position sits within the Data Intelligence Platform team, a group focused on building next-generation AI-assisted data services as part of Teradata's core platform. Our team operates at the intersection of cloud infrastructure, data engineering, and applied AI - shipping highly available, multi-tenant services that power intelligent query routing and data discovery at scale.

Our platform responsibilities include:

• Designing and operating highly available microservices for data catalog ingestion and serving


• Building AI-assisted query generation and routing services across heterogeneous data sources


• Deployment and lifecycle management of services on Kubernetes (K8s) across AWS, Azure, GCP and on-prem.


• Data pipeline development for catalog extraction, normalization, and semantic enrichment


• Centralized observability: monitoring, alerting, and distributed tracing for all platform services


• Providing DevOps tooling and CICD pipelines to support continuous delivery

THE OPPORTUNITY

We are building a new service to collect and normalize data catalogs from diverse data sources - including relational databases, data lakes, data warehouses, and streaming systems - and expose them to an AI agent that dynamically constructs and routes queries to the appropriate source. This is a greenfield initiative that requires strong engineering judgment, a systems-thinking mindset, and experience shipping production-grade services.

You will be a core contributor on this project, working from architecture to implementation - designing ingestion pipelines, building the catalog API layer, and collaborating with the AI/ML team to surface the right metadata signals for intelligent query generation.

Responsibilities

• Design, build, and operate a highly available data catalog collection service that ingests schema and metadata from heterogeneous data sources (RDBMS, data lakes, streaming platforms, APIs)


• Develop robust data pipelines for catalog extraction, normalization, lineage tracking, and semantic tagging to power AI-driven query routing


• Build and maintain RESTful and/or gRPC APIs that expose catalog data to an AI query agent


• Deploy and manage services on Kubernetes (K8s), including helm chart authoring, autoscaling configuration, and multi-cluster operations


• Ensure service reliability through SLO definition, circuit breakers, retry logic, and distributed tracing


• Integrate with open-source and cloud-native technologies including Apache Kafka, Spark, dbt, Apache Atlas, or OpenMetadata


• Collaborate with AI/ML engineers to design and iterate on the metadata schema and query routing interface


• Participate in on-call rotations and contribute to incident response, postmortems, and reliability improvements


• Contribute to CICD pipelines, infrastructure-as-code (Terraform / Helm), and automated testing frameworks

Qualifications

Required

• 3+ years of software engineering experience building and operating production services


• Proficiency in one or more of: Rust, Go, Python, Java - with a preference for Go or Python for backend services


• Hands-on experience with data pipeline development: ingestion, transformation, and metadata management at scale


• Solid understanding of RESTful API design principles and service-to-service communication patterns


• Experience deploying and operating services on Kubernetes (K8s) in production cloud environments


• Familiarity with at least one major public cloud platform: AWS, Azure, or GCP


• Strong knowledge of relational and non-relational database systems and their schema/catalog semantics


• Experience with distributed messaging systems such as Apache Kafka or AWS Kinesis


• Proficiency with Git, code review workflows, and agile development practices


• Excellent troubleshooting skills and comfort operating in Linux environments

Preferred

• Experience with data catalog or metadata management tools such as Apache Atlas, OpenMetadata, DataHub, or Collibra


• Familiarity with semantic search, vector databases, or LLM-based query generation systems


• Experience designing or integrating AI/ML model APIs into production backend services


• Knowledge of data governance, lineage tracking, and schema registry patterns


• Experience with infrastructure-as-code tools


• Background in multi-tenant SaaS platform engineering


• Contributions to open-source data or infrastructure projects

WHY TERADATA

• Work on a greenfield AI-powered data intelligence product with direct business impact


• Collaborate with world-class engineers across cloud infrastructure, AI/ML, and data platform teams


• Competitive compensation including equity, comprehensive benefits, and flexible working arrangements


• Commitment to engineering excellence: investment in tooling, learning, and technical growth


• Inclusive and diverse culture with a strong sense of shared mission.

Why We Think You’ll Love Teradata

We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are an anti-racist company because our dedication to Diversity, Equity, and Inclusion is more than a statement. It is a deep commitment to doing the work to foster an equitable environment that celebrates people for all of who they are.

Teradata invites all identities and backgrounds in the workplace. We work with deliberation and intent to ensure we are cultivating collaboration and inclusivity across our global organization. We are proud to be an equal opportunity and affirmative action employer. We do not discriminate based upon race, color, ancestry, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related conditions), national origin, sexual orientation, age, citizenship, marital status, disability, medical condition, genetic information, gender identity or expression, military and veteran status, or any other legally protected status.