Lead AI Platform Engineer (Python, Cloud & GenAI)

TransUnion; Bengaluru; Hybrid; INR 4,000,000 - 7,000,000; Full time

Job summary

TransUnion seeks an experienced Lead Engineer to design, build, and operate production-grade systems spanning software, cloud infrastructure, and AI-powered applications. The role emphasizes strong Python engineering, cloud architecture on Google Cloud Platform, and scalable microservices.

You will define reusable patterns, mentor engineers, and shape platform standards across product, data science, and engineering teams.

Qualifications

• Experience designing and building production Python services and APIs
• Hands-on in cloud-native architectures on Google Cloud Platform
• Proven ability to design distributed, high-throughput systems
• Strong focus on testing strategies including unit/integration tests
• Ability to create reusable libraries, SDKs, and templates for teams
• Experience with Terraform and CI/CD pipelines
• Data engineering experience with BigQuery, Pub/Sub, Dataflow
• Comfort leading architectural direction and mentoring engineers

Responsibilities

• Design, build, and operate production-grade systems spanning software, cloud, and AI components
• Architect scalable microservices and RESTful/GraphQL APIs with Python frameworks
• Lead distributed system designs for high throughput and low latency
• Define testing strategies and enforce code quality gates
• Develop reusable libraries, SDKs, and platform capabilities
• Implement cloud-native architectures on GCP with GKE, Cloud Run, Cloud Functions
• Design scalable data pipelines for analytics, ML, and AI workflows
• Lead IaC practices using Terraform and CI/CD tooling

Skills

Production Python Engineering

API Design & Microservices

System Design & Distributed Systems

Testing Strategy & Quality

Reusable Libraries & SDKs

Cloud‑Native Architecture (GCP)

Data Infrastructure & Pipelines

Infrastructure as Code & DevOps

Tools

FastAPI

Flask

Terraform

Cloud Build

Job description

TransUnion's Job Applicant Privacy Notice

Team Overview

Our team is at the forefront of building next-generation AI-powered platforms and cloud-native solutions that enable the organization to accelerate innovation at scale. We develop reusable engineering capabilities, intelligent services, and enterprise-grade platforms that empower product teams, data scientists, and engineers to build, deploy, and operate secure, scalable, and reliable applications.

We work across the full technology stack, combining modern software engineering, cloud infrastructure, data platforms, and Generative AI to solve complex business challenges. Our focus areas include Python engineering, cloud-native architectures on Google Cloud Platform, AI/ML platforms, Retrieval-Augmented Generation (RAG), agentic AI systems, platform reliability, and developer productivity.

The team values technical excellence, innovation, ownership, and continuous learning. Engineers are encouraged to experiment with emerging technologies, influence architectural direction, contribute to platform strategy, and collaborate closely with product, security, data science, and business stakeholders. We foster a culture where strong engineering fundamentals, operational excellence, and practical AI innovation come together to deliver meaningful business impact.

As part of this team, you will have the opportunity to work on cutting-edge technologies, solve large-scale engineering problems, and help shape the future of intelligent systems across the enterprise. You'll collaborate with highly skilled engineers, architects, and AI practitioners while helping establish engineering standards, reusable frameworks, and best practices that drive success across multiple teams.

This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

Role Overview And Core Responsibilities

We are seeking an experienced and highly skilled Lead Engineer to design, build, and operate production-grade systems that span software engineering, cloud-native infrastructure, and AI-powered applications. The ideal candidate combines deep Python engineering expertise with strong cloud architecture skills on Google Cloud Platform (GCP) and proven experience building and deploying Generative AI at enterprise scale. This role will define reusable engineering patterns and platform capabilities that enable multiple product, data science, and engineering teams to safely build, deploy, evaluate, and operate intelligent systems. The Lead Engineer will remain deeply technical while providing architecture leadership, mentoring engineers, and influencing engineering standards across the organization.

• Production Python Engineering: Design and develop high-performance, production-grade Python services and applications following modern software engineering best practices. Establish coding standards, design patterns, and reusable frameworks that enable teams to ship reliable software at velocity.
• API Design & Microservices Architecture: Architect and build scalable microservices and RESTful/GraphQL APIs using Python frameworks such as FastAPI and Flask. Define service boundaries, communication patterns, and data contracts that support distributed system reliability and independent team ownership.
• System Design & Distributed Systems: Lead the design of distributed, event-driven, and asynchronous systems that handle high throughput and low-latency requirements. Apply principles of concurrency, fault tolerance, and horizontal scaling to deliver resilient production architectures.
• Testing Strategy & Engineering Quality: Define and drive comprehensive testing strategies including unit, integration, contract, and end-to-end testing using pytest and related tooling. Champion code review practices, static analysis, and automated quality gates to maintain high engineering standards.
• Reusable Libraries & SDKs: Identify repeated engineering patterns across teams and convert them into standardized Python libraries, SDKs, templates, and self-service platform capabilities that accelerate development and reduce duplication.
• Cloud‑Native Architecture (GCP): Design and implement cloud-native architectures on Google Cloud Platform using services such as GKE, Cloud Run, Cloud Functions, and App Engine. Establish patterns for containerization, orchestration, autoscaling, and resilient infrastructure that support production AI and software workloads.
• Data Infrastructure & Pipelines: Architect scalable data infrastructure using BigQuery, Pub/Sub, Cloud Storage, Dataflow, and Cloud Composer. Design data pipelines that support both real-time streaming and batch processing for analytics, ML training, and AI application data needs.
• Infrastructure as Code & DevOps: Establish infrastructure-as-code practices using Terraform and CI/CD pipelines with Cloud Build or equivalent tooling. Drive automation of build, test, d