Lead Developer Java Spark And GCP

TransUnion; Pune District; Hybrid; INR 1,400,000 - 2,000,000; Full time

Job summary

TransUnion in Pune, India, is seeking a Lead Developer, Applications Development with 8–12 years of IT experience. The role focuses on migrating batch and data processing to a cloud-based platform, driving scalable solutions on GCP/AWS, and delivering automation enhancements.

The ideal candidate will have strong Java and Spark expertise, hands-on cloud experience, and the ability to lead a globally distributed team while delivering high-availability systems.

Qualifications

• 8–12 years of experience in IT industry.
• Minimum 8 years of experience in Java and related technology.
• Minimum 2 years of working knowledge in Spark, Hadoop and big data technologies.
• Cloud experience is must. Hands-on working experience in either GCP/AWS.

Responsibilities

• Accelerate migration from on-premises infrastructure to OneTru GCP cloud portal.
• Deliver a scalable and resilient batch processing platform capable of handling enterprise-scale data volumes.
• Simplify management of batch triggers and LFE daily running configurations through automation and standardisation using AI.
• Improve operational efficiency, reliability, and time-to-market for business initiatives.

Skills

Spark

Java

Spark SQL

Vue.Js

Microservices

Python

Hive

postgreSQL

Job description

Job Description:

TransUnion's Job Applicant Privacy Notice

Team Overview

• The US Market Core Credit Batch Team is responsible for enabling and operating the batch processing capabilities for the US Credit business on the OneTru platform. The batch workload has already been migrated to OneTru and is currently running in production.
• The team operates as a globally distributed organisation, with members located across both India and the United States, ensuring continuous support, platform evolution, and migration activities.
• The batch ecosystem processes petabytes of data annually, making it one of the most data-intensive platforms within the Credit domain. Daily operations include: Management of approximately 1,000 batch trigger configurations; Execution and support of 100+ LFE (Logical Flow Engine) configurations; Processing of large-scale credit and operational data workloads on a daily basis
• This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

Role Overview And Core Responsibilities

• Accelerate migration from on-premises infrastructure to OneTru GCP cloud portal. Deliver a scalable and resilient batch processing platform capable of handling enterprise-scale data volumes.
• Simplify management of batch triggers and LFE daily running configurations through automation and standardisation using AI.
• Improve operational efficiency, reliability, and time-to-market for business initiatives.

Required Knowledge And Experiences

• Candidate should be an engineer with 8 to 12 years of experience in IT industry.
• Minimum 8 years of experience in Java and related technology
• Minimum 2 years of working knowledge in Spark, Hadoop and big data technologies
• Cloud experience is must. Candidate should have hands on working experience in either GCP/AWS.

Required Technical Skills:

• Spark, Java, Spark SQL, Vue.Js, Microservices, Python, Hive, postgreSQL
• Cloud knowledge is must. GCP knowledge is preferred over AWS or Azure.
• Candidate should have basic AI knowledge and adoption skill.

TransUnion Overview:

At TransUnion, we encourage and are committed to creating a real, positive impact and shared sense of purpose within our Workforce for Good, which empowers our people to grow, innovate and contribute to a better future for our communities and customers. We strive to build an environment where our associates are in the driver’s seat of their professional development— while having access to help along the way. We recognize that success comes when our associates thrive both professionally and personally; that’s why we prioritize work/life flexibility and offer resources for our teams across the globe to collaborate and drive excellence.

Be a part of our Workforce for Good – you’ll work with great people, pioneering products and cutting-edge technology.

TransUnion Job Title

Lead Developer, Applications Development

Requirements: