Lead Applications Developer – GCP, BigQuery, Pub/Sub, Kafka, GKE, Java/Python/c#

UPS; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading logistics company is seeking a GCP-focused Data Engineer to build scalable data pipelines for its Data Maturity initiative. Candidates should have over 7 years of experience, particularly with GCP services like BigQuery and Pub/Sub, along with proficiency in Python or Java. The role involves developing ETL pipelines, microservices, and ensuring data quality frameworks, while leading and mentoring junior engineers. A Bachelor's degree in a related field is required, and the position is permanent in Chennai, Tamil Nadu.

Qualifications

• Minimum 7+ years of relevant experience.
• Strong hands-on experience with GCP data services.
• Proficiency in Python/Java/C#, RESTful APIs, and microservices.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using BigQuery.
• Build and deploy APIs to integrate logistics systems.
• Implement validation checks and monitoring for pipeline SLAs.

Skills

GCP BigQuery

Pub/Sub

Python

Java

C#

SQL

Docker

Kubernetes

Data Quality

Microservice Development

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Tools

Terraform

Kafka

Cloud Composer (Airflow)

Job description

Job Summary

We are seeking a GCP-focused Data Engineer to build scalable, high‑quality data pipelines supporting our Data Maturity initiative for Logistics/Parcel Services. The ideal candidate has strong experience in GCP data services, data modeling, data quality frameworks, and understands logistics domain data such as shipment tracking, routing, and warehouse operations.

Key Responsibilities

• Pipeline Development: Design and develop scalable ETL/ELT pipelines using BigQuery, Pub/Sub, and Dataflow/Dataproc.
• Microservices: Build and deploy APIs using Python/Java/C# to integrate enterprise and external logistics systems.
• Orchestration: Orchestrate workloads via Composer (Airflow) or GKE using Docker and Kubernetes.
• Data Quality: Implement validation checks, lineage tracking, and monitoring for pipeline SLAs (freshness, latency).
• Modeling: Model logistics and supply chain data in BigQuery for analytics and operational insights.
• DataOps: Apply CI/CD, automated testing, and versioning best practices.
• System Design: Take ownership of end-to-end technical design for complex data modules.
• Mentorship: Actively mentor junior engineers and conduct rigorous code reviews to ensure high engineering standards.
• Best Practices: Establish and document DataOps standards and reusable patterns for the team.
• POD Leadership: Act as the technical head of the data pod, ensuring sprint goals are met and unblocking the team.
• Architecture: Define the high‑level architecture and long‑term technical roadmap for the logistics data platform.
• Stakeholder Management: Partner with business leaders to translate complex logistics requirements into technical specifications.
• Negotiation: Manage requirements scoping and prioritize backlogs by balancing technical debt with business value.
• Coaching: Drive the professional growth of the entire engineering team through structured coaching and performance feedback.

Required Skills

• Lead – Minimum 7+ years of relevant experience.
• Strong hands‑on experience with GCP BigQuery, Pub/Sub, GCS, Dataflow/Dataproc.
• Proficiency in Python/Java/C#, RESTful APIs, and microservice development.
• Experience with Kafka for event‑driven ingestion.
• Strong SQL and experience with data modeling.
• Expertise in Docker/Kubernetes (GKE) and CI/CD tools (Cloud Build, GitHub Actions, or ADO).
• Experience implementing Data Quality, Metadata management, and Data Governance frameworks.

Preferred Qualifications

• Experience with Terraform, Cloud Composer (Airflow).
• Experience in Azure Databricks, Delta Lake, ADLS, and Azure Data Factory.
• Experience in Knowledge Graph Engineering using Neo4j and/or Stardog.
• Familiarity with Data Governance tools or Cataloging systems (AXON Informatica).
• Logistics domain experience.

Education

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field.

Employee Type

Permanent

UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.