Architect / POD Lead – Data Engineering

Orion Innovation; Bengaluru; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Orion Innovation is seeking an Architect / POD Lead for Data Engineering in Bengaluru. The role involves designing scalable data platforms, building data pipelines, and driving data integration using Kafka, Pub/Sub, and APIs.

You will lead the Data Engineering POD, mentor engineers, and ensure data quality and governance across cloud-based solutions. The position requires 13–16 years of experience, strong Python automation skills, and hands-on experience with GCP, Terraform, and IaC.

Qualifications

• Design and architect scalable data platforms and pipelines.

Responsibilities

• Design and architect scalable data platforms, data pipelines, and data engineering solutions.
• Define and implement batch processing frameworks using Spring Batch and other relevant technologies.
• Design data ingestion, transformation, processing, and storage patterns.
• Drive data integration using Kafka, Google Pub/Sub, APIs, and event-based integrations.
• Ensure data quality, consistency, validation, lineage, and traceability.
• Define failure handling, recovery, and monitoring strategies for data pipelines.
• Drive automation using Python and Bash scripting and optimize pipeline performance and scalability.
• Lead the Data Engineering POD and drive architecture decisions, design reviews, and technical best practices.
• Collaborate with Data, Platform, Product, and other technology teams to deliver solutions.
• Mentor engineers and support the development of strong data engineering capabilities.
• Remove technical blockers and ensure smooth delivery of POD activities.
• Design and deploy GCP resources using Infrastructure as Code (IaC).
• Support architecture governance, technical planning, and delivery milestones.

Skills

Data engineering architecture

GCP / Google Cloud Platform

Python for data engineering

Data pipelines ETL

Kafka

Google Pub/Sub

Data quality

Data governance

Infrastructure as Code

Terraform

Parquet/Avro/JSON

API integration

Event-driven architecture

Batch processing

Bash scripting

Technical leadership

Tools

Terraform

Google Cloud Platform

Spring Batch

Kafka

Google Pub/Sub

Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Job Title- Architect / POD Lead – Data Engineering

Location: Bangalore – Electronic City

Experience: 13–16 Years

Key Responsibilities

• Design and architect scalable data platforms, data pipelines, and data engineering solutions.
• Define and implement batch processing frameworks using Spring Batch and other relevant technologies.
• Design data ingestion, transformation, processing, and storage patterns.
• Drive data integration using Kafka, Google Pub/Sub, APIs, and event-based integrations.
• Ensure data quality, consistency, validation, lineage, and traceability.
• Define failure handling, recovery, and monitoring strategies for data pipelines.
• Drive automation using Python and Bash scripting and optimize pipeline performance and scalability.
• Lead the Data Engineering POD and drive architecture decisions, design reviews, and technical best practices.
• Collaborate with Data, Platform, Product, and other technology teams to deliver solutions.
• Mentor engineers and support the development of strong data engineering capabilities.
• Remove technical blockers and ensure smooth delivery of POD activities.
• Design and deploy GCP resources using Infrastructure as Code (IaC).
• Support architecture governance, technical planning, and delivery milestones.

Key Skills

• Strong experience in Data Engineering Architecture, solution design, and data platform development.
• Hands-on experience with GCP / Google Cloud Platform and cloud-based data solutions.
• Strong proficiency in Python for data engineering and automation.
• Hands-on experience with Data Pipelines, ETL, and Data Integration.
• Experience with Spring Batch, Kafka, and Google Pub/Sub.
• Good understanding of Data Quality, Data Governance, and data management principles.
• Experience with Infrastructure as Code (IaC) and tools such as Terraform.
• Strong knowledge of data formats including Avro, JSON, and Parquet.
• Experience with API Integration, Event-Driven Architecture, and Batch Processing.
• Good knowledge of Bash Scripting and cloud-based development practices.
• Strong Technical Leadership / POD Leadership experience with excellent stakeholder management

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains

• What information we collect during our application and recruitment process and why we collect it;
• How we handle that information; and
• How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.