Lead Data Engineer

SourcingXPress; Mumbai; Hybrid; INR 2,500,000 - 4,000,000; Full time

Job summary

SourcingXPress is looking for a Lead Data Engineer in Mumbai to spearhead the design and delivery of scalable data platforms. You will be responsible for leading engineering teams, defining data architecture, and collaborating with business stakeholders. The ideal candidate requires 7-10 years of experience in Data Engineering, proficiency in Python and PySpark, and a strong background in Big Data technologies. This position offers a hybrid working model with four days in-office and one day remote.

Qualifications

• 7-10 years of experience in Data Engineering.
• Proven experience in leading teams and delivering large-scale data platforms.
• Strong track record of solution architecture and stakeholder management.

Responsibilities

• Lead the design and implementation of end-to-end data engineering solutions.
• Architect scalable, fault-tolerant data pipelines on distributed systems.
• Define and enforce data engineering best practices and standards.
• Work closely with business stakeholders for robust technical solutions.
• Drive data modelling, pipeline optimization, and performance tuning.
• Ensure data quality, security, and compliance standards are met.
• Mentor and lead a team of data engineers for delivery excellence.

Skills

Expert-level proficiency in Python

Expert-level proficiency in PySpark

Expert-level proficiency in Advanced SQL

Strong experience with Big Data technologies (Hadoop, Hive)

Deep understanding of Spark internals (DAG, partitioning, optimization)

Extensive experience in ETL/ELT frameworks

Strong hands-on experience with AWS cloud

Experience with CI/CD pipelines

Job description

Company: Go Digital Technology

Website: Visit Website

Business Type: Small/Medium Business

Company Type: Service

Business Model: B2B

Funding Stage: Private Equity

Industry: Information Technology

Salary Range: ₹ 25-40 Lacs PA

Lead Data Engineer

Mumbai | Hybrid (4 Days Office, 1 Day Remote)

About The Role

We are looking for a Lead Data Engineer to drive the design and delivery of scalable, enterprise-grade data platforms. This role is ideal for someone who can own end-to-end data architecture, lead engineering teams, and influence data strategy across the organization.

Key Responsibilities

• Lead the design and implementation of end-to-end data engineering solutions
• Architect scalable, fault-tolerant data pipelines on distributed systems
• Define and enforce data engineering best practices, standards, and frameworks
• Work closely with business stakeholders to translate requirements into robust technical solutions
• Drive data modelling, pipeline optimization, and performance tuning initiatives
• Ensure data quality, security, and compliance standards are met
• Collaborate with enterprise architects and leadership on data strategy and roadmap
• Mentor and lead a team of data engineers, ensuring delivery excellence

Skills Required

• Expert-level proficiency in Python, PySpark, and Advanced SQL
• Strong experience with Big Data technologies (Hadoop, Hive)
• Deep understanding of Spark internals (DAG, partitioning, memory management, optimization)
• Extensive experience in ETL/ELT frameworks and data modelling
• Strong hands‑on experience with AWS cloud and data services
• Experience with CI/CD pipelines, Git, and Agile delivery models
• Ability to design scalable and modular data architectures

Experience

• 7–10 years of experience in Data Engineering
• Proven experience in leading teams and delivering large-scale data platforms
• Strong track record of solution architecture and stakeholder management

Nice to Have

• Experience with real‑time / streaming data pipelines
• Hands‑on with workflow orchestration tools (Autosys, etc.)
• Exposure to enterprise data governance and architecture frameworks