Data Engineering Lead

Talworx Solutions

Hyderabad, Bengaluru

Hybrid

INR 3,500,000 - 6,000,000

Full time

7 days ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Talworx Solutions is seeking a hands-on Data Engineering Lead to drive the design, implementation and delivery of large-scale cloud-based data solutions. You will guide data-lake architectures, manage client engagements, and mentor a team of engineers across the project lifecycle.

The role requires 8 years of experience, expertise in multi-cloud platforms, and a strong background in ETL/ELT pipelines, data governance, and secure data architectures.

Qualifications

5+ years in Data Engineering and cloud-based data solutions.
Strong expertise in AWS, Azure, or Google Cloud Platform.
Experience designing and implementing Data Lakes.
Hands-on with Spark, Databricks, AWS Glue, Azure Data Factory or similar ETL tools.
Experience with serverless computing (Lambda, Functions).
Understanding of governance, data quality, security and compliance.
Experience with Docker and Kubernetes.
Programming skills in SQL, Python, Scala or Java.
Experience with cloud data warehouses such as Redshift, BigQuery, or Synapse.
Leadership experience delivering projects from pre-sales through implementation.
Excellent communication and stakeholder management.

Responsibilities

Lead the design and implementation of scalable cloud-based data engineering solutions and data lakes.
Drive pre-sales activities, client discussions, solution design, proposals and PoCs.
Design secure, scalable data storage using AWS, Azure, or GCP.
Build and optimize ETL/ELT pipelines using Spark, Databricks, Glue, or Data Factory.
Develop data transformation workflows using serverless technologies.
Implement data governance, security, and quality frameworks.
Collaborate with data scientists, BI teams, and stakeholders for reliable analytics.
Lead and mentor a team of data engineers through the project lifecycle.
Optimize cloud costs while maintaining performance and reliability.
Ensure successful delivery aligned with client and business objectives.

Skills

Data Engineering

Cloud Platforms

ETL/ELT

Apache Spark

Databricks

Serverless

Data Governance

SQL/Python/Java/Scala

Docker & Kubernetes

Cloud Data Warehouses

Education

BE/ME/B.Tech/M.Tech/BCA/MCA/BSc/MSc

Tools

AWS Glue

Azure Data Factory

Databricks

Apache Spark

Docker

Kubernetes

BigQuery

Redshift

Job description

Job Title:Data Engineering Lead

Location:Bengaluru/Hyderabad

Experience:8 Years

About the Role

We are looking for a hands‑on Data Engineering Leadto lead the design,

implementation, and delivery of large‑scale cloud‑based data engineering

solutions. The ideal candidate will have strong expertise in data lakes, cloud

platforms, ETL/ELT pipelines, and modern data architecture while managing

technical teams and client engagements from pre‑sales through project

delivery.

Key Responsibilities

Lead the design and implementation of scalable cloud-based data

engineering solutions and data lakes.

Drive pre-sales activities, including client discussions, solution design,

technical proposals, and Proof of Concepts (PoCs).

Design secure and scalable data storage architectures using AWS, Azure, or

GCP.

Build and optimize ETL/ELT pipelines using Apache Spark, Databricks, AWS

Glue, Azure Data Factory, or similar technologies.

Develop efficient data transformation and processing workflows using

serverless technologies such as AWS Lambda, Azure Functions, or Google

Cloud Functions.