Deputy Manager Data Engineering Bengaluru Engineering as a Service/ Operate - Deloitte

OpenTalent; Karnataka; On-site; INR 1,800,000 - 3,400,000; Full time

Job summary

OpenTalent in Bengaluru is seeking a hands-on Data Engineering Lead to guide design, implementation and delivery of large-scale cloud data solutions. You will oversee ETL/ELT pipelines, data lakes, and governance, while managing client engagements from pre-sales to delivery.

The role requires 8–10 years of experience, strong cloud expertise (AWS/Azure/GCP), and leadership of technical teams. A cloud-first, security-conscious mindset is essential for success.

Qualifications

• 5+ years of hands-on experience in Data Engineering and cloud-based data solutions.
• Strong expertise in AWS, Azure, or Google Cloud Platform.
• Experience designing and implementing Data Lakes.
• Hands-on experience with Apache Spark, Databricks, AWS Glue, Azure Data Factory, or similar ETL tools.
• Experience with serverless computing (AWS Lambda, Azure Functions, Google Cloud Functions).
• Strong understanding of data governance, data quality, security, and compliance.
• Experience with Docker and Kubernetes.
• Strong programming skills in SQL, Python, Scala, or Java.
• Experience with cloud data warehouses such as Amazon Redshift, Google BigQuery, or Azure Synapse.
• Proven leadership experience managing technical teams and delivering projects from pre-sales through implementation.
• Excellent communication and stakeholder management skills.

Responsibilities

• Lead the design and implementation of scalable cloud-based data engineering solutions and data lakes.
• Drive pre-sales activities, including client discussions, solution design, technical proposals, and PoCs.
• Design secure and scalable data storage architectures using AWS, Azure, or GCP.
• Build and optimize ETL/ELT pipelines using Spark, Databricks, AWS Glue, Azure Data Factory, or similar tools.
• Develop efficient data transformation and processing workflows using serverless technologies
• Implement data governance, security, and data quality frameworks.
• Collaborate with data scientists, BI teams, and business stakeholders to enable reliable analytics.
• Lead and mentor a team of data engineers throughout the project lifecycle.
• Optimize cloud infrastructure, storage, and processing costs while maintaining performance and reliability.
• Ensure successful project delivery aligned with client and business objectives.

Job description

Job Title: Data Engineering Lead

Location: Bengaluru

Experience: 8-10 Years

About the Role

We are looking for a hands-on Data Engineering Lead to lead the design, implementation, and delivery of large-scale cloud-based data engineering solutions. The ideal candidate will have strong expertise in data lakes, cloud platforms, ETL/ELT pipelines, and modern data architecture while managing technical teams and client engagements from pre-sales through project delivery.

Key Responsibilities

• Lead the design and implementation of scalable cloud-based data engineering solutions and data lakes.
• Drive pre-sales activities, including client discussions, solution design, technical proposals, and Proof of Concepts (PoCs).
• Design secure and scalable data storage architectures using AWS, Azure, or GCP.
• Build and optimize ETL/ELT pipelines using Apache Spark, Databricks, AWS Glue, Azure Data Factory, or similar technologies.
• Develop efficient data transformation and processing workflows using serverless technologies such as AWS Lambda, Azure Functions, or Google Cloud Functions.
• Implement data governance, security, and data quality frameworks.
• Collaborate with data scientists, BI teams, and business stakeholders to enable reliable analytics.
• Lead and mentor a team of data engineers throughout the project lifecycle.
• Optimize cloud infrastructure, storage, and processing costs while maintaining performance and reliability.
• Ensure successful project delivery aligned with client and business objectives.

Required Skills

• 5+ years of hands-on experience in Data Engineering and cloud-based data solutions.
• Strong expertise in AWS, Azure, or Google Cloud Platform.
• Experience designing and implementing Data Lakes.
• Hands-on experience with Apache Spark, Databricks, AWS Glue, Azure Data Factory, or similar ETL tools.
• Experience with serverless computing (AWS Lambda, Azure Functions, Google Cloud Functions).
• Strong understanding of data governance, data quality, security, and compliance.
• Experience with Docker and Kubernetes.
• Strong programming skills in SQL, Python, Scala, or Java.
• Experience with cloud data warehouses such as Amazon Redshift, Google BigQuery, or Azure Synapse.
• Proven leadership experience managing technical teams and delivering projects from pre-sales through implementation.
• Excellent communication and stakeholder management skills.

Preferred Qualifications

• Experience with AWS Lake Formation, Azure Purview, or Google Data Catalog.
• Cloud certifications (AWS, Azure, or GCP).
• Experience with CI/CD pipelines and DevOps practices.