Data Engineer - Azure

Mindshare; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Mindshare in Bengaluru seeks a Senior Data Engineer to design, develop, and optimize enterprise ETL/ELT pipelines using Azure Data Factory and Azure Data Lake Storage. You will implement complex SQL, drive automation with Python, and lead CI/CD practices to ensure scalable, reliable data solutions.

You will own production pipeline reliability, perform deep root-cause analysis, and set governance standards while collaborating with global teams and analytics partners.

Qualifications

• 3-5 years of progressive experience in data engineering with expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP).
• Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines, including SQL performance tuning and CI/CD automation.
• Advanced knowledge of production operations, troubleshooting, and high-availability data processing at scale.

Responsibilities

• Design, develop, and optimize enterprise ETL/ELT pipelines using Azure Data Factory and data lake storage.
• Implement highly efficient SQL solutions with advanced optimization for analytics models and real-time processing.
• Lead automation frameworks using Python and API orchestration to streamline the data lifecycle.
• Ensure production pipeline reliability; perform root-cause analysis and institute durable stability measures.
• Establish coding standards through reviews and audits, and champion data lineage and governance.
• Provide expert support to analytics and media teams and translate business challenges into scalable technical solutions.

Skills

Azure Data Factory

SQL

CI/CD automation

Python

APIs

Tools

Azure Data Factory

Azure Data Lake Storage

Databricks

DBT

Terraform

Wrike/Jira/Azure DevOps

Job description

Job Summary

As part of the Global Operations Centre (GOC), you will work closely with teams across the United States, Europe, and Asia to deliver high-impact solutions in a collaborative, multicultural environment. We are looking for a Senior Data Engineer, based out of Gurgaon/Bangalore who will:

• Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies-ensuring cross-platform scalability, security, and reliability.
• Implement highly efficient, complex SQL solutions-including advanced query optimization, partitioning, and indexing-to power sophisticated analytics models and enable real-time data processing.
• Lead the development and integration of robust automation frameworks using Python, and API orchestration, introducing innovative solutions to streamline the entire data lifecycle and maximize operational efficiency.
• Exercise full ownership of production pipeline reliability; proactively identify and resolve critical issues through deep root-cause analysis, and institute resilient, long-term stability measures for continuous uptime.
• Establish, refine, and enforce rigorous coding and architectural standards through comprehensive code reviews and technical audits, setting quality benchmarks for the offshore engineering team.
• Champion best-in-class documentation, data lineage, and automated CI/CD deployment practices, ensuring transparency, auditability, and governance across all data assets.
• Demonstrate expert-level support for analytics and media teams, translating business challenges into scalable, high-performance technical solutions, leveraging deep Azure and SQL expertise.

Senior-Level Expectations

• Act as the organization s subject matter expert (SME) in end-to-end pipeline architecture, orchestration frameworks, schema evolution, and advanced Azure Data Factory strategies.
• Lead modernization initiatives across the organization, championing the adoption of technologies such as Databricks, DBT and advanced DevOps practices to future-proof the data platform and enable rapid innovation.
• Ensure strict adherence to SLAs and regulatory compliance through advanced monitoring, proactive risk mitigation, and continuous improvement of operational processes.

Skills and Experience

If this opportunity looks right for you, we are looking for candidates who have:

• 3-5 years of progressive experience in data engineering, with expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP).
• Provenexpertisein designing, optimizing, and managing large-scale, production-grade data pipelines, including deep skills in SQL performance tuning, ADF orchestration, and CI/CD automation.
• Advanced knowledge of production operations, troubleshooting, and high-availability data processing at scale.

Good to Have

• Adverity
• Dataflow
• Big Query
• Databricks
• DBT
• Terraform
• Wrike/Jira/Azure DevOps
• DP-203 / GCP Data Engineer certifications