Lead Engineer I - Innovation - Admin - BLR

Withum; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Withum is seeking a Data Engineer III to join the Product Development team in Bengaluru. The ideal candidate will design and optimize data pipelines, mentor junior engineers, and ensure data governance while collaborating with various stakeholders.

The position requires a minimum of 8 years of experience in data engineering and proficiency in Azure services. Candidates with advanced knowledge in Microsoft Fabric are preferred. Join us to empower clients with innovative data solutions.

Qualifications

• 8 years of experience in data engineering, including 2 years on Azure.
• Advanced expertise in Microsoft Azure and Microsoft Fabric.
• Proficient with Git, CI/CD, and Agile methodologies.

Responsibilities

• Design and implement scalable data pipelines using Azure.
• Collaborate with stakeholders to deliver robust data solutions.
• Mentor junior engineers and contribute to architectural standards.

Skills

SQL

Python

Apache Spark

Azure Data Factory

Microsoft Fabric

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure DevOps

Power BI

Job description

Withum is a place where talent thrives - where who you are matters. It’s a place of endless opportunities for growth. A place where entrepreneurial energy plus inclusive teamwork equals exponential results. We empower clients with innovative tools and solutions to address their data, analytics, and business intelligence needs. At Withum, talent thrives—we recruit only the best and brightest people with a genuine passion for technology and impact.

We are seeking Data Engineer III to join our Product Development team in our Bengaluru office. This role is ideal for a firsthand engineer who can design, build, and optimize data pipelines and architectures, while mentoring junior engineers and collaborating across teams to deliver scalable data solutions.

How You’ll Spend Your Time

• Design and implement scalable data pipelines using Azure Data Factory, Synapse Pipelines, and Apache Spark on Azure Fabric.
• Architect and maintain data models and storage solutions using OneLake, Delta Lake, Parquet, ADLS gen2.
• Develop and optimize Dataflows Gen2, Notebooks, and KQL queries for data transformation and exploration.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver robust solutions.
• Implement data governance, lineage, and quality frameworks using Microsoft Purview and Fabric Data Activator.
• Supporting CI/CD pipelines and automation for data workflows using Azure DevOps or GitHub Actions.
• Integrating external datasets by working with APIs and third-party data sources.
• Ensure security, compliance, and performance of data systems.
• Mentor junior engineers and contribute to best practices and architectural standards.

The Kinds of People We Want to Talk To

• Education: A bachelor’s degree or higher in Computer Science, Information Systems, or a related field.
• Experience: 8 years of experience in data engineering, including a minimum of two years on Azure.
• Proficiency: Skilled in SQL, Python, and Spark.
• Azure Services: Experience with Azure cloud services such as Data Factory, Synapse, Blob Storage, Functions, ADLS gen2, and Data Bricks.
• Microsoft Fabric: Advanced expertise in Microsoft Fabric
• Data Management: Familiarity with data governance, lineage, and cataloging tools.
• Data Warehousing: Strong understanding of data warehousing concepts and dimensional modeling.
• Methodologies: Proficient with version control (Git), CI/CD, and Agile methodologies.
• Communication: Excellent communication and collaboration skills.
• Certification: Microsoft Azure Data Engineer certification is an advantage.

Must-Have Technical Skills

• Cloud Platform: Advanced expertise in Microsoft Azure, with a particular focus on Microsoft Fabric.
• Data Engineering: Proficiency in Azure Data Factory, Azure Synapse Analytics, and Apache Spark.
• Lakehouse Architecture: Familiarity with OneLake, Delta Lake, Parquet, Delta, Iceberg, and Hudi.
• Warehousing: Proficiency in star/snowflake schemas, dimensional modeling, and satellite hub models.
• Programming: Expertise in Python, PySpark, SQL, and KQL (Kusto Query Language).
• Data Orchestration: Firsthand experience with Dataflows Gen2 and Notebooks.
• DevOps & CI/CD: Proficiency in Azure DevOps, Git, and YAML pipelines.
• Security & Governance: Advanced understanding of Microsoft Purview, RBAC, and data masking techniques.

Nice-to-Have Skills

• Streaming & Real-Time: Knowledge and experience with Azure Event Hubs and Azure Stream Analytics.
• Machine Learning Integration: Familiarity with Azure ML and MLflow.
• Monitoring & Observability: Proficiency in Azure Monitor and Log Analytics.
• Data Visualization: Expertise in Power BI, particularly in Direct Lake mode.
• Infrastructure Code: Experience with Bicep and Terraform.
• Data Cataloging: Familiarity with Data Activator and data lineage tools.
• Other Tools: Knowledge of dbt, Delta Live Tables, and Great Expectations.

Withum will not discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or because he or she is a protected veteran.