Data Engineer

MASTER MIND CONSULTANCY; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Master Mind Consultancy is hiring a Data Engineer to own and scale the data infrastructure in a Bangalore-based setup. The role focuses on designing and maintaining robust data pipelines and ETL processes using Azure data services.

You will collaborate with data scientists and analysts, ensuring data quality and governance across the data lake and storage outputs. The ideal candidate has 5–10 years of experience with Azure Data Factory, Synapse, Databricks, and related storage services, plus

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field; equivalent experience.
• 5–10 years of proven Data Engineer or similar experience handling data and ETL processes.
• Strong knowledge of Microsoft Azure services including Azure Data Factory, Synapse, Databricks, Blob Storage, Data Lake Gen 2.
• Experience using SQL DML to query modern RDBMS (SQL Server, PostgreSQL).
• Understanding of Software Engineering practices applied to Data Engineering (CI/CD, version control, testing).
• Experience with big data technologies (e.g., Spark).
• Strong problem-solving, attention to detail, and excellent communication and collaboration skills.

Responsibilities

• Oversee the entire data infrastructure to ensure scalability, operation efficiency and resiliency.
• Mentor junior data engineers within the organization.
• Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
• Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs (Azure Data Lake Gen 2, Azure Blob Storage).
• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
• Ensure data quality and integrity through data validation techniques and frameworks.
• Develop and maintain documentation for data processes, configurations, and best practices.
• Monitor and troubleshoot data pipeline issues to ensure timely resolution.
• Stay current with industry trends and emerging technologies to keep data solutions cutting-edge.
• Manage the CI/CD process for deploying and maintaining data solutions.

Skills

Data pipelines

ETL development

Azure data services

CI/CD practices

SQL querying

Spark

Communication

Mentoring

Education

Bachelor's degree in CS/Engineering

Tools

Azure Data Factory

Azure Synapse

Azure Databricks

Azure Data Lake Gen 2

Azure Blob Storage

SQL Server

PostgreSQL

Spark

Job description

Job Title : Data Engineer
Experience : 5 TO 10 Years
Location : Bangalore

Roles & Responsibilities

• Oversee the entire data infrastructure to ensure scalability, operation efficiency and resiliency
  
• Mentor junior data engineers within the organization
  
• Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric)
  
• Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage)
  
• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions
  
• Optimize data pipelines in the Azure environment for performance, scalability, and reliability
  
• Ensure data quality and integrity through data validation techniques and frameworks
  
• Develop and maintain documentation for data processes, configurations, and best practices
• Monitor and troubleshoot data pipeline issues to ensure timely resolution
  
• Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge
  
• Manage the CI/CD process for deploying and maintaining data solutions

Requisites

• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals
  
• Relevant years of proven experience as a Data Engineer or similar role dealing with data and ETL processes. 5 - 10 years of experience
  
• Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2
  
• Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL)
  
• Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing)
  
• Experience with big data technologies (e.g., Spark)
  
• Strong problem-solving skills and attention to detail Excellent communication and collaboration skills