Azure Data Engineer

Motherson Technology Services Limited; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Motherson Technology Services Limited is seeking a Data Engineer to design, build, and optimize large-scale data pipelines on Azure. You will collaborate with cross-functional teams to gather requirements and implement scalable architectures leveraging ADF, PySpark, and SQL within Azure Cloud.

The role emphasizes automated testing with Pytest and adherence to Scrum practices to ensure timely, high-quality delivery. Bengaluru-based, with on-site collaboration and cloud-focused data solutions.

Qualifications

• 3–7 years of experience in Data Engineering with Azure Data Factory, PySpark, SQL, and Azure Cloud technologies.
• Bachelor's degree in B.Tech / BE.
• Experience with AWS or GCP is an added advantage.

Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory.
• Collaborate with cross-functional teams to design scalable data processing architectures.
• Develop complex SQL queries to optimize databases and troubleshoot in Azure Databricks.
• Follow Agile/Scrum practices to deliver projects on time.

Skills

Azure Data Factory

PySpark

SQL

Azure Cloud

Scrum

Education

B.Tech / BE

Tools

Azure Databricks

Pytest

Job description

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions.
  
• Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs.
  
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks.
  
• Implement automated testing frameworks such as Pytest or Unite Testing to ensure high-quality code delivery.
  
• Participate in Agile development methodologies like Scrum to deliver projects on time.
  

Desired Candidate Profile

• 3-7 years of experience in Data Engineering with expertise in Azure Data Factory (ADF), Pyspark, SQL, and Azure Cloud technologies.
  
• Bachelor's degree in Any Specialization (B.Tech / B.E.).
  
• Experience working with cloud platforms like AWS or GCP is an added advantage.