Azure Data Engineer

Azimuth Grc; Gurugram District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Azimuth Grc in Gurugram, Haryana, India is seeking a Senior Data Engineer to design, develop, and maintain scalable ETL pipelines on Azure. You will implement ingestion, transformation, and storage solutions using Azure Data Factory, Databricks, and Synapse, ensuring high performance and cost efficiency.

The role requires 5+ years in data engineering, strong Python skills with Regex, and solid SQL knowledge.

Qualifications

• Bachelor's degree in computer science, IT, or related field.
• Minimum 5+ years in Data Engineering roles.
• Experience with Azure Data Services and Databricks is required.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Azure Data Factory, Databricks, and related services.
• Implement data ingestion, transformation, and storage solutions on Azure Cloud.
• Optimize data workflows for performance and cost efficiency.
• Collaborate with data scientists and analysts to ensure data availability and quality.
• Monitor and troubleshoot data pipelines, ensuring reliability and accuracy.
• Implement best practices for data security, governance, and compliance.

Skills

Python

SQL

Regex

CI/CD

Data processing

Education

Bachelor's degree in computer science, Information Technology, or related field

Tools

Azure Data Factory

Databricks

Azure Data Lake

Azure Synapse

Git

Job description

RESPONSIBILITIES:

• Design, Develop, and Maintain scalable ETL pipelines using Azure Data Factory, Databricks, and related services.
• Implement data ingestion, transformation, and storage solutions on Azure Cloud.
• Optimize data workflows for performance and cost efficiency.
• Write and maintain Python scripts for data processing, including advanced Regex-based parsing and validation.
• Collaborate with data scientists and analysts to ensure data availability and quality.
• Monitor and troubleshoot data pipelines, ensuring reliability and accuracy.
• Implement best practices for data security, governance, and compliance.

Required Skills & Qualifications:

• Bachelor's degree in computer science, Information Technology, or related field.
• Minimum 5+ years in Data Engineering roles.

Technical Skills:

• Strong experience with Azure Data Services (Data Factory, Data Lake, Synapse).
• Hands-on experience with Databricks for Big Data Processing and Analytics.
• Proficiency in Python, including advanced Regex for text processing.
• Knowledge of SQL and relational database concepts.
• Familiarity with CI/CD pipelines and version control (Git).