Azure Data Engineer

Black And White Business Solutions; Pune District, Bengaluru, Hyderabad; On-site; INR 800,000 - 1,200,000; Full time

Benefits offered by this job

Immediate joining preferred

Opportunity to work with the latest Azure technologies

Job summary

Black And White Business Solutions is seeking a skilled Azure Data Engineer with 5 to 10 years of experience in designing and maintaining enterprise-scale data solutions on the Azure cloud platform. The ideal candidate must possess strong skills in ETL development, PySpark, SQL, and various Azure tools.

The role involves designing and optimizing data pipelines, collaborating with stakeholders, and ensuring data quality and governance. Immediate joining or candidates with a notice period of up to 45 days are preferred.

Qualifications

• 5 to 10 years of experience in designing and developing data solutions.
• Strong expertise in ETL development, PySpark, Azure Data Factory (ADF), SQL.
• Experience in Azure Synapse Analytics and Azure Databricks.

Responsibilities

• Design and maintain ETL pipelines for data processing.
• Develop data orchestration pipelines using Azure Data Factory.
• Write optimized SQL queries and ensure data quality.

Skills

ETL Development

PySpark

Azure Data Factory (ADF)

SQL

Azure Synapse Analytics

Azure Databricks

Data Lake and Data Warehouse concepts

Performance tuning and optimization

Analytical and problem-solving skills

Education

Any Full-Time UG / PG

Job description

Job Title:

AZURE DATA ENGINEER

Experience:

5 to 10 Years

Location:

Bangalore / Hyderabad / Pune

Education:

Any Full-Time UG / PG

Notice Period:

Immediate - 45 Days

Employment Type:

Full-Time

Job Summary

We are looking for a highly skilled Azure Data Engineer with 510 years of experience in designing, developing, and maintaining enterprise‑scale data solutions on the Azure cloud platform. The ideal candidate should possess strong expertise in ETL development, PySpark, Azure Data Factory (ADF), SQL, Azure Synapse Analytics, and Azure Databricks.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large‑scale data processing.
• Build and optimize data transformation workflows using PySpark and Azure Databricks.
• Develop and manage data orchestration pipelines using Azure Data Factory (ADF).
• Design and implement data warehousing solutions using Azure Synapse Analytics.
• Write efficient and optimized SQL queries, stored procedures, and database objects.
• Integrate data from multiple sources and ensure data quality, reliability, and governance.
• Collaborate with business stakeholders, architects, and analysts to gather and translate requirements into technical solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Participate in code reviews, testing, deployment, and production support activities.
• Follow best practices for cloud‑based data engineering and data security.

Required Skills

• Strong experience in ETL Development
• Hands‑on expertise in PySpark
• Experience with Azure Data Factory (ADF)
• Advanced proficiency in SQL
• Experience with Azure Synapse Analytics
• Strong working knowledge of Azure Databricks
• Understanding of Data Lake, Data Warehouse, and Big Data concepts
• Experience in performance tuning and optimization of data pipelines
• Strong analytical and problem‑solving skills

Preferred Qualifications

• Experience working on enterprise‑scale Azure data platforms
• Knowledge of CI/CD implementation for data engineering projects
• Familiarity with Agile/Scrum methodologies
• Azure certifications will be an added advantage

Candidate Profile

• Strong relevant experience in Data Engineering
• Strong communication and stakeholder management skills
• Ability to work independently and collaboratively in a fast‑paced environment
• Immediate joiners or candidates with a notice period of up to 45 days preferred