Walk-in | Azure Data Engineer

Everforth Quinnox; Bengaluru; Hybrid; INR 900,000 - 1,500,000; Full time

Job summary

Everforth Quinnox is seeking a skilled Azure Data Engineer to design and implement large-scale data migration and integration on the Azure platform. You will work with ADF, Databricks, PySpark, SQL, Python, and Azure DevOps to ensure data quality, performance, and reliability.

The role involves migrating data from legacy systems to Azure-based data lakes and data warehouses, building scalable ETL pipelines, and collaborating with analysts and architects to meet data requirements in an Agile

Qualifications

• 3–8 years of data engineering experience with ETL/Data Migration focus.
• Hands-on expertise in Azure Data Factory, Databricks, PySpark and SQL.
• Proficient in Python and building automated data pipelines.
• Experience with CI/CD processes and deployment to Azure DevOps.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using ADF.
• Build data transformations with Databricks and PySpark.
• End-to-end data migration from legacy systems to Azure data lakes/warehouses.
• Analyze source-to-target mappings and implement transformations.
• Develop reusable data ingestion frameworks and automation solutions.
• Write optimized SQL and perform data quality checks during migration.
• Collaborate with analysts, architects, QA, and stakeholders; support CI/CD with Azure DevOps.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and adhere to best practices; maintain docs/runbooks.

Skills

ETL experience

Data migration

SQL proficiency

Python proficiency

Stakeholder collaboration

CI/CD awareness

Tools

Azure Data Factory

Azure Databricks

SQL

PySpark

Python

Azure DevOps

Job description

Requirement : Azure Data Engineer

Location: Bengaluru
Experience : 3Years - 8years
Role : B2/Senior consultant
B3/Lead Consultant

Job Description:

We are seeking a highly skilled ETL Data Migration Engineer with 4 to 7 years of experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have strong hands‑on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Build and optimize data transformation processes using Azure Databricks and PySpark.
• Perform end‑to‑end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
• Analyze source-to-target mappings and implement complex business transformation logic.
• Develop reusable data ingestion frameworks and automation solutions.
• Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions. Implement data validation, reconciliation, and data quality checks during migration activities.
• Collaborate with Business Analysts, Architects, QA teams, and stakeholders to understand data requirements. Support deployment, release management, and CI/CD processes using Azure DevOps.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and ensure adherence to development best practices.
• Create and maintain technical documentation, migration runbooks, and deployment guides. Support Agile ceremonies including Sprint Planning, Daily Scrum, Retrospectives, and Release activities