Senior Azure Data Engineer: ETL, Databricks & Modernization

Vidushi Infotech; United States; Remote; USD 130,000 - 170,000; Full time

Job summary

Vidushi Infotech is seeking a Senior Azure Data Engineer with 5–7 years of hands-on experience building and managing enterprise‑grade data pipelines on the Microsoft Azure stack. The role focuses on SQL, Python, PySpark, and Azure Databricks to design high‑performance ETL/ELT pipelines.

You will modernize legacy assets, ensure data quality and governance, and collaborate with data architects, analysts, and stakeholders.

Qualifications

• 5 to 7 years of hands-on professional experience building, managing, and optimizing scalable data pipelines on Azure.
• Expertise in SQL, Python, and PySpark for large‑scale data transformations.
• Proficient with data governance, testing, and data quality practices.

Responsibilities

• ETL/ELT design, development, and deployment of scalable pipelines using Azure Data Factory, Azure Databricks, and core Azure services.
• Write, test, and maintain production-grade code in Python, PySpark, and SQL.
• Modernize legacy data pipelines to improve throughput, maintainability, and reliability.

Skills

SQL

Python

PySpark

Azure Databricks

ADF

Azure Synapse

Git

CI/CD

Tools

Azure Data Factory (ADF)

Azure Databricks

Azure DevOps

GitHub

Git

Job description

Vidushi Infotech is seeking a Senior Azure Data Engineer with 5–7 years of hands-on experience building and managing enterprise‑grade data pipelines on the Microsoft Azure stack. The role focuses on SQL, Python, PySpark, and Azure Databricks to design high‑performance ETL/ELT pipelines.

You will modernize legacy assets, ensure data quality and governance, and collaborate with data architects, analysts, and stakeholders.