Azure Data Engineer: Pipelines, PySpark & DW Modernization

StaffXpert LLC; Montvale (NJ); Hybrid; USD 110,000 - 170,000; Part time

Job summary

STAFFXPERT LLC is seeking a Data Engineer in Montvale, NJ to support data platform stability, troubleshooting, and modernization initiatives. The ideal candidate will have strong experience with Azure data engineering, Python, Databricks, PySpark, and SQL Server, along with a proven ability to troubleshoot production data environments and optimize data pipelines and warehouse performance.

This role requires close collaboration with technical teams and business stakeholders to resolve

Qualifications

• 5+ years of data engineering, application support, technical leadership, or data-platform troubleshooting.
• Bachelor's degree in CS/IS/Engineering or related field.
• Hands-on experience with Microsoft Azure data engineering technologies.
• Strong programming experience with Python.
• Working experience with Databricks and PySpark.
• Strong T-SQL skills and enterprise data warehouses.
• Experience troubleshooting ETL pipelines, data-quality issues, and performance challenges.
• Experience with incident management and stakeholder communication.

Responsibilities

• Support, monitor, and troubleshoot data pipelines, large datasets, and production data issues.
• Develop and maintain data engineering solutions within Microsoft Azure environments using Python and Databricks.
• Build notebooks, data transformations, and data processing workflows using PySpark.
• Perform data read/write operations and troubleshoot data processing issues across enterprise platforms.
• Optimize data warehouse performance using T-SQL, indexing, and query tuning.
• Troubleshoot ETL pipelines, data-quality issues, and scalability challenges.
• Investigate production incidents, perform root-cause analysis, and implement sustainable solutions.
• Collaborate with stakeholders and technical teams to resolve data and platform issues.
• Contribute to data platform modernization and operational improvements.
• Provide technical guidance to team members when needed.

Skills

Azure data engineering

Python

Databricks

PySpark

T-SQL

Incident management

Problem solving

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Tools

Azure Data Factory (ADF)

Azure Data Lake Storage (ADLS)

Delta Lake

Parquet

AKS

SSIS/MSBI

Power BI

Alteryx

Job description

STAFFXPERT LLC is seeking a Data Engineer in Montvale, NJ to support data platform stability, troubleshooting, and modernization initiatives. The ideal candidate will have strong experience with Azure data engineering, Python, Databricks, PySpark, and SQL Server, along with a proven ability to troubleshoot production data environments and optimize data pipelines and warehouse performance.

This role requires close collaboration with technical teams and business stakeholders to resolve