Lead Data Engineer - Hybrid, Azure & PySpark

Harvey Nash; Charlotte (NC); Hybrid; USD 103,000 - 117,000; Full time

Job summary

Harvey Nash in Charlotte, NC seeks a hands-on Lead Data Engineer to lead a team of engineers and drive technical delivery. The role requires strong Python, PySpark, SQL, Databricks, and Azure cloud data platforms, with experience in enterprise-scale data solutions and data modeling.

This hybrid position offers two days on site per week with contract-to-hire potential. The interview will include live coding focused on PySpark and SQL, and the pay range is $75 to $85 per hour.

Qualifications

• 5–8 years of Data Engineering/Data Integration experience.
• Strong Python.
• Strong PySpark / Spark.
• Strong SQL.
• Hands-on Databricks.
• Experience with Azure or another major cloud platform.
• Data Lake, ETL/ELT and datapipeline development.
• SQL and pipeline performance optimization.
• CI/CD experience.
• Strong understanding of data structures and data modeling.
• Experience supporting production data applications and troubleshooting complex issues.

Responsibilities

• Lead engineers and drive technical delivery in a hands-on capacity.
• Mentor engineers, conduct code reviews and provide technical direction.
• Design and implement enterprise-scale data solutions using PySpark, SQL and Databricks.
• Engage with Azure/cloud data platforms and data pipelines in production environments.
• Prepare for a technical interview with live coding focused on PySpark and SQL.

Skills

Python

PySpark

SQL

Databricks

Azure

Cloud data platforms

Team leadership

Data architecture

Data lakes

ETL/ELT

Data modeling

Performance tuning

CI/CD

Production pipelines

Mentoring

Code reviews

Technical direction

Kafka

Kinesis

Regulated environments

Tools

Databricks

Job description

Harvey Nash in Charlotte, NC seeks a hands-on Lead Data Engineer to lead a team of engineers and drive technical delivery. The role requires strong Python, PySpark, SQL, Databricks, and Azure cloud data platforms, with experience in enterprise-scale data solutions and data modeling.

This hybrid position offers two days on site per week with contract-to-hire potential. The interview will include live coding focused on PySpark and SQL, and the pay range is $75 to $85 per hour.