Azure Databricks Tech Lead: Data Engineering & Spark

PDSSOFT INC.; Charlotte (NC); On-site; USD 120,000 - 190,000; Full time

Job summary

PDSSOFT INC. seeks a Technical Team Lead with deep Azure Databricks expertise to guide a development team in building data-driven solutions. You will oversee design, development, and implementation using Spark, Databricks, and cloud data stores.

The role emphasizes leadership, multi-project management, and delivery of scalable data pipelines and warehousing concepts in a fast-paced environment.

Qualifications

• Proven expertise in Azure Databricks with Spark, data pipelines and data lakes.
• Strong programming skills in Python/Scala/SQL.
• Experience with cloud data storage (Azure Data Lake, Azure SQL).
• Solid data modeling, ETL, and data warehousing fundamentals.
• Proven track record leading technical teams and delivering projects.

Skills

Azure Databricks

Spark

Python

Scala

SQL

Data modeling

ETL

Data warehousing

Leadership

Project management

Education

Bachelor's degree in CS/IT

Tools

Azure Data Lake Storage

Azure SQL Database

Job description

PDSSOFT INC. seeks a Technical Team Lead with deep Azure Databricks expertise to guide a development team in building data-driven solutions. You will oversee design, development, and implementation using Spark, Databricks, and cloud data stores.

The role emphasizes leadership, multi-project management, and delivery of scalable data pipelines and warehousing concepts in a fast-paced environment.