Senior Databricks Engineer & Tech Lead

Techstra Solutions; Pittsburgh (Allegheny County); On-site; USD 180,000 - 230,000; Full time

Job summary

Techstra Solutions is seeking a Senior Databricks Engineer / Technical Lead with 10+ years of data engineering, warehousing, and ETL/ELT experience. The role combines technical leadership, hands-on development, and solution architecture to shape scalable data solutions.

The candidate will guide engineering teams, translate business requirements into robust Databricks-based data platforms, and collaborate with stakeholders to ensure secure, maintainable solutions.

Qualifications

• 10+ years of experience in data engineering, data warehousing, ETL/ELT, BI, or enterprise data platforms.
• Hands-on Databricks experience.
• Experience leading data engineering teams.
• Strong skills in Databricks, Spark, PySpark, Python, SQL, Delta Lake.
• Understanding of lakehouse architectures and Medallion Architecture.
• Experience with Unity Catalog and data governance.
• Experience with cloud platforms (Azure, AWS, or Google Cloud).
• CI/CD for data engineering solutions.

Responsibilities

• Provide technical leadership for Databricks and data engineering initiatives.
• Mentor data engineers through design, development, testing, deployment, and production support.
• Translate requirements into actionable engineering work.
• Establish development standards, patterns, reusable frameworks.
• Lead code and design reviews ensuring performance, security, and quality.
• Design scalable lakehouse and data platform architectures.
• Develop scalable data pipelines using Databricks, Spark, PySpark, Python, SQL.
• Implement CI/CD and automated testing for data pipelines.
• Ensure governance using Unity Catalog and data quality controls.

Skills

Databricks

Apache Spark

PySpark

Python

SQL

Delta Lake

CI/CD

Leadership

Data warehousing

Architecture

Tools

Azure DevOps

Power BI

Job description

Techstra Solutions is seeking a Senior Databricks Engineer / Technical Lead with 10+ years of data engineering, warehousing, and ETL/ELT experience. The role combines technical leadership, hands-on development, and solution architecture to shape scalable data solutions.

The candidate will guide engineering teams, translate business requirements into robust Databricks-based data platforms, and collaborate with stakeholders to ensure secure, maintainable solutions.