Remote Databricks Data Engineering Lead — Lakehouse

Valiant Technologies LLC; New Jersey; Remote; USD 87,000 - 117,000; Full time

Job summary

Valiant Technologies LLC is seeking a Databricks Data Engineering Lead to architect and deliver enterprise-scale data solutions on Databricks, PySpark, and Delta Lake. You will mentor engineers, set technical direction, and ensure scalable, reliable pipelines on AWS.

The role is remote with NJ consideration, a 12-month engagement, and involves hands-on leadership, design reviews, and collaboration with business stakeholders to translate requirements into robust data platforms.

Qualifications

• 10+ years of overall experience in Data Engineering and Data Platforms.
• Hands-on experience with Databricks and Databricks Genie.
• Advanced Python programming and PySpark development.
• Strong SQL and data modeling knowledge.
• Experience designing Lakehouse-based architectures and Delta Lake.

Responsibilities

• Lead the design, development, and implementation of enterprise-scale data engineering solutions on Databricks.
• Develop scalable ETL/ELT pipelines using Databricks, Python, and PySpark.
• Provide hands-on technical leadership for Databricks Genie implementations.
• Architect data architectures leveraging Delta Lake and Lakehouse patterns.
• Mentor data engineers and drive engineering standards and best practices.

Skills

Databricks

PySpark

Python

Delta Lake

SQL

Data Modeling

Data Quality

Data Governance

Leadership

Tools

Databricks Genie

Delta Lake

AWS S3

ETL/ELT Frameworks

Job description

Valiant Technologies LLC is seeking a Databricks Data Engineering Lead to architect and deliver enterprise-scale data solutions on Databricks, PySpark, and Delta Lake. You will mentor engineers, set technical direction, and ensure scalable, reliable pipelines on AWS.

The role is remote with NJ consideration, a 12-month engagement, and involves hands-on leadership, design reviews, and collaboration with business stakeholders to translate requirements into robust data platforms.