Remote Databricks Data Engineering Lead

Ethereum Technologies LLC; New Jersey; Remote; USD 84,000 - 120,000; Full time

Job summary

Ethereum Technologies is seeking an experienced Databricks Data Engineering Lead for a remote engagement in New Jersey. You will lead design and development of enterprise-scale data solutions using Databricks, Python, PySpark, Delta Lake, and Lakehouse patterns.

The candidate will provide technical direction, mentor engineers, and ensure scalable, secure pipelines on AWS, with focus on data quality, governance, and production readiness. 12-month duration, bill rate $74/hour (C2C).

Qualifications

• 10+ years of overall experience in Data Engineering / Data Platforms.
• Strong hands-on experience with Databricks.
• Strong practical experience with Databricks Genie.
• Advanced programming experience in Python.
• Strong development and optimization experience using PySpark.
• Strong understanding and implementation experience with Delta Lake.
• Experience designing and implementing Lakehouse-based data platforms.
• Strong knowledge of SQL and data modeling concepts.
• Experience developing enterprise-grade batch and/or streaming data pipelines.
• Strong understanding of data quality, observability, performance tuning, and production support.
• Experience leading technical teams and driving engineering standards and best practices.

Responsibilities

• Lead the design, development, and implementation of enterprise-scale data engineering solutions on Databricks.
• Design and develop scalable ETL/ELT pipelines using Databricks, Python, and PySpark.
• Provide hands-on technical leadership for Databricks Genie implementations and use cases.
• Design and optimize data architectures leveraging Delta Lake and Lakehouse architectural patterns.
• Build reusable frameworks and engineering components for data ingestion, transformation, validation, and processing.
• Develop and optimize complex PySpark workloads for performance, reliability, and scalability.
• Implement data quality, governance, security, monitoring, and operational controls across data pipelines.
• Provide technical leadership through architecture reviews, design reviews, code reviews, troubleshooting, and engineering best practices.
• Mentor data engineers and provide technical guidance during development and implementation.
• Work closely with architects, business analysts, data teams, and application teams to translate requirements into technical solutions.
• Support production deployments, performance tuning, incident resolution, and continuous improvement.
• Contribute to technical documentation, solution design, deployment strategy, and engineering standards.

Skills

Leadership

Team mentoring

Data modeling

Governance

ETL/ELT pipelines

Tools

Databricks

Databricks Genie

Python

PySpark

Delta Lake

Lakehouse

SQL

Job description

Ethereum Technologies is seeking an experienced Databricks Data Engineering Lead for a remote engagement in New Jersey. You will lead design and development of enterprise-scale data solutions using Databricks, Python, PySpark, Delta Lake, and Lakehouse patterns.

The candidate will provide technical direction, mentor engineers, and ensure scalable, secure pipelines on AWS, with focus on data quality, governance, and production readiness. 12-month duration, bill rate $74/hour (C2C).