Remote Databricks Data Engineering Lead (12m)

Robotic Technologies Automation; New Jersey; Remote; USD 84,000 - 120,000; Full time

Job summary

Robotic Technologies Automation is seeking a Databricks Data Engineering Lead with 8+ years of experience to steer scalable data solutions on Databricks, Delta Lake, and Lakehouse patterns. You will guide the engineering team, define architectures, and ensure secure, high-performance deployments on AWS Databricks.

Lead the design and optimization of ETL/ELT pipelines, mentor engineers, and collaborate with architects, analysts, and product teams to translate requirements into robust data

Qualifications

• 8+ years of data engineering experience.
• Hands-on Databricks experience.
• Experience with AWS Databricks is desirable.
• Strong Python, PySpark and Delta Lake skills.
• Experience with data governance and quality.

Responsibilities

• Lead design and implementation of enterprise-scale data solutions on Databricks.
• Develop scalable ETL/ELT pipelines using Databricks, Python, PySpark.
• Provide hands-on leadership for Databricks Genie implementations.
• Design data architectures leveraging Delta Lake and Lakehouse patterns.
• Build reusable data ingestion, transformation, validation components.
• Tune PySpark workloads for performance and reliability.
• Ensure data quality, governance, security, monitoring, and ops controls.
• Mentor data engineers and guide development and deployment.
• Collaborate with architects, analysts, and business teams.
• Support production deployments and incident resolution.
• Contribute to documentation, deployment strategy, and standards.

Skills

Python programming

PySpark

SQL

Data modeling

Data quality

Observability

Production support

Technical leadership

Mentoring

Databricks Genie

Tools

Databricks

Databricks Genie

AWS data services

CI/CD for data engineering

Lakehouse architectures

Job description

Robotic Technologies Automation is seeking a Databricks Data Engineering Lead with 8+ years of experience to steer scalable data solutions on Databricks, Delta Lake, and Lakehouse patterns. You will guide the engineering team, define architectures, and ensure secure, high-performance deployments on AWS Databricks.

Lead the design and optimization of ETL/ELT pipelines, mentor engineers, and collaborate with architects, analysts, and product teams to translate requirements into robust data