Lead Data Engineer - Cloud Databricks Migration & Lakehouse

TechDigital Group; Jersey City (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

TechDigital Group is looking for a skilled data engineer in Jersey City, NJ, to lead the migration of legacy data platforms to cloud-native solutions using Databricks. The ideal candidate will have 8–12 years of experience in data engineering and strong expertise in Apache Spark and PySpark. Responsibilities include designing Databricks architectures, ensuring data quality and governance, and implementing cloud security measures. This role offers the opportunity to work on large-scale transformative projects in a collaborative environment.

Qualifications

• 8–12+ years in data engineering/platform modernization.
• Strong hands-on experience with Databricks in large-scale enterprises.
• Proven experience delivering cloud migration programs.
• Deep expertise in Apache Spark, PySpark, Spark SQL.

Responsibilities

• Lead and execute migration of legacy data platforms to Databricks.
• Design and implement Databricks Lakehouse architecture.
• Embed data quality and governance controls in migrations.
• Implement cloud security and resilience measures.

Skills

Data engineering experience

Databricks expertise

Apache Spark proficiency

Cloud migration experience

Data quality controls

Job description

TechDigital Group is looking for a skilled data engineer in Jersey City, NJ, to lead the migration of legacy data platforms to cloud-native solutions using Databricks. The ideal candidate will have 8–12 years of experience in data engineering and strong expertise in Apache Spark and PySpark. Responsibilities include designing Databricks architectures, ensuring data quality and governance, and implementing cloud security measures. This role offers the opportunity to work on large-scale transformative projects in a collaborative environment.