Databricks Architect Lead - Data & Analytics Scale

E-Solutions; Woodbridge Township (NJ); Hybrid; USD 100,000 - 120,000; Full time

Benefits offered by this job

Medical insurance

Vision insurance

401(k)

Job summary

A dynamic IT consultancy is seeking a Databrick Architect/Lead with strong MDM experience to join their data team. The ideal candidate will design and optimize large-scale data pipelines using Databricks, ensuring performance and reliability. Responsibilities include building ETL processes, collaborating with cross-functional teams, and implementing data governance standards. Familiarity with Azure Cloud Services and strong skills in SQL and Python are essential. This is a hybrid contract role based in Woodbridge Township, NJ.

Qualifications

• Strong expertise in Databricks, including Delta Lake and Lakehouse Architecture.
• Proficiency in big data processing using Spark and PySpark.
• Familiarity with data governance and security standards.

Responsibilities

• Build and maintain scalable ETL/ELT pipelines using Databricks.
• Integrate data from multiple sources including Azure Blob Storage.
• Monitor and troubleshoot data pipelines to ensure reliability.

Skills

MDM

Databricks

Pyspark

SQL

Python

Tools

Azure Cloud Services

GitLab

Job description

A dynamic IT consultancy is seeking a Databrick Architect/Lead with strong MDM experience to join their data team. The ideal candidate will design and optimize large-scale data pipelines using Databricks, ensuring performance and reliability. Responsibilities include building ETL processes, collaborating with cross-functional teams, and implementing data governance standards. Familiarity with Azure Cloud Services and strong skills in SQL and Python are essential. This is a hybrid contract role based in Woodbridge Township, NJ.