Tech Lead: Databricks Data Engineer

ValueMomentum; Edison (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading data solutions firm in New Jersey is seeking a Tech Lead – Databricks Data Engineer to design and develop data pipelines. Candidates must have 10-12 years of experience in data ingestion, processing, and analytics, along with strong skills in SQL, Python, and PySpark. This position involves collaboration with business teams and requires hands-on experience with Azure services such as Databricks and Data Factory, as well as DevOps knowledge. The role offers a challenging environment to leverage data for advanced analytics.

Qualifications

• 10-12 years of experience in data ingestion, processing, and analytical pipelines.
• Hands-on experience with Azure services like Databricks and Data Factory.
• Familiarity with CI/CD deployments.

Responsibilities

• Design and develop ETL pipelines using ADF.
• Collaborate with Azure modules like Data Lakes to build solutions.
• Write efficient SQL, Python, and PySpark code.

Skills

SQL

Python

PySpark

DevOps

Attention to detail

Strong communication skills

Tools

Azure Databricks

Data Factory

SQL DW

ADLS

Synapse

Azure SQL DB

Job description

A leading data solutions firm in New Jersey is seeking a Tech Lead – Databricks Data Engineer to design and develop data pipelines. Candidates must have 10-12 years of experience in data ingestion, processing, and analytics, along with strong skills in SQL, Python, and PySpark. This position involves collaboration with business teams and requires hands-on experience with Azure services such as Databricks and Data Factory, as well as DevOps knowledge. The role offers a challenging environment to leverage data for advanced analytics.