Databricks Lakehouse Data Ingestion Architect

Compunnel Inc.

Edison (NJ)

On-site

USD 100,000 - 130,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A leading technology company located in Edison, New Jersey is seeking a Data Engineer to design, develop, and maintain data ingestion pipelines using Databricks and Lakeflow Connect. The ideal candidate should have at least 4 years of experience in data engineering, hands-on experience with Databricks SQL and PySpark, and a strong understanding of data integration patterns. This position requires collaboration with data architects and business stakeholders to ensure data quality and compliance, along with optimizing ingestion performance for scalability and cost efficiency.

Qualifications

  • 4 years of experience in data engineering or ETL development.
  • Hands-on experience with Databricks SQL, PySpark, and Delta Lake.
  • Proficiency with Lakeflow Connect for building data ingestion workflows.

Responsibilities

  • Design, develop, and maintain data ingestion pipelines using Databricks.
  • Integrate data from various sources into Delta Lake.
  • Optimize data ingestion performance ensuring scalability and reliability.

Skills

Databricks SQL
PySpark
Delta Lake
Data Ingestion Workflows
Cloud Platforms (Azure, AWS, GCP)
Data Modeling
Collaboration Skills
CICD Practices

Education

Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering

Tools

Lakeflow Connect
Git

Job description

A leading technology company located in Edison, New Jersey is seeking a Data Engineer to design, develop, and maintain data ingestion pipelines using Databricks and Lakeflow Connect. The ideal candidate should have at least 4 years of experience in data engineering, hands-on experience with Databricks SQL and PySpark, and a strong understanding of data integration patterns. This position requires collaboration with data architects and business stakeholders to ensure data quality and compliance, along with optimizing ingestion performance for scalability and cost efficiency.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Architect -- KATDC5738914
Databricks Architect -- KATDC5738914

Compunnel Inc. • Edison (NJ)

On-site
USD 100,000 - 130,000
Tech Lead: Databricks Data Engineer
Tech Lead: Databricks Data Engineer

ValueMomentum • Edison (NJ)

On-site
USD 120,000 - 150,000
Databricks Data Engineer
Databricks Data Engineer

Compunnel Inc. • Spring (TX)

On-site
USD 110,000 - 140,000
Databricks Lakehouse Data Engineer
Databricks Lakehouse Data Engineer

Airlife • Grand Rapids (MI)

On-site
USD 90,000 - 130,000
Medical benefits
401(k) plan
Paid time off
+1
Databricks Lakehouse Architect for Scalable Data Platform
Databricks Lakehouse Architect for Scalable Data Platform

Bloomberg Industry Group • Arlington (VA)

On-site
USD 180,000 - 220,000
Databricks Lakehouse Architect: AI & Data Governance
Databricks Lakehouse Architect: AI & Data Governance

CCS IT LIMITED • Washington

On-site
USD 160,000 - 210,000
Data Engineer - Databricks on AWS & Spark
Data Engineer - Databricks on AWS & Spark

VySystems • Georgia

On-site
USD 100,000 - 130,000
Senior Databricks Data Architect — Lakehouse & Pipelines
Senior Databricks Data Architect — Lakehouse & Pipelines

Incedo Inc. • San Rafael (CA)

On-site
USD 100,000 - 140,000
Databricks Platform Architect - AWS Lakehouse & DevOps
Databricks Platform Architect - AWS Lakehouse & DevOps

UsefulBI Corporation • Raleigh (NC)

On-site
USD 130,000 - 180,000
Databricks Data Lead — Lakehouse Architect (Hybrid Bay Area)
Databricks Data Lead — Lakehouse Architect (Hybrid Bay Area)

Incedo Inc. • San Rafael (CA)

Hybrid
USD 130,000 - 150,000
Medical insurance
Vision insurance
401(k)