Senior Databricks Data Engineer: Lakehouse & Spark Expert

DATAECONOMY Inc

New Jersey

On-site

USD 130,000 - 180,000

Full time

11 hours ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DATAECONOMY Inc. in New Jersey seeks a Senior/Lead Data Engineer to design and build scalable data pipelines on Databricks, delivering robust Bronze-Silver-Gold architectures and reliable data workflows.

You will collaborate across teams to implement Delta Live Tables, Unity Catalog, and Lakehouse patterns, applying best practices in streaming, data quality, and cloud environments (AWS/Azure/GCP) to empower analytics at scale.

Qualifications

Strong Python (PySpark) and SQL programming
Databricks stack: Spark, Delta Lake, Workflows, Unity Catalog
ETL/ELT pipelines with Medallion Architecture (Bronze/Silver/Gold)
Delta Live Tables, Auto-Loader, Structured Streaming
Data modeling: star/snowflake, normalization/denormalization
CI/CD, Git, job orchestration
Cloud experience: AWS, Azure, or GCP
7–10+ years in data engineering
Knowledge of medallion architecture, DLT and Unity Catalog

Responsibilities

Build scalable, production-grade ETL/ELT pipelines using Databricks.
Ingest structured, semi-structured, and streaming data into Bronze/Silver/Gold layers.
Develop optimized transformations, data quality rules, and reusable components.
Implement best practices for job orchestration, monitoring, and automation.
Hands-on experience with Spark, Delta Lake, Workflows, Unity Catalog.
Strong SQL and performance tuning for large-scale data projects.
Work in cloud environments (AWS/Azure/GCP) and modern lakehouse concepts.