Senior Databricks Data Engineer - Lakehouse & ETL Expert

DATAECONOMY Inc; Northern (KY); Hybrid; USD 140,000 - 180,000; Full time

Job summary

DATAECONOMY Inc. in Rutherford, NJ is seeking a Senior Data Engineer to build scalable ETL/ELT pipelines using Databricks and PySpark. You will ingest data into Bronze/Silver/Gold layers and implement data quality rules while optimizing transformations.

Join a data-driven team implementing lakehouse architectures across AWS/Azure/GCP, with focus on performance and governance in a fast-growing company.

Qualifications

• 7–10+ years in data engineering or equivalent.
• Strong Python (PySpark) and SQL proficiency.
• Experience with Databricks, Spark, and Delta Lake in cloud environments.

Responsibilities

• Build scalable, production-grade ETL/ELT pipelines using Databricks (PySpark, Spark SQL, Delta Live Tables, Workflows).
• Ingest structured, semi-structured, and streaming data into Bronze, Silver, and Gold layers.
• Develop optimized transformations, data quality rules, and reusable framework components.
• Implement best practices for job orchestration, monitoring, alerting, and automation.
• Demonstrate strong SQL programming and performance tuning skills.
• Collaborate on cloud deployments across AWS/Azure/GCP and lakehouse architectures.

Skills

Python (PySpark)

SQL

Databricks

Spark

Delta Lake

Workflows

Unity Catalog

DLT

CI/CD

Git

Cloud (AWS/Azure/GCP)

Medallion Architecture

Lakehouse

Data Governance concepts

Tools

Airflow

dbt

Orchestration tools

Job description

DATAECONOMY Inc. in Rutherford, NJ is seeking a Senior Data Engineer to build scalable ETL/ELT pipelines using Databricks and PySpark. You will ingest data into Bronze/Silver/Gold layers and implement data quality rules while optimizing transformations.

Join a data-driven team implementing lakehouse architectures across AWS/Azure/GCP, with focus on performance and governance in a fast-growing company.