Senior Data Engineer — Databricks, Data Lakehouse Architect

Elliott Group; Jeannette (Westmoreland County); On-site; USD 120,000 - 160,000; Full time

Job summary

Elliott Group in Jeannette, PA seeks a Senior Data Engineer to build and maintain robust data pipelines moving data into the Enterprise Data Lakehouse. You will design complex workflows, troubleshoot transformations and collaborate with analysts and data scientists to enable new data sources.

The role requires extensive ETL experience, Databricks proficiency, and strong cloud/database knowledge in a fast-paced environment.

Qualifications

• Bachelors degree in CS/IS/DS required.
• Minimum 10 years hands-on ETL engineering experience.
• Strong experience with Databricks and data pipelines.

Responsibilities

• Design and build robust ETL pipelines for the Enterprise Data Lakehouse.
• Architect and troubleshoot complex workflows and data transformations.
• Monitor data flow across databases, cloud and on-prem environments.
• Profile data, detect anomalies and improve data quality.
• Collaborate with data analysts, visualization engineers and data scientists.

Skills

ETL engineering

Databricks

Cloud computing (AWS)

Data modeling

Informatica

Fivetran

Azure Data Factory

SQL/Oracle/SQL Server

Python basics

APIs & ODBC data sources

Cross-functional collaboration

Troubleshooting complex data pipelines

Education

Bachelor's degree in Computer Science / Information Systems / Data Science

Tools

Databricks

Informatica

Fivetran

Azure Data Factory

Oracle

SQL Server

ODBC

Job description

Elliott Group in Jeannette, PA seeks a Senior Data Engineer to build and maintain robust data pipelines moving data into the Enterprise Data Lakehouse. You will design complex workflows, troubleshoot transformations and collaborate with analysts and data scientists to enable new data sources.

The role requires extensive ETL experience, Databricks proficiency, and strong cloud/database knowledge in a fast-paced environment.