Senior Data Engineer - Lakehouse Data Quality & Databricks

fulcrumdigital

Dublin

On-site

EUR 90,000 - 120,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Fulcrum Digital is seeking a highly skilled Data Quality Engineer with strong Data Engineering expertise to ensure accuracy, reliability, and scalability of enterprise data platforms. The ideal candidate will work with Databricks, PySpark, Hadoop, Hive, and cloud technologies to validate data across large-scale pipelines and Lakehouse architectures.

You will lead end-to-end data quality validation, implement quality frameworks, and optimize data processing jobs while collaborating with Data

Qualifications

6+ years in Data Engineering, Data Quality Engineering, or Data Testing.
Hands-on Databricks and PySpark experience.
Strong knowledge of Hadoop ecosystem (Hive, HDFS, Spark) and Apache tech.
Experience with data warehouses, lakes, and lakehouse architectures.
Understanding of Star Schema, Snowflake Schema, and dimensional modeling.
Experience with cloud platforms (Azure, AWS, or GCP).

Responsibilities

Data Quality & Validation: end-to-end validation of data pipelines across ingestion, transformation, and consumption layers.
Execute source-to-target reconciliation and data quality checks.
Identify, investigate, and resolve data anomalies and inconsistencies.
Define and implement data quality frameworks, metrics, and controls.
Develop and validate data pipelines with PySpark and Databricks.
Monitor and optimize data processing in Lakehouse environments.