Data Engineer: Databricks, Azure & Lakehouse

Acuity; Ireland; Hybrid; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Health care

Dental coverage

Vision plans

401K benefits

Commissions/incentive compensation

Job summary

Acuity Inc. is seeking a Data Engineer to join the Digital Center of Excellence (DCoE) in Cork. You will build, test, deploy, and support data pipelines and curated datasets using Databricks and Azure Data Lake.

This hands-on role collaborates with senior engineers, architects, analysts, and business SMEs to integrate enterprise data for reporting, analytics, data science, AI, and downstream applications. Responsibilities include developing ETL/ELT pipelines, creating trusted data products,

Qualifications

• 2+ years in data engineering or software eng with data pipelines.
• Proficiency in SQL and Python/PySpark.
• Experience with Databricks, Azure Data Lake and Delta Lake.

Responsibilities

• Build and maintain ETL/ELT pipelines using Databricks and Azure services.
• Create bronze/silver/gold datasets and ensure data quality and lineage.
• Collaborate with architects and analysts; enable reporting and data science.
• Use Git and Azure DevOps for CI/CD, unit and integration tests.

Skills

SQL

Python

PySpark

Databricks

Azure Data Lake

Delta Lake

Git

Azure DevOps

CI/CD

Agile

Data pipelines

Data quality

Education

Bachelor's degree in CS/IS/Engineering

Tools

Azure

Delta Lake

Job description

Acuity Inc. is seeking a Data Engineer to join the Digital Center of Excellence (DCoE) in Cork. You will build, test, deploy, and support data pipelines and curated datasets using Databricks and Azure Data Lake.

This hands-on role collaborates with senior engineers, architects, analysts, and business SMEs to integrate enterprise data for reporting, analytics, data science, AI, and downstream applications. Responsibilities include developing ETL/ELT pipelines, creating trusted data products,