Data Engineer: Databricks + Azure Lakehouse

Acuity Inc.; Ireland; Remote; EUR 70,000 - 100,000; Full time

Benefits offered by this job

Health care

Dental coverage

Vision plans

401K benefits

Commission/incentive compensation

Job summary

Acuity Inc. in Cork,is seeking a Data Engineer to join the Digital Center of Excellence (DCoE) and build, test, deploy, and support data pipelines and curated datasets using Databricks and Azure Data Lake.

You will work hands-on with senior engineers, architects, analysts, and business experts to integrate enterprise data and make trusted information available for reporting, analytics, data science, AI, and downstream applications.

Qualifications

• 2+ years hands‑on data engineering or software engineering experience with data pipelines and data transformations.
• Practical experience with SQL and Python or PySpark.
• Working knowledge of Databricks, Azure Data Lake, Delta Lake, or comparable cloud data technologies.
• Understanding of ETL/ELT, data integration, data‑quality checks, and lakehouse or data‑warehouse concepts.
• Familiarity with Git, CI/CD, Agile delivery, and Azure DevOps or a comparable delivery tool.
• Ability to diagnose data and pipeline issues and work effectively with technical and business stakeholders.
• Bachelor’s degree in computer science, information systems, engineering, or a related field, or equivalent practical experience.

Responsibilities

• Build and maintain ETL/ELT pipelines using Databricks, Python/PySpark, SQL, Delta Lake and Azure services.
• Ingest data from databases, APIs, files, SaaS applications, and event sources using established batch or streaming patterns.
• Develop bronze, silver, and gold datasets using reusable engineering approaches.
• Implement incremental processing, schema handling, error handling, restorability, reconciliation, and audit controls.

Skills

Analytical thinking

Collaborative

Communication

Problem solving

Stakeholder engagement

Education

Bachelor’s degree in computer science, information systems, engineering, or related field

Tools

Databricks

Python

PySpark

SQL

Delta Lake

Azure Data Lake

Git

Azure DevOps

CI/CD

Power BI

Job description

Acuity Inc. in Cork,is seeking a Data Engineer to join the Digital Center of Excellence (DCoE) and build, test, deploy, and support data pipelines and curated datasets using Databricks and Azure Data Lake.

You will work hands-on with senior engineers, architects, analysts, and business experts to integrate enterprise data and make trusted information available for reporting, analytics, data science, AI, and downstream applications.