Senior Databricks Data Engineer - Scale Pipelines

Intetics; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Intetics Inc. is a global technology company delivering custom software and data platform solutions.

We are seeking a data engineer to own Databricks production support, optimize pipelines, migrate legacy ETL to Databricks, and ensure multi‑tenant data isolation across Azure and AWS environments. You will work with data science, product, and infra teams to deliver end‑to‑end data capabilities with strong SLAs and security practices.

Qualifications

• 4+ years of data engineering experience.
• 2+ years with Databricks or Spark in Azure/AWS.
• Proficiency in PySpark, SQL and Python for production pipelines.
• Hands-on Delta Lake, schema evolution and ACID transactions.
• Experience tuning Databricks performance and cost.
• Strong PostgreSQL knowledge for pipelines.
• Experience with legacy ETL tooling in production.
• Experience with multi-tenant data isolation and security.

Responsibilities

• Own Databricks production support across the data platform.
• Monitor, alert, and respond to incidents per SLA.
• Optimize pipelines to reduce compute costs and improve throughput.
• Migrate legacy ETL/ELT to Databricks with automation tooling.
• Onboard and harden tenant data pipelines for new customers.
• Design high‑performance Databricks pipelines for ERP/CRM data.
• Own Delta Lake architecture and data quality enforcement.
• Enforce security and access controls across environments.
• Implement data quality monitoring and observability.
• Ensure multi‑tenant isolation and compliance.
• Collaborate with Enterprise Architecture to integrate with AI/analytics spine.
• Provide on‑call support across time zones and maintain docs.

Skills

Databricks

PySpark

SQL

Python

Delta Lake

Data governance

Cross‑functional collaboration

SLA adherence

Tools

Azure

AWS

PostgreSQL

SSIS

Informatica

Job description

Intetics Inc. is a global technology company delivering custom software and data platform solutions.

We are seeking a data engineer to own Databricks production support, optimize pipelines, migrate legacy ETL to Databricks, and ensure multi‑tenant data isolation across Azure and AWS environments. You will work with data science, product, and infra teams to deliver end‑to‑end data capabilities with strong SLAs and security practices.