Hybrid Data Engineer - Azure Databricks Pipelines

Cognita; Greater London; Hybrid; GBP 70,000 - 95,000; Full time

Benefits offered by this job

Private Medical Insurance

GPP Pension

Life Assurance

25 days annual leave

Employee Assistance Programme

Employee Discounts Site

Professional Subscriptions

Job summary

Cognita is seeking a hands-on Data Engineer to build and maintain a modern data platform in Azure Databricks. You will design end-to-end data pipelines, govern data quality, and collaborate with analysts and engineers across the Group Data team.

Working arrangement is four days in the London office and one day remote. A degree in CS/DI, Azure certifications, and ongoing cloud data tech development are advantageous.

Qualifications

• Hands-on data engineer with production-grade pipelines.
• Strong Azure Databricks, PySpark, SQL skills.
• Experience with structured and semi-structured data (JSON/CSV/Parquet).

Responsibilities

• Design and build scalable data pipelines in cloud environments.
• Govern data quality, schemas, and monitoring.
• Collaborate with analysts and platform engineers; CI/CD.

Skills

Azure Databricks

PySpark

Delta Lake

SQL

CI/CD practices

Git

APIs

Education

Degree in Computer Science or Data Engineering or Information Systems

Job description

Cognita is seeking a hands-on Data Engineer to build and maintain a modern data platform in Azure Databricks. You will design end-to-end data pipelines, govern data quality, and collaborate with analysts and engineers across the Group Data team.

Working arrangement is four days in the London office and one day remote. A degree in CS/DI, Azure certifications, and ongoing cloud data tech development are advantageous.