Databricks Data Engineer - Hybrid Cambridge ETL & Analytics

Whitehall Resources Limited; Cambridge; In loco; GBP 55.000 - 85.000; Tempo pieno

Descrizione del lavoro

Whitehall Resources Limited in Cambridge is seeking a Data Engineer for an initial 6 month contract, on-site two days per week. The role focuses on designing and delivering high-quality data solutions in Databricks, building and optimising ETL pipelines from systems such as ServiceNow, JIRA and Dynatrace to support reporting and analytics.

You will design and maintain efficient data pipelines, implement data modelling and schema design, and perform data quality validation to ensure trustworthy

Competenze

• Minimum 4 years of experience building ETL pipelines in Databricks.
• Strong SQL and Python for data transformation.
• Experience with data modelling and schema design.
• Knowledge of data governance and data lineage practices.
• Experience with Git-based version control and CI/CD.

Mansioni

• Design, build, and maintain scalable ETL pipelines in Databricks.
• Integrate data from ServiceNow, JIRA, and Dynatrace.
• Implement data validation and quality checks for Power BI reporting.
• Collaborate with Staff Data Engineer and Visualisation Developer.
• Manage code in Git and support CI/CD for Databricks deployments.
• Contribute to data lineage documentation and governance standards.

Conoscenze

Databricks

SQL

Python

Data modelling

Schema design

Data quality

Git

CI/CD

Data governance

Data lineage

Agile

Strumenti

Databricks

Git

ServiceNow

JIRA

Dynatrace

Azure DevOps (ADO)

Descrizione del lavoro

Whitehall Resources Limited in Cambridge is seeking a Data Engineer for an initial 6 month contract, on-site two days per week. The role focuses on designing and delivering high-quality data solutions in Databricks, building and optimising ETL pipelines from systems such as ServiceNow, JIRA and Dynatrace to support reporting and analytics.

You will design and maintain efficient data pipelines, implement data modelling and schema design, and perform data quality validation to ensure trustworthy