Data Engineer

Primus Connect; United Kingdom; Remote; GBP 65,000 - 90,000; Full time

Job summary

Primus Connect is partnering with a growing Data & AI consultancy delivering modern data platforms and Databricks solutions for enterprise clients. They are expanding their engineering capability and are looking for a Mid-Level Data Engineer with strong Databricks and Spark experience to join an active delivery team.

This hands-on role will own data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and the wider delivery team to deliver

Qualifications

• Hands-on data pipeline development using Databricks, PySpark and Spark.
• Strong knowledge of Delta Lake medallion architecture.
• Experience with cloud platforms (Azure, AWS or GCP).

Responsibilities

• Design, build and maintain ETL/ELT data pipelines.
• Write clean Python code for data engineering tasks.
• Implement data quality checks and monitoring.
• Collaborate with senior engineers and delivery team.
• Participate in Agile ceremonies.

Skills

Databricks

PySpark

Spark SQL

Python

Delta Lake

CI/CD pipelines

SQL

Tools

Databricks

Delta Lake

Azure

AWS

GCP

Job description

Contract Opportunity | Data & AI Consultancy | Databricks

yLocation: Fully Remote – U

KStart: ASA

g
The Opportuni

tyPrimus Connect is working with a growng Data & AI Consultancy that is delivering modern data platforms and Databricks solutions for a range of enterprise client

s.They are expanding their engineering capability and are looking for a Mid-Level Data Engineer with strong commercial Databricks and Spark experience to join an active delivery tea

m.This is a hands-on engineering position where you will take ownership of data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and wider delivery team

s.
Key Responsibilit

• iesDesign, build and maintain ETL/ELT data pipelines using Databricks, PySpark and Spark
• SQLDevelop and optimise Delta Lake tables using Bronze, Silver and Gold medallion architect
• ureIngest data from a variety of source systems into Databri
• cksWrite clean, maintainable and well-tested Python/data engineering c
• odeImplement data quality checks, validation and monitor
• ingParticipate in code reviews and collaborative developm
• entContribute to CI/CD pipelines for data engineering worklo
• adsWork with senior engineers to deliver scalable data platform soluti
• onsCollaborate with technical, analytics and business stakehold
• ersParticipate in Agile ceremonies and delivery activit
• enceCommercial experience building data pipelines using Databr
• icksStrong PySpark and Spark SQL sk
• illsSolid Python experience within data enginee
• ringPractical experience with Delta
• LakeUnderstanding of medallion architecture and modern data platform princi
• plesExperience working with Azure, AWS or
• GCPGood understanding of Git and collaborative development pract
• icesExperience working within Agile delivery environm
• entsStrong communication skills and the ability to work effectively in a remote