Data Engineer

Olive Jar Digital; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Olive Jar Digital is looking for an experienced Data Engineer for a 6-month fixed-term contract. The role focuses on delivering a Master Data Management initiative and involves designing scalable data pipelines, managing data quality, and working with data governance in Azure environments. Candidates should have strong skills in data engineering, SQL, and Python, and experience with Microsoft Purview. This position allows for remote work across the United States.

Qualifications

• Strong experience in data engineering within cloud environments, ideally Azure.
• Proficiency in data pipeline development using Azure Data Factory, Databricks, or similar.
• Experience implementing and managing Microsoft Purview or equivalent data cataloguing tools.

Responsibilities

• Design, build, and optimise data pipelines for ingestion, transformation, and delivery.
• Develop and maintain metadata capture processes to support data cataloguing.
• Collaborate with Data Governance and Data Quality teams to ensure compliance.

Skills

Data engineering experience

Azure Data Factory

SQL

Python

Data quality frameworks

Tools

Microsoft Purview

Databricks

Synapse

Job description

6 Month Fixed-Term Contract
UK-wide
Remote

About the role

We are seeking an experienced Data Engineer to support the delivery of a Master Data Management (MDM) initiative and associated data governance and metadata management activities. The role focuses on implementing scalable data pipelines, metadata management, and data quality solutions within Azure and Microsoft Purview environments. You will work closely with data governance and architecture teams to design and build robust data engineering capabilities that underpin organisational data management and reporting.

Responsibilities

• Design, build, and optimise data pipelines for ingestion, transformation, and delivery across structured and unstructured sources.
• Develop and maintain metadata capture processes to support data cataloguing and lineage. Implement and document data quality rules, retention policies, and data optimisation processes.
• Support large-scale deployment and configuration of Microsoft Purview.
• Establish automated scanning and metadata ingestion for source systems.
• Configure data lineage, glossary, and metadata structures to align with governance and compliance standards (UK GDPR, ISO 27001).
• Assess current data platform performance; identify and resolve bottlenecks across ingestion, processing, query, and reporting layers.
• Conduct benchmarking (e.g., latency, throughput, cost efficiency) and implement storage/DQ optimisations.
• Develop and apply storage tiering and retention strategies.
• Collaborate with Data Governance and Data Quality teams to ensure consistency, accuracy, and compliance.
• Contribute to documentation and knowledge transfer for data engineering and digital services teams.
• Participate in agile delivery ceremonies, workshops, and technical review sessions.

About You

• Strong experience in data engineering within cloud environments, ideally Azure.
• Proficiency in data pipeline development (e.g., Azure Data Factory, Databricks, Synapse, or similar).
• Experience implementing and managing Microsoft Purview or equivalent data cataloguing tools.
• Solid understanding of metadata management, data lineage, and data quality frameworks. Knowledge of data governance principles, including GDPR compliance and data retention policy design.
• Strong experience in SQL, Python, or PySpark for data manipulation and integration.
• Proven ability to optimise performance and manage large data volumes efficiently.
• Experience working in agile delivery environments with cross-functional data teams.