Senior Data Engineer — Contract: Data Pipelines on Fabric

Inchcape Shipping Services; United States; Remote; USD 152,000 - 220,000; Full time

Job summary

Inchcape Shipping Services seeks a Senior Data Engineer to design, build, and maintain data ingestion and transformation pipelines for our central data platforms. You will curate bronze/silver/gold datasets from diverse sources, ensuring quality, performance, and reusable assets for modelling and BI.

You will ingest data from ERP/CRM/operational sources using Delta Lake on Microsoft Fabric, while optimizing workloads and enforcing data governance.

Qualifications

• 8+ years in data engineering or data integration roles.
• Experience with ETL/ELT patterns, CDC, incremental loading and data warehousing principles using Microsoft Fabric.
• Proficient with DeltaLake, Lakehouse/Medallion architecture, and cloud data platforms (Azure and AWS).
• Experience building pipelines with MS Fabric Dataflows Gen2, Spark/SQL notebooks or equivalents.
• Knowledge of data quality frameworks and monitoring/observability tools.
• Ability to collaborate across teams and communicate technical concepts to non-engineers.

Responsibilities

• Develop and maintain ETL/ELT pipelines to ingest data from ERP, CRM, operational, financial, and third-party sources into the Microsoft Fabric Platform (OneLake) using Delta Lake/Parquet.
• Implement data quality standards and controls, incremental loading, CDC and error handling to ensure reliability and correctness.
• Create bronze tables, curated Silver and gold tables by transforming, cleansing and conforming raw data, document lineage and transformations.
• Optimise performance through partitioning, clustering and tuning of MS Fabric, SQL and Spark workloads; monitor pipeline health and costs.
• Collaborate with Data Architects, Modellers and Data BAs to design schemas, naming conventions and integration patterns for business self-service data.
• Build reusable components, templates and automation scripts using Fabric Dataflows Gen2, Spark notebooks or equivalent tools.
• Maintain metadata and sensitivity labels via Purview, ensure proper access controls and compliance.
• Research and evaluate new features in Microsoft Fabric and make adoption recommendations for an AI-driven data strategy.
• Introduce cost-efficient data integration techniques to reduce total operational cost.

Skills

SQL

Python

Scala

Education

Bachelor's degree in computer science, engineering or related discipline

Azure Data Engineering certification

AWS cloud data platform certifications

Tools

MS Fabric Dataflows Gen2

Spark notebooks

DeltaLake

Azure

AWS

Job description

Inchcape Shipping Services seeks a Senior Data Engineer to design, build, and maintain data ingestion and transformation pipelines for our central data platforms. You will curate bronze/silver/gold datasets from diverse sources, ensuring quality, performance, and reusable assets for modelling and BI.

You will ingest data from ERP/CRM/operational sources using Delta Lake on Microsoft Fabric, while optimizing workloads and enforcing data governance.