Data Engineering Consultant

Advancing Analytics; United States; Remote; USD 93,000 - 132,000; Full time

Benefits offered by this job

Remote work from the UK

Occasional travel to customers

Job summary

Advancing Analytics is seeking a data platform engineer to build scalable data pipelines and analytical solutions. The role blends hands-on engineering with consulting, delivering end-to-end data products for client projects. This is a remote position for UK-based candidates, with occasional travel to customers or team locations.

You will work across the data lifecycle—requirements, design, implementation, and governance—using cloud services, Spark, Python, and SQL to create reliable platforms.

Qualifications

• Experience with Azure cloud and data engineering on cloud platforms.
• Proficient in Python and SQL with complex queries.
• Familiar with Spark/Databricks and data lake architectures.
• Knowledge of governance tooling and IaC practices.
• Experience with agile delivery and client consulting.

Responsibilities

• Gather client requirements and contribute to data engineering designs.
• Develop data pipelines and platform components using cloud services, Spark, Python, and SQL.
• Orchestrate data workflows and work with lake storage and Delta Lake formats.
• Apply practices that improve data quality, resilience, observability, and governance.
• Participate in agile project delivery and follow deployment processes.
• Share knowledge and contribute to a collaborative technical community.

Skills

Azure cloud

Spark data processing

Python

SQL

Data governance

CI/CD practices

Agile delivery

Consulting

Streaming data

Tools

Databricks

Microsoft Fabric

Azure Data Lake

Delta Lake

Unity Catalog

Purview

Terraform

Azure DevOps

Job description

Role overview

Build data platforms and analytical solutions for client projects, combining hands-on engineering with consulting and agile delivery. The work spans the data pipeline lifecycle, from understanding requirements through building reliable, governed solutions. This is a remote role for candidates based in the UK, with occasional visits to customers or team locations.

Responsibilities

• Gather client requirements and contribute to practical data engineering designs.
• Develop data pipelines and platform components using cloud services, Spark, Python, and SQL.
• Orchestrate data workflows and work with lake storage and table formats.
• Apply practices that improve data quality, resilience, observability, and governance.
• Participate in agile project delivery and follow sound development and deployment processes.
• Share knowledge with colleagues and contribute to a collaborative technical community.

Requirements

• Working knowledge of Microsoft Azure and cloud computing concepts.
• Experience with Apache Spark, such as Databricks, Microsoft Fabric, or a similar engine.
• Good Python and SQL skills, including writing complex, efficient queries.
• Familiarity with orchestration tools, Azure Data Lake, and Delta Lake.
• Exposure to data governance tooling and infrastructure as code, such as Unity Catalog or Purview, Terraform, or Azure DevOps.
• Client consulting, requirements gathering, agile delivery, object-oriented development, and CI/CD or software lifecycle practices.

Nice to have

• Experience with streaming data, distributed systems, or Azure Functions.

Benefits and work setup

• Remote work from within the UK, with occasional travel to customers or team locations.