Principal Data Engineering Consultant

Advancing Analytics; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work (UK-based)

Occasional travel

Job summary

Advancing Analytics is seeking a Senior Data Platform Consultant to guide data engineering delivery across multiple client projects. You will connect technical design with practical delivery, consult with clients, shape scope and budgets, and help teams build robust data solutions.

The role emphasizes Azure/cloud concepts, Spark, Python and SQL, data governance, and CI/CD practices. Remote UK-based work with occasional travel to customers and team locations is expected.

Qualifications

• Experience guiding data engineering and consulting with clients.
• Strong Azure and cloud concepts knowledge.
• Proficiency in Spark, Python and complex SQL.

Responsibilities

• Shape end-to-end data platform solutions across engagements.
• Consult with clients, gather requirements, translate to delivery plans.
• Guide agile work, including budget and scope management.
• Build or oversee data pipelines using cloud, Spark, Python, SQL.
• Promote observability, governance, and CI/CD practices.
• Share expertise and mentor team members.

Skills

Azure cloud

Spark

Python

SQL

Data governance

CI/CD

Agile delivery

Client consulting

SDLC

Observability

Orchestration

Education

B.S./B.A. in a related field

Tools

Unity Catalog

Purview

Terraform

Azure DevOps

Delta Lake

Job description

Role overview

Guide data engineering delivery across multiple client projects, connecting technical design with practical delivery needs. The role calls for broad understanding of the data platform lifecycle and the ability to consult with clients, manage project scope and budgets, and help teams deliver robust solutions. The position is remote for people based in the UK, with occasional customer and team visits.

Responsibilities

• Shape end-to-end data platform solutions across concurrent engagements.
• Consult with clients, gather requirements, and translate them into delivery plans.
• Guide agile project work, including budget and scope management.
• Build or oversee data pipelines and platform components using cloud, Spark, Python, and SQL technologies.
• Promote quality, resilience, observability, governance, and sound CI/CD practices.
• Share expertise and support learning across the team and data community.

Requirements

• Strong experience with Azure and cloud computing concepts.
• Proficiency with Apache Spark, Python, and complex, performance-minded SQL.
• Familiarity with orchestration, data lake storage, and Delta Lake patterns.
• Knowledge of data governance tools and infrastructure as code, such as Unity Catalog or Purview, Terraform, or Azure DevOps.
• Client consulting and requirements gathering skills, plus agile delivery experience that includes scope and budget management.
• Understanding of object-oriented development, ETL quality and resilience, observability, CI/CD, and the software development lifecycle.

Nice to have

• Experience with streaming systems, distributed compute, or cloud functions.

Benefits and work setup

• Remote work from within the UK, with occasional travel to customers or team locations.