Senior Data Consultant: Azure Fabric & Lakehouse Migration

Trility Consulting; Virginia Beach (VA); Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Paid time off

Company holidays

Floating holidays

Job summary

Trility Consulting is seeking an experienced Senior Data Consultant to modernize an Azure Synapse-based data platform and migrate workloads to Microsoft Fabric. This remote W2 role requires collaborating with client engineers to build scalable, metadata-driven ingestion frameworks and CI/CD pipelines, leveraging Claude Code for AI-assisted development.

You will design ingestion patterns, migrate sources, develop PySpark-based pipelines, and validate data migrations while ensuring governance and

Qualifications

• 5+ years of experience with Azure Data Services including Fabric, ADF, Databricks or Synapse
• Hands-on Fabric experience in production environments with lakehouses and pipelines
• Strong SQL skills for data transformation and performance tuning
• Experience building production ETL/ELT pipelines and reusable ingestion frameworks
• Experience Git-based CI/CD workflows for data platform artifacts
• Familiarity with Claude Code in AI-assisted development workflows
• Experience validating migrations and ensuring data quality across sources

Responsibilities

• Evaluate and refine the Microsoft Fabric architecture, including metadata structures and reusable ingestion patterns
• Design a metadata-driven ingestion framework for onboarding new tables via configuration
• Migrate data sources from Azure Synapse to Microsoft Fabric
• Develop Fabric data pipelines and Spark notebooks using PySpark and Spark SQL
• Analyze and translate existing Synapse pipelines into Fabric solutions
• Build data validation and reconciliation processes for migration accuracy
• Implement CI/CD and environment promotion for Fabric artifacts using GitHub Actions or Azure DevOps
• Review AI-generated code using Claude Code for quality and maintainability
• Assess data dictionary, metadata, and lineage requirements, including catalog solutions like Microsoft Purview
• Apply data engineering best practices for performance, testing, security, and operations
• Experience migrating data platforms from Synapse to Fabric and integrating sources like REST APIs and DB2/Oracle

Skills

Azure Data Services

Microsoft Fabric

Azure Data Factory

Databricks

Synapse

PySpark

Spark SQL

SQL

Git-based CI/CD

Claude Code

Data governance

Metadata management

REST APIs

Oracle/DB2

Tools

GitHub Actions

Azure DevOps

Job description

Trility Consulting is seeking an experienced Senior Data Consultant to modernize an Azure Synapse-based data platform and migrate workloads to Microsoft Fabric. This remote W2 role requires collaborating with client engineers to build scalable, metadata-driven ingestion frameworks and CI/CD pipelines, leveraging Claude Code for AI-assisted development.

You will design ingestion patterns, migrate sources, develop PySpark-based pipelines, and validate data migrations while ensuring governance and