Senior Data Consultant - Azure Fabric Lakehouse (Remote)

Trility Consulting; Lorida (FL); Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Paid time off, holidays, and floating

Job summary

Trility Consulting is seeking an experienced Senior Data Consultant for a remote W2 role focused on modernizing an Azure Synapse data platform and migrating workloads to Microsoft Fabric. You will collaborate with client engineers to design metadata-driven ingestion, build scalable data pipelines, and implement CI/CD for Fabric artifacts.

You will work hands-on with Claude Code to guide AI-assisted development, validate migrations, and ensure data quality while enabling repeatable patterns for

Qualifications

• 5+ years with Azure Data Services including Fabric, ADF, Databricks or Synapse.
• Hands-on Fabric production experience with lakehouses, pipelines, notebooks, medallion architecture and capacity management.
• Strong track record building production ETL/ELT pipelines and reusable data ingestion frameworks.
• Experience designing a metadata‑driven ingestion framework with configuration-based onboarding.
• Developing Spark notebooks and data transformation workflows using PySpark and Spark SQL.
• Strong SQL skills for data transformation, validation, and performance tuning; read/write T-SQL.
• Experience with Azure Synapse analyzing pipelines and complex dependencies.
• Designing Git-based CI/CD workflows for data platform artifacts using GitHub Actions or Azure DevOps.
• Hands-on Claude Code for AI-assisted development, directing code generation and reviewing generated code.
• Validate data migrations and ensure quality across source and target systems.
• Integrate data from REST APIs, relational databases, and semi-structured data sources.
• Familiarity with data governance, lineage, metadata management and data catalog concepts.
• Experience migrating data platforms from Azure Synapse to Microsoft Fabric.
• Experience with Oracle and DB2 data sources.
• Incremental ingestion, CDC, and source-specific loading strategies.
• Develop data reconciliation and validation frameworks for large migrations.
• Evaluate Microsoft Purview or other data catalog/ lineage solutions.

Responsibilities

• Evaluate and refine the Fabric architecture, including metadata, table-level events, and reusable ingestion patterns.
• Design and implement a metadata-driven ingestion framework enabling onboarding via configuration.
• Migrate prioritized data sources/workloads from Azure Synapse into Fabric.
• Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL.
• Analyze existing Synapse pipelines to understand dependencies and translate logic into Fabric.
• Build data validation and reconciliation processes to verify migration accuracy.
• Analyze loading requirements and advise on full-load, incremental, or CDC patterns.
• Implement Git-based CI/CD and automated environment promotion for Fabric artifacts.
• Leverage Claude Code to define specs, accelerate development, and review AI-generated code.
• Evaluate data dictionary, metadata, and lineage needs, including catalog solutions like Purview.
• Apply data engineering best practices for performance, testing, monitoring, security, and ops.

Tools

Microsoft Fabric

Azure Synapse

Azure Data Factory

Databricks

Spark notebooks

PySpark

Spark SQL

SQL

GitHub Actions

Azure DevOps

Claude Code

Microsoft Purview

REST APIs

Job description

Trility Consulting is seeking an experienced Senior Data Consultant for a remote W2 role focused on modernizing an Azure Synapse data platform and migrating workloads to Microsoft Fabric. You will collaborate with client engineers to design metadata-driven ingestion, build scalable data pipelines, and implement CI/CD for Fabric artifacts.

You will work hands-on with Claude Code to guide AI-assisted development, validate migrations, and ensure data quality while enabling repeatable patterns for