Senior Data Consultant: Fabric Modernization (Remote)

Trility Consulting LLC; Bastrop (LA); Remote; USD 130,000 - 195,000; Full time

Benefits offered by this job

Paid time-off, company holidays, and浮動

Job summary

Trility Consulting LLC is seeking an experienced Senior Data Consultant to modernize an Azure Synapse data platform and migrate prioritized workloads to Microsoft Fabric. You will work with client engineers to refine Fabric architecture, build reusable ingestion pipelines, and establish automated CI/CD workflows for Fabric artifacts.

You’ll contribute to architectural decisions and implement metadata-driven ingestion, data validation, and lineage considerations while collaborating with

Qualifications

• 5+ years of experience with Azure Data Services, including Fabric, Data Factory, Databricks or Synapse.
• Hands-on Fabric production experience in lakehouses, pipelines, medallion architecture and capacity management.
• Strong track record building production ETL/ELT pipelines and reusable ingestion frameworks.
• Experience designing a metadata‑driven ingestion framework with config-based onboarding.
• Experience developing Spark notebooks with PySpark and Spark SQL.
• Advanced SQL skills for data transformation, validation, and performance tuning (T-SQL familiarity).
• Experience migrating data platforms from Azure Synapse to Microsoft Fabric.
• Experience designing Git-based CI/CD workflows for data artifacts (GitHub Actions, Azure DevOps).
• Hands-on use of Claude Code for AI-assisted software development and code review.
• Familiarity with data governance, lineage, metadata management, and catalog concepts (Purview).
• Experience integrating data from REST APIs, relational databases, and semi-structured data.

Responsibilities

• Evaluate and refine the Microsoft Fabric architecture and metadata structures.
• Design a metadata‑driven ingestion framework with config-based onboarding.
• Migrate prioritized sources from Azure Synapse to Microsoft Fabric.
• Develop and orchestrate Fabric data pipelines and Spark notebooks (PySpark/Spark SQL).
• Analyze Synapse pipelines to understand dependencies and translate logic to Fabric.
• Build data validation and reconciliation processes for migration accuracy.
• Determine loading strategies: full-load, incremental, or CDC per source.
• Implement Git-based CI/CD and environment promotion for Fabric artifacts.
• Leverage Claude Code to define specs and review AI-generated code.
• Assess data dictionary, metadata, and lineage needs, evaluating catalog solutions.

Skills

Azure Data Services

Microsoft Fabric

Azure Synapse

Spark notebooks

PySpark

SQL

GitHub Actions

Azure DevOps

Claude Code

Data ingestion frameworks

Tools

Claude Code

GitHub Actions

Azure DevOps

Job description

Trility Consulting LLC is seeking an experienced Senior Data Consultant to modernize an Azure Synapse data platform and migrate prioritized workloads to Microsoft Fabric. You will work with client engineers to refine Fabric architecture, build reusable ingestion pipelines, and establish automated CI/CD workflows for Fabric artifacts.

You’ll contribute to architectural decisions and implement metadata-driven ingestion, data validation, and lineage considerations while collaborating with