Remote Senior Data Consultant — Fabric Lakehouse

Trility Consulting LLC; Clifton (TX); Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Paid time-off

Floating holidays

Company holidays

Job summary

Trility Consulting LLC is seeking an experienced Senior Data Consultant to modernize an Azure Synapse data platform and migrate workloads to Microsoft Fabric. You will partner with client engineers to design scalable data pipelines and ensure data integrity across environments.

This remote W2 position emphasizes AI-assisted development with Claude Code, robust CI/CD practices, and governance considerations for metadata and lineage. The role is nationwide across the United States.

Qualifications

• 5+ years of experience with Azure Data Services and modern data platforms.
• Proven ability to design metadata-driven ingestion and scalable data pipelines.
• Hands-on experience in migration and modernization from Synapse to Fabric.
• Strong SQL skills and experience with PySpark/Spark SQL.
• Experience implementing CI/CD for data artifacts using GitHub Actions or Azure DevOps.

Responsibilities

• Evaluate and refine Microsoft Fabric architecture and ingestion patterns.
• Design a metadata-driven ingestion framework to onboard new tables/sources via configuration.
• Migrate prioritized workloads from Azure Synapse to Microsoft Fabric.
• Develop and orchestrate Fabric pipelines and Spark notebooks (PySpark/Spark SQL).
• Implement data validation and reconciliation to ensure migration accuracy.
• Establish CI/CD workflows for Fabric artifacts and notebooks using GitHub Actions/Azure DevOps.
• Use Claude Code to guide implementation and review AI-generated code for quality and maintainability.
• Assess data dictionary, metadata, and lineage needs, exploring catalog solutions such as Microsoft Purview.

Skills

Azure Data Services

Microsoft Fabric

Azure Synapse

PySpark

Spark SQL

ETL/ELT pipelines

GitHub Actions

Azure DevOps

Claude Code

Data governance

REST APIs

Tools

Claude Code

GitHub Actions

Azure DevOps

Databricks

Microsoft Purview

Spark notebooks

Job description

Trility Consulting LLC is seeking an experienced Senior Data Consultant to modernize an Azure Synapse data platform and migrate workloads to Microsoft Fabric. You will partner with client engineers to design scalable data pipelines and ensure data integrity across environments.

This remote W2 position emphasizes AI-assisted development with Claude Code, robust CI/CD practices, and governance considerations for metadata and lineage. The role is nationwide across the United States.