Senior Data Architect: Microsoft Fabric & Azure Synapse

Trility Consulting LLC; Athens (GA); Remote; USD 120.000 - 170.000; Vollzeit

Benefits dieser Stelle

Work remotely in the United States

Paid time-off & holidays

Comprehensive benefits

401(k) plan

Learning opportunities

Zusammenfassung

Trility Consulting LLC is seeking an experienced Senior Data Consultant to support a client engagement focused on modernizing an existing Azure Synapse data platform and migrating prioritized workloads to Microsoft Fabric. You’ll partner with client engineers to pressure-test Fabric architecture, build reusable ingestion frameworks, and migrate data workloads into a modern lakehouse environment.

You’ll develop scalable data pipelines, implement validation processes, and establish automated CI/CD

Qualifikationen

• 5+ years with Azure Data Services (Fabric, ADF, Databricks, Synapse).
• Production experience with Fabric lakehouses, pipelines, notebooks, medallion architecture, capacity mgmt.
• Strong ETL/ELT pipeline experience and reusable ingestion frameworks.
• Metadata-driven ingestion design with configuration-based onboarding.
• Spark notebooks and data transformations using PySpark/Spark SQL.
• Strong SQL for data transformation, validation, performance tuning.

Aufgaben

• Evaluate and refine the Microsoft Fabric architecture, including metadata structures, table‑level event triggering, and reusable ingestion patterns.
• Design and implement a metadata‑driven ingestion framework for configuration-based onboarding of new tables/sources.
• Migrate data sources/workloads from Azure Synapse to Microsoft Fabric.
• Develop and orchestrate Fabric data pipelines and Spark notebooks using PySpark and Spark SQL.
• Analyze Synapse pipelines to understand dependencies and translate logic into Fabric solutions.
• Build data validation and reconciliation processes, including duplicate detection and key alignment.
• Evaluate loading patterns (full/CDC) and advise on appropriate strategies.
• Implement Git-based CI/CD and automated environment promotion for Fabric artifacts.
• Leverage Claude Code to define specs, accelerate development, and review AI-generated code.
• Evaluate data dictionary, metadata, and lineage requirements and potential catalog solutions.
• Collaborate with client engineers to establish sustainable engineering standards.
• Apply best practices for performance, testing, monitoring, documentation, security, and ops.

Kenntnisse

Azure Data Services

Microsoft Fabric

ETL/ELT pipelines

Spark PySpark

SQL

CI/CD

Claude Code

Data governance

REST APIs

Collaboration

Cloud data platforms

Tools

Azure Data Factory

Databricks

Synapse

GitHub Actions

Azure DevOps

Claude Code

Jobbeschreibung

Trility Consulting LLC is seeking an experienced Senior Data Consultant to support a client engagement focused on modernizing an existing Azure Synapse data platform and migrating prioritized workloads to Microsoft Fabric. You’ll partner with client engineers to pressure-test Fabric architecture, build reusable ingestion frameworks, and migrate data workloads into a modern lakehouse environment.

You’ll develop scalable data pipelines, implement validation processes, and establish automated CI/CD