Data Engineer – Azure Fabric

VeriDex Solutions; Roanoke (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

VeriDex Solutions is seeking a Data Engineer with hands-on Microsoft Fabric experience to design and operate scalable data pipelines, Lakehouse transformations, and analytics-ready datasets in an Azure-native environment.

You will collaborate with data architects, analysts, and product teams to implement ingestion, transformation, and modeling patterns across OneLake, Lakehouse, Dataflows Gen2, and Warehouse, ensuring data quality and governance.

Qualifications

• 6–9 years of data engineering or ETL experience.
• Hands-on with Microsoft Fabric including Lakehouse, Dataflows Gen2, Spark notebooks, Warehouse, OneLake.
• Strong SQL and PySpark skills.
• Familiarity with Azure services: ADLS Gen2, Event Hub, Functions, Key Vault.
• Experience with Git-based development and CI/CD for data pipelines.
• Understanding of medallion architecture and data modeling fundamentals.

Responsibilities

• Build and maintain Fabric Data Pipelines for batch and streaming ingestion.
• Develop Spark notebooks and Dataflows Gen2 for transformation and enrichment.
• Create and optimize Delta Lake tables, partitions, and file layouts.

Skills

Microsoft Fabric

Lakehouse

Dataflows Gen2

Spark notebooks

OneLake

Delta Lake

SQL

PySpark

Azure services

Git

CI/CD

Tools

Git

CI/CD

Job description

Job Description: Data Engineer - Azure Fabric (Mid-Level)

Experience: 10+ years

Employment Type: Full-time

Role Overview

We are looking for a Data Engineer with hands-on experience in Microsoft Fabric to build scalable, high-quality data pipelines, Lakehouse transformations, and analytics-ready datasets. You will work closely with data architects, analysts, and product teams to implement ingestion, transformation, and modeling patterns across OneLake, Lakehouse, Data Pipelines, Dataflows Gen2, and Warehouse. This role is ideal for someone who enjoys building, optimizing, and operationalizing data systems in a modern Azure-native environment.

Key Responsibilities

• Build and maintain Fabric Data Pipelines for batch and streaming ingestion.
• Develop Spark notebooks and Dataflows Gen2 for transformation and enrichment.
• Create and optimize Delta Lake tables, partitions, and file layouts.

2. Lakehouse & OneLake Implementation

• Work within OneLake to manage Lakehouse storage, schemas, and tables.
• Implement data ingestion from Azure services (ADLS, Event Hub, SQL DB) and SaaS sources.
• Ensure data consistency, schema evolution, and versioning using Delta Lake.

3. Data Quality, Observability & Governance

• Implement data validation, profiling, and quality checks.
• Build monitoring dashboards for pipeline health, performance, and SLAs.
• Maintain metadata, lineage, and cataloging using Purview and Fabric governance features.

4. Analytics & Semantic Layer Support

• Prepare curated datasets for analytics and reporting teams.
• Collaborate with BI engineers to build Power BI semantic models.
• Support Warehouse teams with SQL transformations and performance tuning.
• Work with architects to implement platform standards and best practices.
• Participate in code reviews, CI/CD workflows, and Git-based development.
• Troubleshoot issues across pipelines, compute engines, and storage layers.

Required Skills & Experience

Technical Skills

• 6-9 years of experience in data engineering or ETL development.
• Hands-on experience with Microsoft Fabric, including:
• Lakehouse
• Dataflows Gen2
• Spark notebooks
• Warehouse
• OneLake
• Strong SQL and PySpark skills.
• Experience with Delta Lake, Parquet, and distributed data processing.
• Familiarity with Azure services: ADLS Gen2, Event Hub, Functions, Key Vault.
• Experience with Git-based development and CI/CD for data pipelines.
• Understanding of medallion architecture and data modeling fundamentals.
• Ability to debug performance issues across compute, storage, and pipelines.

Soft Skills

• Strong communication and collaboration skills.
• Ability to work in agile, cross-functional engineering teams.
• Problem-solving mindset with attention to detail.

Preferred Qualifications

• Experience with Real-Time Analytics (KQL) or Event Streams.
• Exposure to Azure Databricks or Synapse.
• Experience in regulated industries (insurance, financial services, healthcare).
• Microsoft Fabric or Azure Data Engineer certifications.

Why This Role Matters

• You will help build a modern, AI-ready data platform on Microsoft Fabric.
• You’ll work with cutting-edge Azure technologies and enterprise-scale datasets.
• You’ll contribute directly to the foundation for analytics, AI, and operational intelligence.