Lead Data Engineer - Fabric & OneLake Architect

Straive; Newark (NJ); On-site; USD 140,000 - 200,000; Full time

Job summary

Straive is seeking a Lead Data Engineer to architect and implement modern data solutions within the Microsoft Fabric ecosystem in Newark, NJ. You will streamline data workflows, enable enterprise data integration, and drive analytics initiatives across the organization.

Responsibilities cover OneLake storage, unified data pipelines, Bronze/Silver/Gold lakehouse architectures, and advanced optimizations in PySpark, SQL, and Delta Lake.

Qualifications

• 10-15 years total experience in data engineering or similar roles.
• 3-5 years Azure Data Engineering focusing on Microsoft Fabric, Synapse Analytics, and OneLake.
• Advanced Python (PySpark) and SQL proficiency.
• Hands-on with Delta Lake formats, Medallion Architecture, and Spark-based processing.
• Experience with Power BI Direct Lake connectivity, Git-based CI/CD, and Fabric Capacity Management.
• Proficient in building and monitoring pipelines in Data Factory and managing CI/CD via Azure DevOps.
• Understanding of Star/Snowflake data modeling and semantic modeling.
• Preferred certifications: DP-600, DP-203, DP-700.

Responsibilities

• Unified Storage: implement OneLake structures as single source of truth for varied data assets.
• Data Engineering: develop scalable ETL/ELT via Synapse Data Engineering and Data Factory.
• Performance Tuning: optimize Fabric capacity and compute for cost and speed.
• Pipelines & Ingestion: build metadata-driven pipelines using Fabric Pipelines; handle JSON/ZIP/XLSX/CSV; implement incremental refreshes and SCD logic.
• Architecture & Performance: design Bronze/Silver/Gold lakehouses and optimize with PySpark, SQL, and Delta Lake features.
• Automation & Scripting: write Python and use Fabric REST APIs to automate notebook workflows and workspace management.
• Governance & Data Quality: automate validation, lineage, RLS/CLS controls, and CICD-driven environments.
• DevOps, Capacity & Analytics: manage DevOps/ALM, monitor compute, and support Direct Lake BI and real‑time ingestion.
• Collaboration: work with Data Scientists and BI teams for GenAI-ready datasets.

Skills

Python (PySpark)

SQL

Delta Lake

Azure Data Engineering

Microsoft Fabric

Synapse Analytics

OneLake

Power BI Direct Lake

Git CI/CD

Fabric Capacity Management

Education

DP-600 Fabric Analytics Engineer

DP-203 Azure Data Engineer

DP-700 Fabric Data Engineer Associate

Tools

Data Factory

Azure DevOps

Fabric REST APIs

Fabric Utils

Job description

Straive is seeking a Lead Data Engineer to architect and implement modern data solutions within the Microsoft Fabric ecosystem in Newark, NJ. You will streamline data workflows, enable enterprise data integration, and drive analytics initiatives across the organization.

Responsibilities cover OneLake storage, unified data pipelines, Bronze/Silver/Gold lakehouse architectures, and advanced optimizations in PySpark, SQL, and Delta Lake.