Senior Data Engineer: Azure Lakehouse & Fabric Migration

NFI; Camden (NJ); On-site; USD 104,626 - 139,501; Full time

Benefits offered by this job

Medical

Dental

Vision

401(k) Plan

Wellness Program

Life Insurance

Paid Time Off

Paid Parental Leave

Job summary

NFI is seeking a Senior Data Engineer in Camden, NJ to lead refactoring of legacy SQL logic into modern PySpark pipelines within a Lakehouse on Azure Synapse. You will partner with a vendor to design CI/CD and governance for the Fabric migration, while mentoring junior engineers and ensuring data quality and security.

You will own end-to-end ETL/ELT pipelines, optimize performance across the Azure stack, and champion best practices, data lineage, and robust production stability in a fast-paced

Qualifications

• 5+ years of dedicated data engineering or related experience in enterprise cloud environments.
• Deep expertise in advanced T-SQL, including complex stored procedures.
• Strong Python and PySpark skills for data processing and pipeline development.
• Hands-on experience with core Azure data services (Synapse, Pipeline, ADLS Gen2).
• Ability to review, debug, and optimize code including AI-generated solutions.
• Proven track record building robust, scalable data pipelines in production.

Responsibilities

• Lead refactoring of legacy logic (SQL Stored Procedures) into PySpark pipelines within a Lakehouse architecture.
• Collaborate with a third-party vendor to design CI/CD pipelines and governance for Fabric migration.
• Design, build, and optimize ETL/ELT pipelines across Azure for high performance and data integrity.
• Own data platform health by refactoring fragile processes and reducing production bottlenecks.
• Mentor junior data engineers and establish best practices for maintenance and quality.
• Implement data quality, security, and lineage tracking across ingestion and migration paths.

Skills

SQL Mastery

PySpark/Python

Azure Expertise

Code Evaluation

ETL/ELT Pipelines

Problem Solving

Tools

Azure Synapse Analytics

Azure Pipeline

ADLS Gen2

Job description

NFI is seeking a Senior Data Engineer in Camden, NJ to lead refactoring of legacy SQL logic into modern PySpark pipelines within a Lakehouse on Azure Synapse. You will partner with a vendor to design CI/CD and governance for the Fabric migration, while mentoring junior engineers and ensuring data quality and security.

You will own end-to-end ETL/ELT pipelines, optimize performance across the Azure stack, and champion best practices, data lineage, and robust production stability in a fast-paced