Senior Data Engineer

DBI Staffing; New York (NY); Hybrid; USD 180,000 - 220,000; Full time

Job summary

DBI STaffing in New York, NY is seeking a Data Engineer to design, build, and maintain Microsoft Fabric Lakehouse solutions, data pipelines, and enterprise data platforms delivering analytics, reporting, and AI initiatives.

This hybrid role requires 5-7 years of experience with Azure Data Factory, Databricks, and SQL; onsite 4 days per week at Midtown Manhattan, offering a compensation range of $180,000-$220,000 annually.

Qualifications

• 5–7 years of enterprise data engineering experience.
• Strong SQL/T-SQL, data modeling, transformation, and performance tuning.
• Experience with Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, and Databricks.

Responsibilities

• Design, build, and maintain Microsoft Fabric Lakehouse solutions, data pipelines, and enterprise data platforms.
• Develop scalable data ingestion, transformation, and orchestration processes for analytics and AI initiatives.
• Implement and support Medallion Architecture and Delta Lake standards to deliver quality data products.
• Collaborate with business, analytics, and data teams to meet organizational needs.
• Ensure compliance with data governance, security, and quality standards.

Skills

SQL/T-SQL

Python

REST APIs

CI/CD

DevOps

Education

Bachelor's degree in Computer Science/Information Systems/Engineering

Tools

Azure Data Factory

Azure Synapse Analytics

Databricks

OneLake

Delta Lake

Power Automate

Logic Apps

Job description

***MUST BE A US CITIZEN OR GC HOLDER. WE WILL NOT WORK WITH ANY THIRD PARTIES LOOKING TO REPRESENT CANDIDATES

THIS POSITION IS HYBRID WITH 4 DAYS ONSITE IN MIDTOWN NYC WITH A COMPENSATION RANGE IN THE $180,000-$220,000 ANNUAL RANGE.***

Data Engineer develops and maintains Microsoft Fabric Lakehouse solutions, data pipelines, and enterprise data platforms that deliver secure, reliable, and scalable data for analytics, reporting, and AI initiatives.

Principal Duties and Responsibilities:

• Design, build, and maintain Microsoft Fabric Lakehouse solutions, data pipelines, and enterprise data platforms leveraging OneLake, Data Factory, Databricks, and Azure services.
• Develop scalable data ingestion, transformation, and orchestration processes supporting analytics, reporting, AI, and business operations.
• Implement and support Medallion Architecture (Bronze, Silver, Gold), Delta Lake standards, and enterprise data models to deliver trusted, high-quality data products.
• Design, optimize, and manage Lakehouse storage structures, data models, and integration frameworks to ensure reliability, scalability, performance, and cost efficiency.
• Collaborate with business, application, analytics, and data teams to deliver solutions aligned with organizational requirements.
• Ensure compliance with data governance, security, privacy, and data quality standards in partnership with Information Security and Information
• Governance teams.
• Follow established SDLC, DevOps, CI/CD, and data engineering best practices while evaluating emerging cloud and analytics technologies.
• Monitor, troubleshoot, and optimize data platform performance, reliability, and operational support processes.

Job Specifications:

• 5-7 years of experience designing, developing, and supporting enterprise data engineering solutions using Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Databricks, or similar cloud data platforms.
• Strong understanding of data integration, ETL/ELT, data warehousing, Lakehouse architecture, and modern cloud data platforms.
• Strong SQL/T-SQL skills with experience in data modeling, transformation, query optimization, and performance tuning.
• Experience developing data pipelines and orchestration frameworks using Fabric Data Factory, Azure Data Factory, equivalent technologies.
• Understanding of SQL Server, Azure SQL Database, Cosmos DB, and other relational or NoSQL data platforms.
• Proficiency in Python, REST APIs, Power Automate, Logic Apps, and automation technologies supporting data integration and processes.
• Experience with Delta Lake, Parquet, data governance, security, metadata management, and data quality best practices.
• Familiarity with Git, CI/CD, DevOps processes, and Infrastructure-as-Code concepts for cloud data platforms.
• Strong communication and collaboration skills with the ability to partner effectively with technical and business stakeholders.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
• Legal industry experience preferred.

Attendance Requirements: On site during normal working hours and available as necessary before or after normal working hours.