Azure Data Platform Lead Engineer

DBI Staffing; New York (NY); On-site; USD 190,000 - 240,000; Full time

Job summary

DBI Staffing seeks a Lead Data Engineer to design, build, and operate enterprise-grade data platforms across the firm. You will own ETL/ELT pipelines, data models, and production data operations, partnering with IT, Security, Governance, Finance, and business groups to deliver trustworthy data.

You will lead Azure-based data services and drive DevOps/DataOps practices, ensuring reliability, cost efficiency, and scalable analytics for reporting and AI initiatives.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field, or equivalent practical experience.
• 8+ years of hands-on experience in data engineering, ETL/ELT development, and data integration.
• 3+ years of experience designing and operating cloud-based data platforms (Microsoft Azure preferred).
• Strong MS SQL skills and experience with relational database design, development, and performance tuning (SQL Server preferred).
• Experience building reliable production data pipelines, including monitoring, alerting, and reconciliation.
• Experience with source control and deployment practices for data workflows (e.g., Git and CI/CD pipelines).
• Excellent written and verbal communication skills, including ability to explain technical concepts to non-technical audiences.
• Ability to handle sensitive and confidential information with discretion and professionalism.
• Availability for occasional after-hours work for major releases or production incidents.

Responsibilities

• Enterprise Data Integration & Pipelines: Design, build, and maintain robust ETL/ELT pipelines that integrate data from core firm systems.
• Data Architecture & Modeling: Define and enforce data architecture standards, including data models, schemas, and storage patterns.
• Cloud Data Platform Management: Lead the implementation and operation of Microsoft Azure-based data services.
• Own the firm’s enterprise data warehouse and lakehouse platforms, including data models and ingestion pipelines.
• DevOps / DataOps Practices: Implement source control, CI/CD pipelines, automated testing, and deployment workflows.
• Production Data Operations: Oversee scheduling, execution, reconciliation, and monitoring of production data workflows.
• Data Governance & Quality: Partner with IG and Security to implement data quality standards and lineage documentation.
• Cross-Functional Collaboration: Translate requirements into technical solutions for stakeholders.
• Security & Compliance: Ensure data solutions comply with security policies and regulatory obligations.
• Innovation & Continuous Improvement: Evaluate new capabilities and lead pilots to improve reliability and value.
• Technical Leadership & Mentorship: Provide design guidance and code reviews to junior engineers.

Skills

ETL / ELT pipelines

Azure data platform

Data modeling

Data governance & quality

DevOps for data pipelines

Production data operations

Cross-functional collaboration

SQL / MS SQL

Python / scripting

Education

Bachelor’s degree in Computer Science or related field

Equivalent practical experience

Tools

Azure Data Factory

Azure Databricks

Azure Data Lake Storage

Azure Synapse Analytics

Git

CI/CD pipelines

Power BI/Tableau

Job description

DBI Staffing seeks a Lead Data Engineer to design, build, and operate enterprise-grade data platforms across the firm. You will own ETL/ELT pipelines, data models, and production data operations, partnering with IT, Security, Governance, Finance, and business groups to deliver trustworthy data.

You will lead Azure-based data services and drive DevOps/DataOps practices, ensuring reliability, cost efficiency, and scalable analytics for reporting and AI initiatives.