Data Engineer, Data & Analytics (ETL/Databricks)

NYC Department of Sanitation (DSNY); New York (NY); On-site; USD 90,000 - 120,000; Full time

Job summary

The New York City Department of Sanitation (DSNY) is seeking a Data Engineer to design, develop, and maintain data management systems and integration solutions for the Operations Management Division (OMD). You will support critical reporting, analytics, and operational initiatives across the DSNY project portfolio.

Responsibilities include building data models, optimizing SQL queries, and developing ETL pipelines using tools like Databricks, Informatica PowerCenter, and Pentaho.

Qualifications

• Bachelor’s degree in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering.
• Bachelor’s degree and eight years or equivalent experience in datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering.

Responsibilities

• Design, development, implementation, enhancement, documentation, and maintenance of database management systems, data integration solutions, and related software functions supporting DSNY Operations Management Division.
• Perform data analysis, data profiling, data modeling, source-to-target mapping, and reporting for enterprise data and analytics projects.
• Develop and maintain SQL-based data solutions, including complex queries, stored procedures, and data transformation processes.
• Collaborate with stakeholders to design, develop, and support data integration pipelines using ETL tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration, and similar technologies.
• Develop and maintain technical documentation including data models, data dictionaries, mapping documents, ETL specifications, and reporting artifacts.
• Support BI and reporting initiatives using platforms like OBIEE, Power BI, Tableau, and other enterprise reporting tools.
• Participate in data architecture and integration strategy design to improve data sharing across DSNY and City agencies.

Skills

SQL

Python

pySpark

Data modeling

ETL/ELT

Data integration

OBIEE

Power BI

Tableau

Databricks

Cloud platforms

Unix/Linux

Education

Bachelor’s degree in CS/Engineering

Tools

Databricks

Informatica PowerCenter

Pentaho Data Integration (Kettle)

Oracle BI/OBIEE

Job description

The New York City Department of Sanitation (DSNY) is seeking a Data Engineer to design, develop, and maintain data management systems and integration solutions for the Operations Management Division (OMD). You will support critical reporting, analytics, and operational initiatives across the DSNY project portfolio.

Responsibilities include building data models, optimizing SQL queries, and developing ETL pipelines using tools like Databricks, Informatica PowerCenter, and Pentaho.