Senior Data Engineer & BI Developer, SEO - 27149

NYC Public Schools

New York (NY)

On-site

USD 123,000 - 139,000

Full time

23 hours ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NYC Public Schools is seeking an experienced data engineering/analytics professional to lead end-to-end data integration, warehousing, and reporting for special education programs across preschool and school-age settings. The role focuses on data governance, secure pipelines, and compliance reporting, collaborating with multiple NYCPS divisions and external stakeholders.

The candidate will design ETL workflows, build PowerBI dashboards, and drive cloud modernization using Microsoft Fabric and

Qualifications

Bachelor's degree with 24 CS credits and 2 years of software experience, or
high school diploma with 6 years of experience including a lead role, or
equivalent education/experience as described in the minimum requirements.

Responsibilities

Gather and document business requirements from stakeholders.
Create data models, data dictionaries, and capture data lineage.
Design and deploy large-scale on-premise and cloud data warehouses/marts.

Skills

ETL pipelines

Power BI

Python

T-SQL

Data governance

Cloud modernization

Education

Bachelor's degree in CS or related field with 24 CS credits

Tools

Microsoft SQL Server

Azure Data Factory

Microsoft Fabric

Job description

Position Summary: The Reporting and Analytics team within the Special Education Office (SEO) of the Division of Inclusive and Accessible Learning (DIAL) is seeking a highly skilled, multi-talented, experienced individual to manage end to end data integration, warehousing, and reporting workflows in tracking referrals, evaluations, Individualized Education Programs (IEPs, IESPs), mandated student services, and complex compliance metrics for all preschool and school age students referred for special education services in public, charter, and private school settings. Under general supervision, with broad scope for the exercise of independent initiative and judgement, the selected candidate is responsible for the analysis, design, development, implementation, enhancement, maintenance, security and data governance of data warehouses, data marts, business intelligence systems and operational, management, regulatory reporting systems. Performs related work.

Reports to:

Senior Director of MIS/Analytics, SEO

Direct Reports:

There are no immediate direct reports assigned to this position. However, the candidate must be capable of adapting to future needs, including supervising developers, directing project teams, or overseeing external consultants.

Key Relationships

The candidate will work closely with other offices within the division, several external constituencies, and partner with other New York City Public Schools (NYCPS) divisions/offices, including the Division of Instructional and Information Technology (DIIT), the Office of the General Counsel (OGC), Research and Policy Support Group (RPSG), and the Office of Student Enrollment (OSE).

Responsibilities

Data Procurement & ETL Pipelines

Engage with business stakeholders to gather and document requirements.
Create conceptual, logical and physical data models, data dictionaries and capture data lineage
Design, implement, test, deploy, debug, and document large scale Microsoft based on premise and cloud data warehouses and data marts.
Own the end to end design, extraction, transformation, and loading (ETL) process, testing and deployment for complex large scale datasets ensuring accuracy and security.
Ensure seamless integration of disperse enterprise NYCPSE systems, including school age and pre-school special education applications (SESIS, ATLAS, Encounter Attendance, Provider Assignment), enrollment, attendance, course scheduling, teacher certification, ensuring seamless integration of special education, enrollment, and personnel metrics.

Compliance & Legal Reporting

Design and create complex data models and queries from scratch.
Improve the performance and speed of existing data structures and queries.
Construct reliable data pipelines and reporting frameworks.
Keep data systems updated, accurate, and functional over time.
Run data jobs and deliver reports for federal, state, and city regulations, FOIL requests, audits, and legal stipulations.

Specialized Automation

Architect automation engines, designing scalable Python and T-SQL systems from the ground up to generate and distribute reports.
Maintain automation engines, ensuring ongoing performance and reliability for critical data workflows.
Distribute data insights, delivering information efficiently to key decision makers.
Drive algorithmic assignment, programmatically managing the placement of preschool students with disabilities for reevaluation.

Enterprise BI and Analytics Delivery

Design and deploy robust and reliable systems for data analysis.
Design, build and deploy fast, high-performance PowerBI dashboards.
Tailor all tools and reports for different internal and external groups.

Cloud Modernization

Lead technical readiness for moving legacy on-premise data systems.
Plan data migration from local SQL Server data marts to the cloud.
Implement modern cloud environments using Microsoft Fabric.
Define future state data schemas to support new cloud setups.

Strategic Planning and Project management

Assist in defining roadmaps, align data systems with business goals, and data governance standards.
Test and choose new tools, software, and AI features to keep the data stack modern and efficient.
Coordinate and direct data management activities.
Assist in performing project planning, feasibility studies, cost benefit analyses, impact analyses, and task prioritization.

Qualification Requirements

Minimum

A baccalaureate degree from an accredited college, including or supplemented by 24 semester credits in computer science or a related computer field and two (2) years of satisfactory full-time computer software experience in computer systems development and analysis, applications programming, database administration, systems programming, data communications, including one (1) year in a project leader capacity or as a major contributor on a complex project; or
A four-year high school diploma or its educational equivalent and six (6) years of satisfactory full-time computer software experience as described in "1" above, including one (1) year in a project leader capacity or as a major contributor on a complex project; or
Education and/or experience equivalent to "1" or "2" above. College education may be substituted for up to two (2) years of the required experience in "2" above on the basis that 60 semester credits from an accredited college is equated to one (1) year of experience. A masters degree in computer science or a related computer field may be substituted for one (1) year of the required experience in "1" or "2" above. However, all candidates must have at least a four-year high school diploma or its educational equivalent and at least one (1) year of satisfactory full-time experience in a project leader capacity or as a major contributor on a complex project.

Plus

Familiarity with Microsoft Fabric, Azure Data Factory, or cloud data warehousing pipelines is a major plus.
Familiarity with New York State Special Education laws, policies and practices.
Knowledge of NYCPS processes and systems (including data systems).

In addition to meeting the minimum requirements, individuals must have two additional years of relevant work experience.

Preferred

High proficiency in T-SQL and relational database management systems (Microsoft SQL Server on-premises).
Strong programming experience in Python for data manipulation, scripting, and automated PDF reporting pipelines.
Demonstrated hands on experience on both sides of the pipeline: data procurement/ingestion and reporting delivery.
Ability to troubleshoot, problem solve and anticipate issues needing resolution.
Strong analytical skills combined with the ability to develop thoughtful and creative approaches for addressing a wide range of analytic questions.
Excellent written and spoken communication skills and interpersonal skills.

Salary

$123,208 - $138,997

(Internal candidates who are selected for this position and who currently hold comparable or less senior positions within the DOE will not earn less than their current salary.)

AN EQUAL OPPORTUNITY EMPLOYER

The Department of Education of the City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment upon any legally protected status or protected characteristic, including but not limited to an individual's actual or perceived sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, or pregnancy. For more information, please refer to the DOE Non-Discrimination Policy.

DOE Non- Discrimination Policy

REQUESTING AN ACCOMMODATION - APPLICANTS

Any prospective employee (applicant) who is a qualified individual with a disability may request a reasonable accommodation to assist in the application process. If an applicant for employment believes that they have a qualifying disability and are in need of a reasonable accommodation in order to participate in the application process on an equal basis as applicants who do not have a disability, they should request an accommodation with their interview team or contact ODA by emailing ODA@schools.nyc.gov. The determination of the accommodation request will be communicated to the applicant in writing.

https://infohub.nyced.org/docs/default-source/doe-employees-only/personnel-memorandum-6-2024-2025---accommodations.pdf

Public Service Loan Forgiveness

As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at https://studentaid.gov/pslf/.