Senior Data Engineer & BI Developer, SEO

New York City Department of Education; New York (NY); On-site; USD 95,000 - 135,000; Full time

Job summary

New York City Department of Education seeks a Computer Specialist (Software) to manage end-to-end data integration, warehousing, and reporting for special education programs across preschool and school-age students. The role entails ETL development, data governance, and overseeing complex compliance reporting within a civil service framework.

The ideal candidate will design data models, coordinate with multiple NYCPS offices, and lead or supervise teams or consultants as needed.

Qualifications

• Minimum bachelor's degree with 24 semester credits in computer science or a related field and 2 years of full-time software development/analysis experience, including 1 year in a project lead capacity or on a complex project.
• Alternate: high school diploma with 6 years of relevant software experience, including 1 year in project leadership.
• Education/experience equivalent to above, with possible substitutions defined in the postings.

Responsibilities

• Engage with business stakeholders to gather and document requirements.
• Design conceptual, logical and physical data models, data dictionaries and data lineage.
• Own end-to-end ETL design, extraction, transformation, loading, testing and deployment for large-scale datasets.
• Ensure integration of NYCPSE systems (SESIS, ATLAS, Encounter Attendance, Provider Assignment) and related metrics.

Job description

Computer Specialist (Software)

Level: L3

Division/Office: Division of Inclusive and Accessible Learning (DIAL)

Borough: Manhattan

Posting End Date: 10/01/2026

This position is in a civil service competitive class that is subject to examination. Position is only open to current City employees with permanent NYC civil service status as Computer Specialist (Software) or permanent in an equivalent title that is eligible for transfer under 6.1.9 to Computer Specialist (Software). This position is open to qualified persons with a disability who are eligible for the 55-a program. Please indicate in your cover letter that you would like to be considered for the position under the 55-a program.

Position Summary

The Reporting and Analytics team within the Special Education Office (SEO) of the Division of Inclusive and Accessible Learning (DIAL) is seeking a highly skilled, multi-talented, experienced individual to manage end to end data integration, warehousing, and reporting workflows in tracking referrals, evaluations, Individualized Education Programs (IEPs, IESPs), mandated student services, and complex compliance metrics for all preschool and school age students referred for special education services in public, charter, and private school settings.

Undergeneralsupervision,withbroadscopefortheexerciseofindependentinitiativeand judgement, the selected candidate is responsible for the analysis, design, development, implementation, enhancement, maintenance, security and data governance of data warehouses, data marts, business intelligence systems and operational, management, regulatory reporting systems. Performs related work.

Reports to: Senior Director of MIS/Analytics, SEO

Direct Reports: There are no immediate direct reports assigned to this position. However, the candidate must be capable of adapting to future needs, including supervising developers, directing project teams, or overseeing external consultants.

Key Relationships: The candidate will work closely with other offices within the division, several external constituencies, and partner with other New York City Public Schools (NYCPS) divisions/offices, including the Division of Instructional and Information Technology (DIIT), the Office of the General Counsel (OGC), Research and Policy Support Group (RPSG), and the Office of Student Enrollment (OSE).

Responsibilities

• Engage with business stakeholders to gather and document requirements.
• Create conceptual, logical and physical data models, data dictionaries and capture data lineage
• Design, implement, test, deploy, debug, and document large scale Microsoft based on premise and cloud data warehouses and data marts.
• Own the end to end design, extraction, transformation, and loading (ETL) process, testing and deployment for complex large scale datasets ensuring accuracy and security.
• Ensure seamless integration of disperse enterprise NYCPSE systems, including school age and pre-school special education applications (SESIS, ATLAS, Encounter Attendance, Provider Assignment), enrollment, attendance, course scheduling, teacher certification, ensuring seamless integration of special education, enrollment, and personnel metrics.

Compliance & Legal Reporting

• Design and create complex data models and queries from scratch.
• Improve the performance and speed of existing data structures and queries.
• Construct reliable data pipelines and reporting frameworks.
• Keep data systems updated, accurate, and functional over time.
• Run data jobs and deliver reports for federal, state, and city regulations, FOIL requests, audits, and legal stipulations.

Specialized Automation

• Architect automation engines, designing scalable Python and T-SQL systems from the ground up to generate and distribute reports.
• Maintain automation engines, ensuring ongoing performance and reliability for critical data workflows.
• Distribute data insights, delivering information efficiently to key decision makers.
• Drive algorithmic assignment, programmatically managing the placement of preschool students with disabilities for reevaluation.

Enterprise BI and Analytics Delivery

• Design and deploy robust and reliable systems for data analysis.
• Design, build and deploy fast, high-performance PowerBI dashboards.
• Tailor all tools and reports for different internal and external groups.
• Lead technical readiness for moving legacy on-premise data systems.
• Plan data migration from local SQL Server data marts to the cloud.
• Implement modern cloud environments using Microsoft Fabric.
• Define future state data schemas to support new cloud setups.

Strategic Planning and Project management

• Assist in defining roadmaps, align data systems with business goals, and data governance standards.
• Test and choose new tools, software, and AI features to keep the data stack modern and efficient.
• Coordinate and direct data management activities.
• Assist in performing project planning, feasibility studies, cost benefit analyses, impact analyses, and task prioritization.

Qualification Requirements

Minimum

• A baccalaureate degree from an accredited college, including or supplemented by 24 semester credits in computer science or a related computer field and two (2) years of satisfactory full-time computer software experience in computer systems development and analysis, applications programming, database administration, systems programming, data communications, including one (1) year in a project leader capacity or as a major contributor on a complex project; or
• A four-year high school diploma or its educational equivalent and six (6) years of satisfactory full-time computer software experience as described in "1" above, including one (1) year in a project leader capacity or as a major contributor on a complex project; or
• Education and/or experience equivalent to "1" or "2" above. College education may be substituted for up to two (2) years of the required experience in "2" above on the basis that 60 semester credits from an accredited college is equated to one (1) year of experience. A masters degree in computer science or a related computer field may be substituted for one (1) year of the required experience in "1" or "2" above. However, all candidates must have at least a four-year high school diploma or its educational equivalent and at least one (1) year of satisfactory full-time experience in a project leader capacity or as a major contributor on a complex project.

Plus

• Familiarity with Microsoft Fabric, Azure Data Factory, or cloud data warehousing pipelines is a major plus.
• Familiarity with New York State Special Education laws, policies and practices.
• Knowledge of NYCPS processes and systems (including data systems).

In addition to meeting the minimum requirements, individuals must have two additional years of relevant work experience.

Preferred

• High proficiency in T-SQL and relational database management systems (Microsoft SQL Server on-premises).
• Strong programming experience in Python for data manipulation, scripting, and automated PDF reporting pipelines.
• Demonstrated hands on experience on both sides of the pipeline: data procurement/ingestion and reporting delivery.
• Ability to troubleshoot, problem solve and anticipate issues needing resolution.
• Strong analytical skills combined with the ability to develop thoughtful and creative approaches for addressing a wide range of analytic questions.
• Excellent written and spoken communication skills and interpersonal skills.

(Internal candidates who are selected for this position and who currently hold comparable or less senior positions within the DOE will not earn less than their current salary.)

AN EQUAL OPPORTUNITY EMPLOYER

DOE Non- Discrimination Policy
The Department of Education of the City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment upon any legally protected status or protected characteristic, including but not limited to an individual's actual or perceived sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, or pregnancy. For more information, please refer to the DOE Non-Discrimination Policy .

REQUESTING AN ACCOMMODATION - APPLICANTS

Any prospective employee (applicant) who is a qualified individual with a disability may request a reasonable accommodation to assist in the application process. If an applicant for employment believes that they have a qualifying disability and are in need of a reasonable accommodation in order to participate in the application process on an equal basis as applicants who do not have a disability, they should request an accommodation with their interview team or contact ODA by emailing [e-mail] . The determination of the accommodation request will be communicated to the applicant in writing.

https://infohub.nyced.org/docs/default-source/doe-employees-only/personnel-memorandum-6-2024-2025---accommodations.pdf

As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at https://studentaid.gov/pslf/ .