Machine Learning & Data Engineer, Bureau of Data Technology & Strategy

Begell House Inc.; New York (NY); Hybrid; USD 125,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Pension plan

Work from home policy

Job summary

The City of New York's Department of Health/Mental Hygiene seeks a City Research Scientist to advance data integration and health informatics. You will design scalable data pipelines for real-time and batch processing, collaborate across units, and promote data governance and security.

Ideal candidates have 4+ years in data engineering, cloud experience (Azure/AWS/GCP), and strong modeling and communication skills to translate complex outputs into actionable insights for decision makers.

Qualifications

• Master's degree in an appropriate field (for Assignment Level I)
• Doctorate or equivalent experience for higher levels and supervisory roles
• Experience in data engineering and health informatics projects
• Experience with cloud data solutions and big data technologies
• Ability to translate modeling outputs into clear insights
• Experience mentoring junior staff and leading projects

Responsibilities

• Support development of integrated data pipelines for data exchange, analysis, surveillance, and reporting
• Collaborate with data stewards to align with health informatics standards
• Develop and maintain scalable data pipelines for real-time and batch processing
• Guide selection and implementation of new data technologies
• Promote data governance, quality, and security
• Collaborate with stakeholders to align infrastructure with unit needs

Skills

Data pipelines

Cloud platforms

Python

R

HL7/FHIR

Simulation modeling

Public health analytics

Project management

Stakeholder communication

Education

Master's degree in physical, biological, environmental science or public health

Doctorate in appropriate field (preferred)

Tools

Azure

AWS

GCP

Linux

Hadoop/Spark

Job description

Job Description

The Center for Population Health Data Science (CPHDS) launched in October of 2023- aims to catalyze critical data modernization work and enable the agency to make progress toward linking public health, healthcare, and social service data for timely and effective public action. We are working towards making these data more accessible, equitable, meaningfully usable, and protected – and actively used to protect and promote the health and wellbeing of New Yorkers. We aim to strengthen agency wide data capabilities by empowering our workforce, enhancing intra- and inter-agency data sharing, and using modern technology to yield trusted and integrated data and insights. A real-time and comprehensive view of city needs is needed to enhance public health actions and improve health outcomes for the most vulnerable New Yorkers.

DUTIES WILL INCLUDE BUT NOT BE LIMITED TO:

• Support the development of integrated data pipelines that facilitates efficient data exchange, analysis, surveillance, and reporting.
• Collaborate with public health data stewards to understand data requirements for health informatics, integrating public health data standards and practices into our integrated data architecture.
• Develop, and maintain scalable, secure data pipelines and platform to support real-time and batch data ingestion and processing from diverse internal and external data sources.
• Guide the selection and implementation of cutting-edge data technologies and tools to enhance our analytics and data science capabilities.
• Promote data governance, quality, and security best practices, ensuring compliance with applicable regulations and standards.
• Collaborate with internal and external stakeholders to align data infrastructure enhancements with the needs of diverse units.

PREFERRED SKILLS:

• Planning and project management skills with ability to adapt with new information and needs.
• Experience modeling population-level health outcomes, infectious disease transmission, behavioral dynamics, or health systems operations.
• Experience working with structured and unstructured datasets, including data from NYC or other municipal contexts.
• Knowledge of statistical inference, uncertainty quantification, sensitivity analysis, and validation techniques for simulation models.
• Prioritization and time management skills.
• Interpersonal and communications skills with ability to manage working relationships with individuals at all levels.
• High degree of self-awareness, humility, and diplomacy.
• 4 or more years of experience in data engineering, building and managing scalable data pipelines.
• Experience with cloud-based data solutions (e.g., Azure, AWS, or GCP), programming (e.g., Python, R), Linux systems, and big data technologies (e.g., Hadoop, Spark).
• Familiarity with health informatics, public health data standards (HL7, FHIR), and understanding of the unique needs in managing health-related data.
• Experience developing simulation modeling (e.g., agent-based models, discrete event simulations, system dynamic models).
• Experience identifying and integrating datasets for use in simulation or predictive modeling.
• Ability to translate modeling outputs into clear, actionable insights for stakeholders.
• Experience conducting scenario analysis to inform policy or program decision-making.
• Ability to mentor more junior staff, manage projects, and collaborate across diverse functional teams.
• Strong problem-solving and communication skills to effectively convey technical concepts to a broad audience.

Why you should work for us:

• Loan Forgiveness: As a prospective employee of the City of New York, you may be eligible for federal/state loan forgiveness and repayment assistance programs that lessen your payments or even fully forgive your full balance. For more information, please visit the U.S. Department of Education’s website (
• Benefits: City employees are entitled to unmatched benefits such as:
• a premium-free health insurance plan that saves employees over $10K annually, per a 2024 assessment.
• additional health, fitness, and financial benefits may be available based on the position’s associated union/benefit fund.
• a public sector defined benefit pension plan with steady monthly payments in retirement.
• a tax-deferred savings program and
• a robust Worksite Wellness Program that offers resources and opportunities to keep you healthy while serving New Yorkers.
• Work From Home Policy: Depending on your position, you may be able to work up to two days during the week from home.
• Job Security - you could enjoy more job security compared to private sector employment and be able to contribute to making NYC a healthy place to live and work.

CITY RESEARCH SCIENTIST - 21744

Qualifications

1. For Assignment Level I (only physical, biological and environmental sciences and public health) A master's degree from an accredited college or university with a specialization in an appropriate field of physical, biological or environmental science or in public health.
To be appointed to Assignment Level II and above, candidates must have:
1. A doctorate degree from an accredited college or university with specialization in an appropriate field of physical, biological, environmental or social science and one year of full-time experience in a responsible supervisory, administrative or research capacity in the appropriate field of specialization; or
2. A master's degree from an accredited college or university with specialization in an appropriate field of physical, biological, environmental or social science and three years of responsible full-time research experience in the appropriate field of specialization; or
3. Education and/or experience which is equivalent to "1" or "2" above. However, all candidates must have at least a master's degree in an appropriate field of specialization and at least two years of experience described in "2" above. Two years as a City Research Scientist Level I can be substituted for the experience required in "1" and "2" above.
NOTE:
Probationary Period
Appointments to this position are subject to a minimum probationary period of one year.

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy. The NYC Health Department is an inclusive equal opportunity employer committed to providing access and reasonable accommodation to all individuals. To request reasonable accommodation to participate in the job application or interview process, contact Sye-Eun Ahn, Director of the Office of Equal Employment Opportunity, at or 347-396-6549.

Agency: DEPT OF HEALTH/MENTAL HYGIINEJob Category: Technology, Data & InnovationSalary Band: $125,000 to $150,000 Compensation: USD 109565 - USD 135000