Data Engineer, Bureau of Data Technology & Strategy

Cityofnewyork; New York (NY); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Premium health benefits

Work-from-home flexibility

Public sector pension

Job summary

The City of New York's Department of Health and Mental Hygiene seeks a data engineering scientist to advance data modernization across public health programs. You will support Python-based applications, migrate workloads to Azure, and build scalable data pipelines for analytics that inform city-wide health actions.

Ideal candidates have a graduate degree in a quantitative field and 5+ years in cloud-driven data science, including Python web frameworks and ETL tooling.

Qualifications

• 5+ years of data science tasks using cloud-based technologies.
• 5+ years of hands-on Python experience.
• 3+ years building apps in Python web frameworks (FastAPI, Django, Flask).
• 3+ years using ETL platforms such as Azure Data Factory or Airflow.
• Graduate degree in Data Science, Mathematics, Statistics, CS, or related field.

Responsibilities

• Provide data engineering and infrastructure configuration support for complex Python applications.
• Migrate complex Python applications from on-premise to Azure and transform to cloud-native architecture.
• Build and oversee automated data extraction, transfer, and load processes for analytics databases.
• Design, build, and document scalable hybrid architecture using on-premise and Azure cloud resources.
• Prototype and deploy statistical, ML, and deep learning models; improve data science infrastructure.

Skills

Cloud data science

Python

Python web frameworks

ETL platforms

Education

Graduate degree in Data Science/Statistics/CS

Tools

Azure Data Factory

Airflow

Job description

The Center for Population Health Data Science (CPHDS)- launched in October of 2023- aims to catalyze critical data modernization work and enable the agency to make progress toward linking public health, healthcare, and social service for timely and effective public action. We are working towards making these data more accessible, timely, equitable, meaningfully usable, and protected and actively used to protect and promote the health and wellbeing of New Yorkers. We aim to strengthen agency wide data capabilities by empowering our workforce, enhancing intra- and inter-agency data sharing, and using modern technology to yield trusted and integrated data and insights. A real-time and comprehensive view of city needs is needed to enhance public health actions and improve health outcomes for the most vulnerable New Yorkers. With an annual budget of $2.3 billion and more than 7,000 employees throughout the five boroughs, the New York City Department of Health and Mental Hygiene (NYC DOHMH) is one of the largest public health agencies in the world, serving 8 million New Yorkers from diverse ethnic and cultural backgrounds. We're tackling a broad range of public health issues with innovative policies and programs and geting exceptional results, but our work is never finished. The breadth of our innovative programs provides the widest range of choices for every member of our team.

DUTIES WILL INCLUDE BUT NOT BE LIMITED TO:

• Provide data engineering and infrastructure configuration support for complex Python applications.
• Aide migration of complex Python applications from on-premise environments to Azure including transformation of applications to cloud native architecture.
• Build and oversee automated data extraction, transfer, and load processes to support analytics databases.
• Design, build, and document scalable hybrid technology architecture using both on-premise and cloud resources on Azure.
• Identify, explore, and help build emerging free, open source technologies.
• Design, implement, test, deploy, update, and document statistical, machine learning, and deep learning models.
• Propose and implement improvements to the DOHMH data science infrastructure and processes.

PREFERRED SKILLS:

• 5+ years of experience performing data science tasks using cloud-based technologies
• 5+ years of hands-on experience in Python
• 3+ years of experience building applications in Python web frameworks such as FastAPI, Django, or Flask
• 3+ years of experience using ETL platforms such as Azure Data Factory or Airflow
• Graduate degree in Data Science, Mathematics, Applied Mathematics, Statistics, Applied Statistics, Computer Science, Computer Engineering, Electrical Engineering, Physics, or a similar field of study

Why you should work for us:

• Loan Forgiveness: As a prospective employee of the City of New York, you may be eligible for federal/state loan forgiveness and repayment assistance programs that lessen your payments or even fully forgive your full balance. For more information, please visit the U.S. Department of Education's website (https://studentaid.gov/pslf/)
• Benefits: City employees are entitled to unmatched benefits such as:
  • a premium-free health insurance plan that saves employees over $10K annually, per a 2024 assessment.
  • additional health, fitness, and financial benefits may be available based on the position's associated union/benefit fund.
  • a public sector defined benefit pension plan with steady monthly payments in retirement.
  • a tax-deferred savings program and
  • a robust Worksite Wellness Program that offers resources and opportunities to keep you healthy while serving New Yorkers.
• Work From Home Policy: Depending on your position, you may be able to work up to two days during the week from home.
• Job Security - you could enjoy more job security compared to private sector employment and be able to contribute to making NYC a healthy place to live and work.

Established in 1805, the New York City Department of Health and Mental Hygiene (NYC Health Department) is the oldest and largest health department in the U.S., dedicated to protecting and improving the health of NYC. Our mission is to safeguard the health of every resident and cultivate a city where everyone, regardless of age, background, or location, can achieve their optimal health. We provide a wide array of programs and services focused on food and nutrition, anti-tobacco support, chronic disease prevention, HIV/AIDS treatment, family and child health, environmental health, mental health, and social justice initiatives. As the primary population health strategist and policy authority for NYC, with a rich history of public health initiatives and scientific advancements, from addressing the 1822 yellow fever outbreak to the COVID-19 pandemic, we serve as a global leader in public health innovation and expertise.

Come join us and help to continue our efforts in making a difference in the lives of all New Yorkers!

Commitment to Equity:

The City o