Hybrid Data Engineer: Azure Cloud, Data Lake & ML

Fund for Public Health in NYC; New York (NY); Hybrid; USD 125,000 - 128,000; Full time

Benefits offered by this job

Public Service Loan Forgiveness (PSLF)

Generous PTO

Medical, dental, and life insurance

Retirement savings plan

Flexible spending medical and commuter

Meaningful work

Job summary

Fund for Public Health in NYC is hiring a Data Engineer with the Department of Health and Mental Hygiene to advance data integration and analytics across agency systems. This 35-hour weekly position is hybrid, requiring three days in the office.

You will build data pipelines, migrate Python apps to Azure, and develop scalable data architectures using Azure Synapse and Databricks, while collaborating with a multidisciplinary team.

Qualifications

• 3+ years Python 3.x experience.
• 3+ years SQL experience.
• 3+ years ML/AI models in Python.
• 2+ years cloud-based data science tasks.
• 2+ years building Python apps with Docker or Azure.
• 3+ years Data Lake analytics (Azure Synapse/Databricks).
• Strong organization and time management.
• Good written and verbal communication.
• Ability to work independently or in a team.
• Undergraduate degree in Data Science, Mathematics, CS, or similar field.

Responsibilities

• Provide data engineering and infra configuration for Python apps.
• Aid migration of Python apps to Azure and cloud-native architecture.
• Build and oversee automated ETL data pipelines.
• Ingest, extract, or analyze data in a data lake environment.
• Design scalable hybrid architecture on Azure.
• Identify and adopt emerging open source technologies.
• Design, test, deploy, and document ML/DL models.
• Propose improvements to DOHMH data science infrastructure.

Skills

Python

SQL

ML in Python

Cloud technologies

Docker / Azure

Azure Synapse / Databricks

Communication

Teamwork

Education

Undergraduate degree in Data Science/CS

Graduate degree preferred

Tools

Docker

Azure Data Factory

Airflow

Azure Synapse

Databricks

Job description

Fund for Public Health in NYC is hiring a Data Engineer with the Department of Health and Mental Hygiene to advance data integration and analytics across agency systems. This 35-hour weekly position is hybrid, requiring three days in the office.

You will build data pipelines, migrate Python apps to Azure, and develop scalable data architectures using Azure Synapse and Databricks, while collaborating with a multidisciplinary team.