Remote Data Engineer II – Big Data & Health Analytics

JobCubby; New York (NY); Hybrid; USD 90,000 - 135,000; Full time

Job summary

Mount Sinai Health System in New York City seeks a data engineering professional to design and implement scalable data pipelines, ensuring data quality and security across cloud and on‑premises environments.

You will collaborate in an Agile team with developers, data scientists, and DBAs, and work with Azure Data Factory, Databricks, Spark, and streaming technologies to support research and clinical data initiatives.

Qualifications

• Bachelor's degree in Computer Science or related discipline; Advanced degree preferred.
• 4+ years relevant professional development experience, preferably in a Data Engineering role.
• In depth knowledge of the Azure cloud platform including Azure Data Factory and Databricks.
• Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, and Mongo DB (or similar).
• Proficiency on installation and configuration of big data software and technology
• Knowledge of Hadoop, Spark, Kafka and other big data technology stacks and streaming tools.
• Knowledge of healthcare data, HL7, and Mirth are also a big plus.
• Experience with CI/CD and Observability tools. Also, experience with version control (Git).
• Strong skills in data structures, data/file formats, algorithms and object oriented design.
• Proficiency with at least 2 programming languages among Scala/Python/ Java. Must be flexible and fast to pick up new languages.
• Proficiency in Restful service development, preferably with Node JS, Django and PHP.
• Experience with micro-services and SOA.
• Familiarity with open source technologies and tools.
• Working knowledge of cloud architecture and implementation on Azure or AWS; cloud services is a plus.
• Experience in Agile methodology; JIRA is a plus.

Responsibilities

• Facilitates data collection from various sources, ensuring data quality and quick access for downstream users.
• Ensures data streams/pipelines are scalable, repeatable, and secure for multiple users.
• Develops as a core member of an Agile team with Developers, DB Developers, and Data Scientists.
• Creates infrastructure that provides insight from raw data and handles diverse data sources.
• Enables big data and real-time analytical solutions leveraging emerging technologies.
• Develops prototypes and proofs of concept for selected solutions.

Skills

Data pipeline design

Agile teamwork

RESTful services

Cloud architecture

Big data processing

Education

Bachelor's degree in Computer Science

Advanced degree preferred

Tools

Azure Data Factory

Databricks

Hadoop

Spark

Kafka

Node.js

Django

PHP

Git

JIRA

Job description

Mount Sinai Health System in New York City seeks a data engineering professional to design and implement scalable data pipelines, ensuring data quality and security across cloud and on‑premises environments.

You will collaborate in an Agile team with developers, data scientists, and DBAs, and work with Azure Data Factory, Databricks, Spark, and streaming technologies to support research and clinical data initiatives.