Remote Data Engineer II: Big Data & Analytics

Mount Sinai Health System; United States; Hybrid; USD 90,000 - 135,000; Full time

Job summary

Mount Sinai Health System is seeking a Data Engineer II to design and optimize data collection, storage, and transformation pipelines. The role focuses on both current ETL/Data Warehousing and future Big Data/Streaming architectures to accelerate translational research and improve clinical care.

You will work in an Agile team with developers, DBAs, and data scientists, building scalable data infrastructure and ensuring data quality and security across platforms.

Qualifications

• Bachelor's degree in Computer Science or related discipline.
• 4+ years of professional development experience, preferably in a Data Engineering role.
• Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, MongoDB.
• Proficiency with big data stacks (Hadoop, Spark, Kafka) and streaming tools.
• Experience with Azure cloud platform including Azure Data Factory and Databricks.

Responsibilities

• Facilitates data collection from diverse sources, ensuring quality and standard interfaces.
• Ensures scalable, secure pipelines for multiple users.
• Develops as a core Agile team member with developers, DBAs, and data scientists.
• Creates data infrastructure for insights from raw data and supports Research/Data Science initiatives.
• Enables big data and real-time analytics using emerging technologies.
• Translates business requirements into data pipelines and documents solutions.
• Creates a data catalog and stores metadata.
• Designs monitoring, backup, and disaster recovery for data systems.
• Maintains data integrity and security across storage.
• Complies with HIPAA and IRB policies in data handling.
• Assists in standards/procedures development for data management.

Skills

Azure

Databricks

SQL

NoSQL

Python

Java

Scala

RESTful services

Node.js

Django

HIPAA/IRB awareness

Agile/Scrum

Education

Bachelor's degree in Computer Science or related discipline

Advanced degree preferred

Tools

Azure Data Factory

Databricks

Hadoop

Spark

Kafka

Mirth

PostgreSQL

MySQL

MongoDB

Job description

Mount Sinai Health System is seeking a Data Engineer II to design and optimize data collection, storage, and transformation pipelines. The role focuses on both current ETL/Data Warehousing and future Big Data/Streaming architectures to accelerate translational research and improve clinical care.

You will work in an Agile team with developers, DBAs, and data scientists, building scalable data infrastructure and ensuring data quality and security across platforms.