Senior Data Engineer — Azure & Big Data (Hybrid/Remote)

Mount Sinai Health System; New York (NY); Hybrid; USD 109,000 - 164,000; Full time

Job summary

Mount Sinai Health System in New York, NY, is seeking a senior data engineer to design scalable data pipelines and architectures in a hybrid/remote setting with occasional onsite interviews in NY.

You will collaborate with data scientists, developers, and IT to collect, process, and govern large datasets, leveraging Azure, Databricks, and big data tools to support research initiatives.

Qualifications

• Bachelor’s degree in Computer Science or related discipline.
• 5+ years experience in Data Engineering or similar role.
• Deep knowledge of Azure including Data Factory and Databricks.
• Strong SQL and NoSQL knowledge: Oracle, PostgreSQL/MySQL, MongoDB.
• Proficiency in Scala/Python/Java; RESTful services with Node.js, Django or PHP.
• Experience with micro-services, SOA; CI/CD and Observability tools; Git.
• Familiarity with open source tech and cloud architecture on Azure/AWS.
• Experience in Agile environments; JIRA is a plus.

Responsibilities

• Facilitates data collection from diverse sources with quality controls.
• Ensures scalable, repeatable, and secure data streams for multiple users.
• Core Agile team member collaborating with developers, DBAs, and data scientists.
• Creates infrastructure enabling insights from raw data across platforms.
• Supports big data and real-time analytics using emerging tech.
• Develops prototypes/PoCs and manages large data sets for research.
• Translates requirements into modern data pipelines; documents solutions.
• Creates a data catalog and metadata store.
• Designs monitoring, backup, and disaster recovery for data systems.
• Trains and mentors junior engineers; documents standards and procedures.

Skills

Azure Data Factory

Databricks

SQL/NoSQL

Python/Scala/Java

RESTful services

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure

Hadoop/Spark

Kafka

Git

CI/CD

Job description

Mount Sinai Health System in New York, NY, is seeking a senior data engineer to design scalable data pipelines and architectures in a hybrid/remote setting with occasional onsite interviews in NY.

You will collaborate with data scientists, developers, and IT to collect, process, and govern large datasets, leveraging Azure, Databricks, and big data tools to support research initiatives.