Data Engineer III - Digital and Technology Partners - Hybrid/Remote

Mount Sinai; New York (NY); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Mount Sinai Health System seeks an experienced Senior Data Engineer to lead data collection, movement, and storage for big data and analytics initiatives in a translational research environment.

You will work on ETL/Data Warehousing now and Big Data/Streaming architectures in the future, partnering across IT and clinical research teams to accelerate insights and improve patient care.

Qualifications

• Bachelor's degree in Computer Science or related field; advanced degree preferred.
• 5+ years of professional data engineering experience.
• Strong knowledge of Azure data tools including Data Factory and Databricks.
• Proficiency in SQL and NoSQL (Oracle, PostgreSQL/MySQL, MongoDB).
• Experience with Scala/Python/Java; RESTful service development (Node.js, Django, PHP).
• Experience with micro-services/SOA; CI/CD and observability tools; Git.

Responsibilities

• Facilitate data collection from diverse sources with quality standards and standardized interfaces.
• Ensure data streams/pipelines are scalable, secure, and multi-user capable.
• Work as a core Agile team member with developers, data scientists, and data engineers.
• Create infrastructure for insight from raw data and manage multi-source data pipelines.
• Enable big data and streaming analytics with modern tech stacks.
• Develop prototypes and POCs for selected solutions and manage large data projects.
• Translate business requirements into modern data pipeline solutions and document them.

Skills

SQL

NoSQL databases

Scala/Python/Java

Agile methodologies

Data modeling

Education

Bachelor's in CS or related

Advanced degree preferred

Tools

Azure Data Factory

Databricks

RESTful services

Node.js

Django

PHP

CI/CD

Git

Kafka

Hadoop

Spark

Mirth

AWS

Jira

Job description

Description

This position is hybrid/remote, occasional onsite and may require onsite interviews in NY.

Location: 150 E 42nd Street, New York, NY

The Senior Data Engineer is an experienced technician who is responsible for data collection, movement, storage, transformation processing, and storage of Big Data. This individual works with both current ETL/Data Warehousing and future Big Data/Streaming/Pipeline architectures. The focus is on choosing optimal solutions to use for these purposes, then implementing, maintaining, and monitoring them, always being mindful of the overarching goal of accelerating translational research and improving clinical care.

Responsibilities

• Facilitates data collection from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality standards, and assuring that downstream users can get that data quickly and with a common standard interface.
• Ensures that data streams/pipelines are scalable, repeatable, and secure, and can serve multiple users within the Institute.
• Develops as a core member of an Agile team, using Agile tools and methodology. Work closely with other team members including Application Developers, Database Developers, and Data Scientists.
• Responsible for creating the infrastructure that provides insight from raw data and handles diverse sources of data seamlessly.
• Enables big data and batch/real-time analytical solutions that leverage emerging technologies.
• Additional responsibilities include developing prototypes and proof of concepts for the selected solutions, and implementing complex big data projects with a focus on collecting, parsing, and managing large sets of data using multiple platforms to allow for Research and Data Science initiatives.
• Translates business requirements into modern data pipeline solutions. Create centralized documents and diagrams of all solutions.
• Creates a data catalog store of all metadata.
• Designs and implements monitoring, backup, and disaster recovery of data systems.
• Approaches all relationships with a world-class customer service approach. Maintains a customer-focused approach with users to provide solutions that are science/research-driven.
• Responsible for the integrity and security of data in all forms of storage throughout the Data Architecture.
• Works with other IT professionals through Mount Sinai effectively. Comply with the Institutional Review Board and HIPAA to follow all applicable policies and procedures.
• Assists in the development of standards and procedures affecting data management, design and maintenance. Documents all standards and procedures.
• Provides presentations and training to other team members in the above.
• Possesses an extremely flexible attitude. Willing to work with multiple types of technologies and languages with an open mind and without technology bias. Continuous interest in updating skill sets and knowledge of trends in the Big Data Technology space.
• Trains, mentors and offers input into hire/fire/performance on more junior Data Engineers.
• Other duties as assigned.

Qualifications

• Bachelor’s degree in Computer Science or a related discipline; Advanced degree preferred.
• 5+ years relevant professional development experience, preferably in a Data Engineering role.
• In depth knowledge of the Azure cloud platform including Azure Data Factory and Databricks.
• Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, and Mongo DB (or similar).
• Proficiency with at least 2 programming languages among Scala/Python/ Java. Must be flexible and fast to pick up new languages.
• Proficiency in Restful service development, preferably with Node JS, Django and PHP.
• Experience with micro-services and SOA.
• Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, and Mongo DB (or similar).
• Proficiency on installation and configuration of big data software and technology
• Knowledge of Hadoop, Spark, Kafka and other big data technology stacks and streaming tools.
• Knowledge of healthcare data, HL7, and Mirth are also a big plus.
• Experience with CI/CD and Observability tools. Also, experience with version control (Git).
• Familiarity with and the ability to leverage a wide variety of open source technologies and tools.
• Working knowledge of cloud architecture and implementation on Azure or AWS, is a big plus. Experience with serverless computing, creating VMs, cloud security, and other cloud services is also a big plus.
• Experience working in an Agile methodology. Experience working with JIRA is a plus.
  

Employer Description

Strength through Unity and Inclusion

The Mount Sinai Health System is committed to fostering an environment where everyone can contribute to excellence. We share a common dedication to delivering outstanding patient care. When you join us, you become part of Mount Sinai’s unparalleled legacy of achievement, education, and innovation as we work together to transform healthcare. We encourage all team members to actively participate in creating a culture that ensures fair access to opportunities, promotes inclusive practices, and supports the success of every individual.

At Mount Sinai, our leaders are committed to fostering a workplace where all employees feel valued, respected, and empowered to grow. We strive to create an environment where collaboration, fairness, and continuous learning drive positive change, improving the well-being of our staff, patients, and organization. Our leaders are expected to challenge outdated practices, promote a culture of respect, and work toward meaningful improvements that enhance patient care and workplace experiences. We are dedicated to building a supportive and welcoming environment where everyone has the opportunity to thrive and advance professionally. Explore this opportunity and be part of the next chapter in our history.

About the Mount Sinai Health System:

Mount Sinai Health