Data Engineer II - Digital and Technology Partners - Hybrid/Remote

Mount Sinai

United States

Hybrid

USD 90,000 - 135,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mount Sinai Health System in New York is seeking a Data Engineer II to design, build, and optimize data pipelines for translational research and clinical care. You will collect, transform, and store large datasets, ensuring data quality, security, and accessibility for researchers and clinicians.

The role emphasizes agile collaboration with application and data science teams, implementing scalable big data architectures, and maintaining robust data catalogs and monitoring.

Qualifications

  • Bachelor's degree in Computer Science or related discipline.
  • 4+ years of professional development experience in Data Engineering.
  • Deep knowledge of Azure cloud platform including Azure Data Factory and Databricks.
  • Strong SQL and NoSQL knowledge: Oracle, PostgreSQL/MySQL, MongoDB.
  • Experience with Hadoop, Spark, Kafka and streaming tools.
  • Proficiency in at least two languages among Scala, Python, or Java.

Responsibilities

  • Facilitates data collection from diverse sources and formats with quality standards.
  • Ensures scalable, secure data streams/pipelines for multiple users.
  • Works in an Agile team, collaborating with developers and data scientists.
  • Creates infrastructure to derive insights from raw data and diverse sources.
  • Enables big data and real-time analytical solutions using emerging tech.
  • Develops prototypes and complex big data projects for research and data science.
  • Translates business requirements into modern data pipelines and documents.

Skills

Azure
SQL
NoSQL
Python
Java
Kafka
Spark
RESTful APIs
CI/CD
JIRA

Education

Bachelors in CS
Advanced degree preferred

Tools

Azure Data Factory
Databricks
MongoDB
Hadoop
Mirth
Git

Job description

This is a remote/hybrid position, may require onsite for interviews and occasionally onsite as needed

Location: 150 E 42nd Street, New York, NY

The Data Engineer II focuses on data collection, movement, storage, transformation processing, and storage ofBig Data. This individual works with both current ETL/Data Warehousing and future Big Data/Streaming/Pipeline architectures. The focus is on choosing optimal solutions to use for these purposes, then implementing, maintaining, and monitoring them, always being mindful of the overarching goal of accelerating translational research and improving clinical care.

Responsibilities
  1. Facilitates data collection from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality standards, and assuring that downstream users can get that data quickly and with a common standard interface.
  2. Ensures that data streams/pipelines are scalable, repeatable, and secure, and can serve multiple users within the Institute.
  3. Develops as a core member of an Agile team, using Agile tools and methodology. Work closely with other team members including Application Developers, Database Developers, and Data Scientists.
  4. Responsible for creating the infrastructure that provides insight from raw data and handles diverse sources of data seamlessly.
  5. Enables big data and batch/real-time analytical solutions that leverage emerging technologies.
  6. Additional responsibilities include developing prototypes and proof of concepts for the selected solutions, and implementing complex big data projects with a focus on collecting, parsing, and managing large sets of data using multiple platforms to allow for Research and Data Science initiatives.
  7. Translates business requirements into modern data pipeline solutions. Create centralized documents and diagrams of all solutions.
  8. Creates a data catalog store of all metadata.
  9. Designs and implements monitoring, backup, and disaster recovery of data systems.
  10. Approaches all relationships with a world-class customer service approach. Maintains a customer-focused approach with users to provide solutions that are science/research-driven.
  11. Responsible for the integrity and security of data in all forms of storage throughout the Data Architecture.
  12. Works with other IT professionals through Mount Sinai effectively. Comply with the Institutional Review Board and HIPAA to follow all applicable policies and procedures.
  13. Assists in the development of standards and procedures affecting data management, design and maintenance.Documents all standards and procedures.
  14. Provides presentations and training to other team members in the above.
  15. Possesses an extremely flexible attitude. Willing to work with multiple types of technologies and languages with an open mind and without technology bias. Continuous interest in updating skill sets and knowledge of trends in the Big Data Technology space.
  16. Other duties as assigned.
Qualifications
  • Bachelors degree in Computer Science or a related discipline; Advanced degree preferred.
  • 4+ years relevant professional development experience, preferably in a Data Engineering role.
  • In depth knowledge of the Azure cloud platform including Azure Data Factory and Databricks.
  • Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, and Mongo DB (or similar).
  • Proficiency on installation and configuration of big data software and technology
  • Knowledge of Hadoop, Spark, Kafka and other big data technology stacks and streaming tools.
  • Knowledge of healthcare data, HL7, and Mirth are also a big plus.
  • Experience with CI/CD and Observability tools. Also, experience with version control (Git).
  • Strong skills in data structures, data/file formats, algorithms and object oriented design.
  • Proficiency with at least 2 programming languages among Scala/Python/ Java. Must be flexible and fast to pick up new languages.
  • Proficiency in Restful service development, preferably with Node JS, Django and PHP.
  • Experience with micro-services and SOA.
  • Proficiency on installation and configuration of big data software and technology
  • Knowledge of Hadoop, Spark, Kafka and other big data technology stacks and streaming tools.
  • Familiarity with and the ability to leverage a wide variety of open source technologies and tools.
  • Working knowledge of cloud architecture and implementation on Azure or AWS, is a big plus. Experience with serverless computing, creating VMs, cloud security, and other cloud services is also a big plus.
  • Experience working in an Agile methodology. Experience working with JIRA is a plus.
Compensation Statement

The Mount Sinai Health System (MSHS) provides salary ranges that comply with the New York City Law on Salary Transparency in Job Advertisements. The salary range for the role is $90,000.00 - $135,285.00 Annually. Actual salaries depend on a variety of factors, including experience, education, and operational need. The salary range or contractual rate listed does not include bonu

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer III - Digital and Technology Partners - Hybrid/Remote
Data Engineer III - Digital and Technology Partners - Hybrid/Remote

Mount Sinai • New York (NY)

Hybrid
USD 150,000 - 190,000
Data Engineer II: Big Data, Cloud, & Impact (Remote)
Data Engineer II: Big Data, Cloud, & Impact (Remote)

Mount Sinai • New York (NY)

Hybrid
USD 90,000 - 135,000
Data Engineer II - Digital and Technology Partners - Hybrid/Remote
Data Engineer II - Digital and Technology Partners - Hybrid/Remote

Mount Sinai • New York (NY)

Hybrid
USD 90,000 - 135,000
Data Engineer III - Digital and Technology Partners - Hybrid/Remote
Data Engineer III - Digital and Technology Partners - Hybrid/Remote

Mount Sinai • United States

Hybrid
USD 109,000 - 164,000
Data Engineer II - Digital and Technology Partners - Hybrid/Remote
Data Engineer II - Digital and Technology Partners - Hybrid/Remote

Mount Sinai • New York (NY)

Hybrid
USD 90,000 - 135,000
Senior Data Engineer: Big Data & Streaming (Hybrid/Remote)
Senior Data Engineer: Big Data & Streaming (Hybrid/Remote)

Mount Sinai • New York (NY)

Hybrid
USD 150,000 - 190,000
Data Engineer III - Digital and Technology Partners - Hybrid/Remote
Data Engineer III - Digital and Technology Partners - Hybrid/Remote

Mount Sinai • New York (NY)

Hybrid
USD 109,000 - 164,000
Data Engineer II - Windreich Department of AI & Human Health Research (On Site)
Data Engineer II - Windreich Department of AI & Human Health Research (On Site)

Mount Sinai Health Systems • New York (NY)

On-site
USD 90,000 - 135,000
Data Engineer II - Surgery
Data Engineer II - Surgery

Mount Sinai • New York (NY)

Hybrid
USD 90,000 - 135,285
Cloud Data Operations Engineer - Technology Specialist I - Digital and Technology Partners - Hybrid/Onsite
Cloud Data Operations Engineer - Technology Specialist I - Digital and Technology Partners - Hybrid/Onsite

Mount Sinai • New York (NY)

Hybrid
USD 109,000 - 164,000