Research Data Engineer II

Rhode Island Hospital; United States; On-site; USD 100,000 - 140,000; Full time

Job summary

Brown University Health seeks a Data Engineer II to design, build, and maintain scalable data systems that enable effective decision making across the healthcare network. You will optimize data pipelines, ensure data quality, and collaborate with multiple departments to deliver robust data products for clinicians, researchers, and operations.

The role includes mentoring junior engineers, promoting data governance, and leveraging on-premise and cloud technologies to improve performance and

Qualifications

• Bachelor's Degree in STEM-related field or equivalent.
• Epic Clarity Cogito certification preferred.
• Proficient in SQL, Python, and other data tools.

Responsibilities

• Designs, builds, and maintains scalable data processing systems.
• Operates vendor and home-grown data warehouses and lakes, optimizing pipelines.
• Mentors junior engineers and collaborates across departments.

Skills

SQL

Python

Data Tools

Epic Clarity Cogito

Education

Bachelor's Degree in STEM-related field

Tools

Epic Clarity Cogito

Job description

SUMMARY

Reports to Manager, Data Architecture. The Data Engineer II is responsible for designing, building, and maintaining scalable, performant, and resilient data systems that will enable effective decision making and efficient business practices. Leads the operationalization of complex data pipelines, ensures data solutions align with business objectives. Mentors junior team members, increases organizational confidence in the validity of enterprise data sources, collaborates across departments, and leverages on premise and cloud-native technologies to deliver high performance data products. Streamlines data management processes, improving data quality, fostering collaboration, and providing a solid foundation for informed decision‑making across the entire healthcare system.

Brown University Health employees are expected to successfully role model the organization's values of Compassion, Accountability, Respect, and Excellence as these values guide our everyday actions with patients, customers and one another.

In addition to our values, all employees are expected to demonstrate the core Success Factors which tell us how we work together and how we get things done. The core Success Factors include:

• Instill Trust and Value Differences
• Patient and Community Focus and Collaborate

RESPONSIBILITIES

180165679Designs, builds, and maintains large-scale data processing systems, to ensure data pipelines are efficient, scalable, and secure. Works with multiple vendor supplied and home‑grown data warehouses and lakes to reduce data duplication and inefficiencies. Performs advanced analysis of data sources to determine their value, recommends inclusion in analytical environments. Profiles and re‑organises existing data sources that may be complex and/or disjointed. Produces solid, well‑documented data infrastructure that can be used for years with minimal upkeep. Develops completely automated data validation and data mapping rules that validate regular data source updates, map new data values, and ensure that data values have not unexpectedly changed significantly. Ensures that data validation errors are quickly identified. Performs root cause analysis for any discrepancies or anomalies and implements corrective action. Integrates and ingests information from a diverse array of sources, including clinical data, inputs from suppliers, financial transactions, applications bolstering Human Resources (HR) and other services, third‑party information, and even unstructured data from tools as ubiquitous as Excel spreadsheets and online forms. Innovates and leads the design and development of Extract, Transform, Load (ETL) processes. Evaluates and ensures the integrity of data movement, transformation code, and large datasets. Writes detailed documentation for data processes, tools, and pipelines with data users in mind. Contributes, maintains, and grows a unified data catalog and data model. Maintains a proactive engagement with organisational partners to ascertain and define new data requirements and terminologies as they emerge. Manages the mapping of common or related terms in a single, unified location. Monitors and adjusts mapping in this centralised space to improve coordination with operational partners. Proactively informs the data community about new developments and capabilities provided by the data architecture team. Designs, builds, and maintains a centralised repository of high‑quality, reliable data, to streamline the workflow of data scientists enabling them to pivot from time‑consuming tasks of building and validating datasets to the more sophisticated and impactful work of developing AI models. Mentors and guides junior engineers, fosters a culture of collaboration and continuous learning. Produces training materials on a variety of topics for use by data specialists across the organisation. Contributes to cloud migration initiatives, data infrastructure modernisation, and system optimisation efforts. Monitors analytics department capacity resources such as Microsoft cloud computing capacity. Proactively develops and implements plans to reduce analytics department capacity usage without reducing data functions through optimisation of processing techniques. Works in tandem with data governance bodies to advocate for safer, more secure, and more effective data procedures.

MINIMUM QUALIFICATIONS

• BASIC KNOWLEDGE: Bachelor's Degree in STEM‑related field or equivalent. Epic Clarity Cogito certification preferred. Proficient in Structured Query Language (SQL), Python, and other data tools.
• EXPERIENCE / SKILLS: Experience: 180160757Four years' experience in data engineering, with strong proficiency in SQL, Python, and other data tools. Experience with architecting scalable data systems and working with large, complex datasets. Experience designing and operationalising complex solutions. Experience with data modelling, ETL processes, and data pipeline optimisation. Firsthand experience with cloud platforms, d