Data Administrator

New York State Psychiatry Institute; New York (NY); On-site; USD 123,000 - 146,000; Full time

Benefits offered by this job

Excellent Benefits Package

Job summary

New York State Psychiatric Institute (NYSPI) seeks a Data Administrator - Data Flow Automation to design, build and manage automated data integration pipelines. The role focuses on moving data securely into the data warehouse, reducing manual processing, and ensuring reliability.

Reporting to the NYSPI Director of Shared Services, the position requires 4+ years in RDBMS, healthcare IT experience, and Power BI proficiency.

Qualifications

• Bachelor's degree in Computer Science or related field with at least four years in an RDBMS environment.
• 2+ years healthcare IT experience with data privacy and security.
• 12 months of BI experience with Power BI data modeling and gateway optimization.
• Production-level experience with MSSQL, Oracle, and MySQL.
• 3+ years leading enterprise job schedulers and ETL tools.
• 5+ years scripting in T-SQL, PL/SQL, Python, PowerShell, or Bash.
• 2+ years batch processing, CDC, delta loads across databases.
• 2+ years in secure, remote-first or hybrid environments.

Responsibilities

• Design, implement, and maintain scalable ETL/ELT pipelines for daily batch processing across enterprise data systems.
• Support, tune, and optimize database connectivity between MSSQL, Oracle, and MySQL environments.
• Build monitoring systems and automated error-handling routines for batch job failures.
• Troubleshoot and optimize complex SQL queries, stored procedures, and batch scheduling.
• Implement data profiling and automated validation checks to preserve data lineage.
• Create and maintain documentation on data architecture, workflow dependencies, and disaster recovery.
• Develop operational tasks and schedules to support communications with business and technical teams.

Skills

Power BI

SQL Scripting

Healthcare IT

Data Integration

ETL/ELT

Python

Automation

SQL Server

Oracle DB

MySQL

Education

Bachelor's degree in Computer Science or related field

Tools

MSSQL (SQL Server)

Oracle Database

MySQL

Cron

Apache Airflow

Power BI Gateway

Job description

Job Title: Data Administrator

Grade: 30

Salary: $122,938-$146,330

The Research Foundation for Mental Hygiene, Inc is looking for a qualified candidate to fill the position Data Administrator - Data Flow Automation (Healthcare IT) within the New York State Psychiatric Institute (NYSPI), an institution which provides top-notch, world-wide clinical, educational, and psychiatric research services. Affiliated with both the Columbia University Medical Center and New York State Office of Mental Health and located adjacent to the Columbia University Medical Center and New York Presbyterian Hospital in upper Manhattan, NYSPI programs seek to continue to lead in neurological and psychiatric discovery and care.

Reporting to the NYSPI Director of Shared Services, the Data Administrator - Data Flow Automation (Healthcare IT) will design, build, optimize and manage our automated data integration infrastructure. In this role, you will maintain seamless, automated data pipelines across our organization and eliminate manual data handling by ensuring data moves accurately and securely from various internal and external sources into our data warehouse.

Duties and Responsibilities:

• Data Flow Automation: Design, implement, and maintain scalable, automated ETL/ELT pipelines for daily batch processing across enterprise data systems.
• Multi-Platform Administration: Support, tune, and optimize database connectivity and data movement between MSSQL, Oracle, and MySQL environments.
• Pipeline Monitoring & Alerts: Build proactive monitoring systems and automated error-handling routines (e.g., email alerts, automated fail-overs) to identify and remediate batch job failures immediately.
• Performance Tuning: Troubleshoot and optimize complex SQL queries, stored procedures, and batch scheduling to minimize processing windows and ensure high availability.
• Data Reliability & Quality: Implement data profiling and automated validation checks within the pipelines to preserve data lineage and guarantee data accuracy.
• Documentation: Create and maintain comprehensive documentation regarding data architecture, workflow dependencies, orchestration schedules, and disaster recovery procedures.
• Project planning and communication: Develop operational project tasks and schedules to support communications with business teams, technical teams and other project participants. Minimum Qualifications:
• Bachelor's Degree or higher in Computer Science or related software development field with at least four years related experience in a Relational Database Management System (RDBMS) environment.
• Healthcare IT Experience: At least 2 full-time years professional experience in healthcare IT systems, with a strong understanding of health data workflows, clinical data storage, healthcare data privacy and security requirements and healthcare operations.
• BI and Visualization: Proficiency with Power BI, including data modeling, connecting to disparate data sources, and optimizing gateway connections for automated refreshes, including at least 12 months experience developing customer-facing BI solutions.
• Database Expertise: Comprehensive, production-level experience administering and querying MSSQL (SQL Server), Oracle Database, and MySQL without relying on general database administrator accesses.
• Automation & Orchestration: At least 3 years leading design and operation of enterprise job schedulers, ETL tools, or workflow management platforms (e.g., SQL Server Agent, Cron, Apache Airflow, or similar automation tools).
• Scripting Skills: At least 5 years experience writing advanced script automation using T-SQL, PL/SQL, Python, PowerShell, and/or Bash to handle data ingestion, structural validation, and file manipulation.
• Data Integration Patterns: At least 2 years experience managing batch processing mechanics, change data capture (CDC), delta loads, and managing connectivity across disparate database platforms (via linked servers, DB links, or API endpoints).
• Environment Experience: At least 2 years professional experience operating in secure environments, managing cross-platform credentials, and supporting remote-first or hybrid operational architectures.

Preferred Qualifications:

• Verifiable professional experience building or supporting projects with healthcare interoperability standards, such as FHIR and HL7, and data formats (e.g.,HIPAA compliance frameworks).
• At least 1-year professional experience writing DAX or Power Query (M) formulas for advanced Power BI transformations.
• At least 1-year professional experience supporting institutional research, medical analytics, or complex clinical reporting systems.

Work Location:

1051 Riverside Drive, New York, NY 10032

The Mission of the Research Foundation for Mental Hygiene, Inc. (RFMH) is to promote the mental health of all New Yorkers, with a focus on providing hope and supporting recovery for adults with serious mental illness and children with serious emotional disturbances. Applicants with lived mental health experience are encouraged to apply. RFMH is deeply committed to supporting underserved individuals, organizations, and communities. To this end, RFMH is focused on implementing activities and initiatives to reduce disparities in access, quality, and treatment outcomes for underserved populations. A critical component of these efforts is ensuring that RFMH is a diverse and inclusive workplace where all employees' unique attributes and skills are valued and utilized to support the mission of the Agency. RFMH is an equal opportunity/affirmative action employer.

The Research Foundation is a private not-for-profit corporation and is not an agency or instrumentality of the State of New York. Employees of the Research Foundation are not state employees, do not participate in any state retirement system, and do not receive state fringe benefits. Excellent Benefits Package. Aff