Data Engineering Tech Lead

Berger Health System; Northern (KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

OhioHealth is seeking an experienced Data Engineering Tech Lead to oversee the data platform architecture and ETL development in a cloud-centric environment. You will act as SME within IT and collaborate across vendors, analysts, and architects to deliver complex data services.

The role emphasizes data quality, security, and scalable pipelines using Informatica, IDMC, Spark, and Databricks on Azure Cloud, with a strong focus on leadership and governance.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information, or related field.
• 12–15 years of data engineering experience with ETL and cloud tech.
• Proficiency in Informatica ETL, SQL, and Azure cloud platforms.
• Experience with IDMC, Databricks, and data pipelines on Azure.

Responsibilities

• Lead architecture, development and maintenance of the data platform.
• Mentor team; review designs and enforce architectural vision.
• Collaborate with analysts, vendors and IT teams to deliver complex data solutions.
• Ensure data quality, security and efficient data processing.

Skills

Informatica ETL

SQL

Azure Cloud

Python

Spark

Databricks

Education

Bachelor's or Master's degree in Computer Science / Information

Bachelor's Degree in Computer and Information Science

Tools

Informatica IDMC

Databricks

Microsoft Fabric

Job description

## Data Engineering Tech LeadApplylocations: WORK AT HOME - OHIOtime type: Full timeposted on: Posted Todayjob requisition id: JR151863**We are more than a health system. We are a belief system.** We believe wellness and sickness are both part of a lifelong partnership, and that everyone could use an expert guide. We work hard, care deeply and reach further to help people uncover their own power to be healthy. We inspire hope. We learn, grow, and achieve more – in our careers and in our communities.**Job Description Summary:**Looking for an experienced Lead Data Engineer with background in Informatica ETL and Cloud technologies. In this senior role, tech lead will be responsible for overseeing the architecture, development, and maintenance of our data platform, ensuring data quality and efficiency. Serves as the primary subject matter expert within their respective Information Technology team, with deep knowledge of the applications and technology that their team is responsible for. Collaborates with the business analysts, architects, vendor partners, and other teams across the IT organization to deliver complex applications and services. Provides technical expertise by enforcing the vision of the application or service architecture and safeguarding the integrity and security of the application environment in collaboration and partnership with architects and other tech leads. In addition, the incumbent will lead code or design reviews, analyze results, and make a recommendation to deliver quality products. Project work may include application development, API tooling, and system design to enable external applications with database secure access to RDBMS or No SQL, and related tasks.**Responsibilities And Duties:**15% Collaboration - Works with architects, Business Analysts, Product Owners, and peers providing technical expertise by enforcing the vision of the application architecture and safeguarding the integrity of the application environment. Reviews and provides input into architectural designs and requirements. 15% Functional Subject Matter Expertise - Functions as a subject matter expert and advocate for the software applications supported. 30% Technical Expertise - Serves as the deep technical expert for the applications supported by team. - Support cross team technical collaboration - Identify risks and design contingency plans - Analyze existing operations and evaluate options for improvements - Conduct security audits to identify areas of improvement - Guides their teams through technical issues and challenges - Assists with designing the governance, quality assurance and standards activities associated with ensuring technology architecture compliance of projects and products. - Leads technology change to deliver business outcomes while also virtually leveraging subject matter experts from any other needed technical area. - Oversees, or consults on, technology implementation and modification activities (for example, projects and products), particularly for new or shared solutions. - Creates and delivers working, production-ready IT services that can be easily leveraged by agile teams - Adaptability to new and emerging technology, oversees PoCs - Provides the detailed designs, reviews the implementation by the developers, ensures quality, and best practices such as automated unit tests, integration tests, continuous integration - Technical Documentation - Creates, reviews, and approves technical documentation for applications supported - Technology Strategy - Leads the development of technology strategy and roadmap within a given area of specialty including design, documentation, communication, and implementation of new or existing standards for infrastructure technologies while remaining current on industry trends 10% Vendor Management - Works with 3rd party vendors to validate technical aspects and assess feasibility concerns and develop reporting metrics, dashboards, and status reporting to drive outcomes and meet expectations for quality and performance 30% Operations - Works with internal customers and 3rd party vendors to communicate, coordinate, manage expectations, approve, and assist with operational processes such as crisis management, support escalation, change management, release management, capacity management, and other ITIL processes. Research and Analysis - Analyzes, plans, justifies, schedules, and coordinates the implementation and maintenance of the specialty area’s administrative, operational, and financial initiatives including TCO, optimization, and efficiency As a High Reliability Organization (HRO), responsibilities require focus on safety, quality and efficiency in performing job duties. The job profile provides an overview of responsibilities and duties and is not intended to be an exhaustive list and is subject to change at any time**Minimum Qualifications:**Bachelor's Degree: Computer and Information Science**Additional Job Description:*** Bachelor’s or Master’s degree in Computer Science , Information, or a related field.* Minimum of 12 – 15 years of experience in data engineering, with a focus on ETL and Cloud technologies (can be less than 10 years )* Proficiency in Informatica ETL tools, SQL, and Azure Cloud platforms (preferably Azure but others acceptable)* Experience in Informatica IDMC - Architect, Design and develop ETL processes on IDMC and Informatica suite of tools. Familiarity with MDM Architecture and Data Flow* Experience in potential migration from existing data platforms to Databricks, Microsoft Fabric* Must have working experience with Azure based Data Pipelining, Scheduling and Monitoring and pyspark with ability to debug troublesome pipelines. Must have hands on expertise dealing with data pipelines* Strong working experience with Big Data technologies (Spark, Data Bricks) for Data integration, & processing (ingestion, transformation, curation, etc), preferably on Azure cloud, and a clear understanding of how the resources work and integrate with cloud and on-prem.* High level of proficiency with database and data warehouse development, including replication, staging, ETL, stored procedures, partitioning, change data capture, triggers, scheduling tools, cubes, and datamarts.* Experience working with backend languages such as Python.* Strong computer literacy and proficiency in data manipulation using Analytics tools/platform like Databricks, Azure Fabric using Spark engine* Expertise in at least one technology stack designing, developing, testing, and/or delivering complex software (i.e., Java, Python, Pyspark)* Excellent debugging, troubleshooting, and analytical skills* Strong analytical and problem-solving skills with the ability to own, troubleshoot and resolve complex data issues* Collaborate with Architects and Managers to develop Metrics & KPI’s* Identify any technical risks and forming contingency plans as soon as possible* Good communication and collaboration skills to work effectively with cross-functional teams.* Experience working in an Agile development environment preferred* Experience building data pipelines to support ML workflows a plus* Experience working with geographically distributed teams (different time zones)**SPECIALIZED KNOWLEDGE*** Proficiency in Informatica ETL tools, SQL, and Azure Cloud platforms (preferably Azure but others acceptable)* Experience in Informatica IDMC - Architect, Design and develop ETL processes on IDMC and Informatica suite of tools. Familiarity with MDM Architecture and Data Flow* Experience in potential migration from existing data platforms to Databricks, Microsoft Fabric* Must have working experience with Azure based Data Pipelining, Scheduling and Monitoring and pyspark with ability to debug troublesome pipelines. Must have hands on expertise dealing with data pipelines* Strong working experience with Big Data technologies (Spark, Data Bricks) for Data integration, & processing (ingestion, transformation, curation, etc), preferably on Azure cloud, and a clear understanding of how the resources work and integrate with cloud and on-prem.* High level of proficiency with database and data warehouse development, including replication, staging, ETL, stored procedures, partitioning, change data capture, triggers, scheduling tools, cubes, and datamarts.* Experience working with backend languages such as Python.* Strong computer literacy and proficiency in data manipulation using Analytics tools/platform like Databricks, Azure Fabric using Spark engine* Expertise in at least one technology stack designing, developing, testing, and/or delivering complex software (i.e., Java, Python, Pyspark) **DESIRED ATTRIBUTES:*** Is adaptable to new technology* Forward-thinking, with ability to be strategic when looking at future technologies* Possesses a continuous-learner mindset* Ability to estimate the financial impact of technology alternatives* Ability to quickly comprehend the functions and capabilities of existing, new, and emerging technologies that enable and drive new business designs and models* Demonstrated ability to work well with others and be respected as a leader**Work Shift:**Day**Scheduled Weekly Hours :**40**Department**IT Data Platform and Data ScienceJoin us! ... if your passion is to work in a caring environment ... if you believe that learning is a life-long process ... if you strive for excellence and want to be among the best in the healthcare industryEqual Employment OpportunityOhioHealth is an equal opportunity employer and fully supports and maintains compliance with all state, federal, and local regulations. OhioHealth does not discriminate against associates or applicants because of race, color, genetic information, religion, sex, sexual orientation, gender identity or expression, age, ancestry, national origin, veteran status, military status, pregnancy, disability, marital status, familial status, or other characteristics protected by law. Equal employment is extended to all person in all aspects of the associate-employer relationship including recruitment, hiring, training, promotion, transfer, compensation, discipline, reduction in staff, termination, assignment of benefits, and any other term or condition of employment