Data Engineering Tech Lead
OhioHealth
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
OhioHealth is seeking an experienced Lead Data Engineer to oversee the data platform, focusing on Informatica ETL and Azure cloud tech. You will guide architecture, development, and maintenance, ensuring data quality and security, and lead reviews with architects and peers.
As a technical leader, you will collaborate with analysts, vendors, and IT teams to deliver complex applications, APIs, and data services, enabling secure access to RDBMS and NoSQL stores.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Information, or a related field.
- Minimum 12–15 years of experience in data engineering with ETL and Cloud tech.
- Proficiency in Informatica ETL tools, SQL, and Azure Cloud platforms.
- Experience in Informatica IDMC design/development; familiarity with MDM architecture/ Data Flow.
- Experience migrating data platforms to Databricks and Microsoft Fabric.
- Hands-on Azure-based data pipelining, scheduling, monitoring; PySpark pipelines.
- Strong Big Data experience (Spark, Databricks) on Azure and on-prem.
- Proficiency in database and data warehouse development; ETL, stored procedures, data cubes.
- Backend programming with Python; analytics tooling with Databricks/Azure Fabric.
- Experience designing, developing, testing, delivering complex software (Java, Python, PySpark).
- Excellent debugging, troubleshooting, and analytical skills.
- Ability to work in Agile environments; cross-functional collaboration.
Responsibilities
- 15% Collaboration: advise on architecture, review designs, and enforce integrity of the environment.
- 15% Functional SME: advocate for software applications and supported capabilities.
- 30% Technical Expertise: serve as deep technical expert for applications.
- 10% Vendor Management: validate technical aspects with vendors and track metrics.
- 30% Operations: coordinate with stakeholders on ITIL processes, incident response, and release management.
Skills
Education
Tools
Job description
We are more than a health system. We are a belief system. We believe wellness and sickness are both part of a lifelong partnership, and that everyone could use an expert guide. We work hard, care deeply and reach further to help people uncover their own power to be healthy. We inspire hope. We learn, grow, and achieve more – in our careers and in our communities.
Looking for an experienced Lead Data Engineer with background in Informatica ETL and Cloud technologies. In this senior role, tech lead will be responsible for overseeing the architecture, development, and maintenance of our data platform, ensuring data quality and efficiency.
Serves as the primary subject matter expert within their respective Information Technology team, with deep knowledge of the applications and technology that their team is responsible for.
Collaborates with the business analysts, architects, vendor partners, and other teams across the IT organization to deliver complex applications and services.
Provides technical expertise by enforcing the vision of the application or service architecture and safeguarding the integrity and security of the application environment in collaboration and partnership with architects and other tech leads.
In addition, the incumbent will lead code or design reviews, analyze results, and make a recommendation to deliver quality products.
Project work may include application development, API tooling, and system design to enable external applications with database secure access to RDBMS or No SQL, and related tasks.
15% Collaboration - Works with architects, Business Analysts, Product Owners, and peers providing technical expertise by enforcing the vision of the application architecture and safeguarding the integrity of the application environment. Reviews and provides input into architectural designs and requirements.
15% Functional Subject Matter Expertise - Functions as a subject matter expert and advocate for the software applications supported.
30% Technical Expertise - Serves as the deep technical expert for the applications supported by team.
- Support cross team technical collaboration
- Identify risks and design contingency plans
- Analyze existing operations and evaluate options for improvements
- Conduct security audits to identify areas of improvement
- Guides their teams through technical issues and challenges
- Assists with designing the governance, quality assurance and standards activities associated with ensuring technology architecture compliance of projects and products.
- Leads technology change to deliver business outcomes while also virtually leveraging subject matter experts from any other needed technical area.
- Oversees, or consults on, technology implementation and modification activities (for example, projects and products), particularly for new or shared solutions.
- Creates and delivers working, production-ready IT services that can be easily leveraged by agile teams
- Adaptability to new and emerging technology, oversees PoCs
- Provides the detailed designs, reviews the implementation by the developers, ensures quality, and best practices such as automated unit tests, integration tests, continuous integration
- Technical Documentation - Creates, reviews, and approves technical documentation for applications supported
- Technology Strategy - Leads the development of technology strategy and roadmap within a given area of specialty including design, documentation, communication, and implementation of new or existing standards for infrastructure technologies while remaining current on industry trends
10% Vendor Management - Works with 3rd party vendors to validate technical aspects and assess feasibility concerns and develop reporting metrics, dashboards, and status reporting to drive outcomes and meet expectations for quality and performance
30% Operations - Works with internal customers and 3rd party vendors to communicate, coordinate, manage expectations, approve, and assist with operational processes such as crisis management, support escalation, change management, release management, capacity management, and other ITIL processes. Research and Analysis - Analyzes, plans, justifies, schedules, and coordinates the implementation and maintenance of the specialty area’s administrative, operational, and financial initiatives including TCO, optimization, and efficiency
As a High Reliability Organization (HRO), responsibilities require focus on safety, quality and efficiency in performing job duties.
The job profile provides an overview of responsibilities and duties and is not intended to be an exhaustive list and is subject to change at any time.
Bachelor's Degree: Computer and Information Science
- Bachelor’s or Master’s degree in Computer Science , Information, or a related field.
- Minimum of 12 – 15 years of experience in data engineering, with a focus on ETL and Cloud technologies (can be less than 10 years )
- Proficiency in Informatica ETL tools, SQL, and Azure Cloud platforms (preferably Azure but others acceptable)
- Experience in Informatica IDMC - Architect, Design and develop ETL processes on IDMC and Informatica suite of tools. Familiarity with MDM Architecture and Data Flow
- Experience in potential migration from existing data platforms to Databricks, Microsoft Fabric
- Must have working experience with Azure based Data Pipelining, Scheduling and Monitoring and pyspark with ability to debug troublesome pipelines. Must have hands on expertise dealing with data pipelines
- Strong working experience with Big Data technologies (Spark, Data Bricks) for Data integration, & processing (ingestion, transformation, curation, etc), preferably on Azure cloud, and a clear understanding of how the resources work and integrate with cloud and on-prem.
- High level of proficiency with database and data warehouse development, including replication, staging, ETL, stored procedures, partitioning, change data capture, triggers, scheduling tools, cubes, and datamarts.
- Experience working with backend languages such as Python.
- Strong computer literacy and proficiency in data manipulation using Analytics tools/platform like Databricks, Azure Fabric using Spark engine
- Expertise in at least one technology stack designing, developing, testing, and/or delivering complex software (i.e., Java, Python, Pyspark)
- Excellent debugging, troubleshooting, and analytical skills
- Strong analytical and problem-solving skills with the ability to own, troubleshoot and resolve complex data issues
- Collaborate with Architects and Managers to develop Metrics & KPI’s
- Identify any technical risks and forming contingency plans as soon as possible
- Good communication and collaboration skills to work effectively with cross-functional teams.
- Experience working in an Agile development environment preferred
- Experience building data pipelines to support ML workflows a plus
- Experience working with geographically distributed teams (different time zones)
- Proficiency in Informatica ETL tools, SQL, and Azure Cloud platforms (preferably Azure but others acceptable)
- Experience in Informatica IDMC - Architect, Design and develop ETL processes on IDMC and Informatica suite of tools. Familiarity with MDM Architecture and Data Flow
- Experience in potential migration from existing data platforms to Databricks, Microsoft Fabric
- Must have working experience with Azure based Data Pipelining, Scheduling and Monitoring and pyspark with ability to debug troublesome pipelines. Must have hands on expertise dealing with data pipelines
- Strong working experience with Big Data technologies (Spark, Data Bricks) for Data integration, & processing (ingestion, transformation, curation, etc), preferably on Azure cloud, and a clear understanding of how the resources work and integrate with cloud and on-prem.
- High level of proficiency with database and data warehouse development, including replication, staging, ETL, stored procedures, partitioning, change data capture, triggers, scheduling tools, cubes, and datamarts.
- Experience working with backend languages such as Python.
- Strong computer literacy and proficiency in data manipulation using Analytics tools/platform like Databricks, Azure Fabric using Spark engine
- Expertise in at least one technology stack designing, developing, testing, and/or delivering complex software (i.e., Java, Python, Pyspark)
- Is adaptable to new technology
- Forward-thinking, with ability to be strategic when looking at future technologies
- Possesses a continuous-learner mindset
- Ability to estimate the financial impact of technology alternatives
- Ability to quickly comprehend the functions and capabilities of existing, new, and emerging technologies that enable and drive new business designs and models
- Demonstrated ability to work well with others and be respected as a leader
Work Shift:
Day
40
IT Data Platform and Data Science
Join us!
... if your passion is to work in a caring environment
... if you believe that learning is a life-long process
... if you strive for excellence and want to be among the best in the healthcare industry
Equal Employment Opportunity
OhioHealth is an equal opportunity employer and fully supports and maintains compliance with all state, federal, and local regulations. OhioHealth does not discriminate against associates or applicants because of race, color, genetic information, religion, sex, sexual orientation, gender identity or expression, age, ancestry, national origin, veteran status, military status, pregnancy, disability, marital status, familial status, or other characteristics protected by law. Equal employment is extended to all person in all aspects of the associate-employer relationship including recruitment, hiring, training, promotion, transfer, compensation, discipline, reduction in staff, termination, assignment of benefits, and any other term or condition of employment
Positions marked as remote are only eligible for work from Ohio .
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
