Data Engineer

Joint Commission; Kentucky; On-site; USD 107,000 - 143,000; Full time

Benefits offered by this job

Comprehensive benefits package

Job summary

Joint Commission is seeking a Data Engineer to design, build, and optimize enterprise data pipelines and platforms in a cloud-first environment. You will create scalable data assets that support reporting, analytics, and operations across teams.

Collaborating with analytics, BI, and business units, you will translate requirements into robust data architectures, enforce governance and security, and ensure data quality from ingestion to insight across lakes, lakehouses, and warehouses.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field.
• 5–7 years of experience in data engineering, ETL/ELT development, or cloud data platforms.
• Hands-on experience with Azure Data Factory, Databricks, Microsoft Fabric, and MSSQL.
• Strong knowledge of data lake, lakehouse, and data warehouse architectures.
• Proficiency in SQL and Python; familiarity with cloud platforms and big data technologies.
• Ability to diagnose data issues, optimize performance, and work with cross-functional teams.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Foundry, and Microsoft Fabric.
• Build and optimize data ingestion, transformation, and integration processes across structured and unstructured data sources.
• Develop and support data lakes, lakehouses, and data warehouse environments using MSSQL and cloud-native platforms.
• Implement ETL/ELT best practices to ensure performance, reliability, and data quality.
• Automate data workflows and monitor pipeline health; identify and resolve issues promptly.
• Work closely with analytics, BI, and business teams to understand data requirements and translate them into technical solutions.
• Contribute to documentation of data structures, transformation logic, and system dependencies.

Skills

SQL

Python

ETL/ELT

Data modeling

Data governance

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Databricks

Microsoft Fabric

MSSQL

Job description

The Data Engineer is responsible for designing, developing, and optimizing enterprise data pipelines and data platforms. This role focuses on building scalable, efficient, and secure data solutions using modern cloud technologies. The engineer collaborates with analytics, BI, and business teams to transform requirements into reliable data assets that support reporting, analytics, and operational needs.

Responsibilities

Data Engineering & Pipeline Development

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Foundry, and Microsoft Fabric.
• Build and optimize data ingestion, transformation, and integration processes across structured and unstructured data sources.
• Develop and support data lakes, lakehouses, and data warehouse environments using MSSQL and cloud-native platforms.
• Implement ETL/ELT best practices to ensure performance, reliability, and data quality.
• Automate data workflows and monitor pipeline health; identify and resolve issues promptly.

Collaboration & Solution Delivery

• Work closely with analytics, BI, and business teams to understand data requirements and translate them into technical solutions.
• Partner with cross-functional teams to support data-driven initiatives and ensure pipelines align with reporting and operational needs.
• Contribute to documentation of data structures, transformation logic, and system dependencies.

Technology Enablement & Best Practices

• Contribute to evaluating and adopting new tools, frameworks, and technologies that enhance data engineering efficiency and scalability.
• Follow standards for code quality, testing, version control, and documentation.
• Apply data governance, quality, and reliability principles in daily engineering work.

Business Intelligence & Analytics Support

• Build reusable data models and curated datasets to enable self-service analytics.
• Ensure downstream BI teams receive accurate, well-structured, and timely data.
• Transform business requirements into scalable and maintainable technical designs.

Compliance & Security

• Ensure data engineering solutions align with privacy regulations such as GDPR and HIPAA, as well as internal security requirements.
• Maintain proper data access controls and contribute to monitoring data quality and compliance metrics.

Requirements

Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field.

• 5–7 years of experience in data engineering, ETL/ELT development, or cloud data platforms.
• Hands‑on experience with Azure Data Factory, Databricks, Microsoft Fabric, and MSSQL.
• Strong knowledge of data lake, lakehouse, and data warehouse architectures.
• Solid understanding of ETL/ELT processes, data modeling, and metadata management.
• Proficiency in SQL and Python; familiarity with cloud platforms and big data technologies.
• Ability to diagnose data issues, optimize performance, and work with cross‑functional technical and business teams.

Preferred Certifications

• Microsoft Certified: Azure Data Engineer Associate
• Databricks Certified Data Engineer
• Certifications related to data governance, risk, or compliance
• Master’s degree in Computer Science, Information Systems, or related fields

Joint Commission offers a comprehensive benefits package. For an overview of our benefits package, please visit our Joint Commission Career Page

This job description is intended to describe the general nature and level of work performed by an employee assigned to this position. The description is not an exhaustive list of all duties, responsibilities, knowledge, skills and abilities, and working conditions associated with this position. All requirements are subject to possible modification due to business needs and/or reasonable accommodations for individuals with disabilities.

MIN $107,000.00

MAX $143,000.00

We are an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other status protected by law.