Data Engineer (Data Pipelines & Modeling)

Katalyst CRO; Warrendale (Allegheny County); On-site; USD 100,000 - 150,000; Full time

Job summary

Katalyst CRO is seeking a data engineer to design and implement robust ingestion pipelines from APIs, databases, files, and streaming sources. The role includes supporting C4C offline migrations and integrating data into centralized platforms.

The candidate will design data models for workforce planning, forecast service operations, and develop optimized schemas for reporting and analytics, ensuring data quality and consistency across models.

Qualifications

• Strong experience in data engineering and pipeline development.
• Proficiency in Python and SQL with hands-on Spark experience.
• Bachelor's or Master's in CS/IT or related field.

Responsibilities

• Design and implement robust data ingestion pipelines from APIs, databases, files, and streaming sources.
• Support C4C offline database migration with data accuracy and consistency.
• Integrate data from enterprise systems into centralized data platforms.
• Design and implement data models for workforce planning.
• Forecast service operations.
• Develop optimized schemas for reporting and analytics.
• Ensure data quality, integrity, and consistency across models.

Skills

Data engineering

Pipeline development

Python

SQL

Apache Spark

ETL/ELT

Data warehousing

Independent work

Cross-functional teamwork

Education

Bachelor's or Master's in Computer Science / IT

Tools

Jenkins

GitHub Actions

AWS

Azure

GCP

Job description

Responsibilities

• Design and implement robust data ingestion pipelines from multiple sources (APIs, databases, files, streaming systems).
• Support C4C offline database migration, ensuring data accuracy and consistency.
• Integrate data from enterprise systems into centralized data platforms.
• Design and implement data models for Workforce planning.
• Service operations forecasting.
• Develop optimized schemas for reporting and analytics.
• Ensure data quality, integrity, and consistency across models.

Requirements

• Strong experience in data engineering and pipeline development.
• Proficiency in Python / SQL.
• Hands-on experience with Apache Spark or similar big data tools.
• Strong understanding of ETL/ELT concepts and data warehousing.
• Ability to work independently and in cross-functional teams.
• Bachelor's / Master's in Computer Science, IT, or related field.

Good to Have

• Exposure to CI/CD tools like Jenkins or GitHub Actions.
• Knowledge of cloud platforms (AWS / Azure / GCP).
• Experience in healthcare or regulated environments.