Data Engineer: Pipelines, Modeling & Analytics

Katalyst CRO; Warrendale (Allegheny County); On-site; USD 100,000 - 150,000; Full time

Job summary

Katalyst CRO is seeking a data engineer to design and implement robust ingestion pipelines from APIs, databases, files, and streaming sources. The role includes supporting C4C offline migrations and integrating data into centralized platforms.

The candidate will design data models for workforce planning, forecast service operations, and develop optimized schemas for reporting and analytics, ensuring data quality and consistency across models.

Qualifications

• Strong experience in data engineering and pipeline development.
• Proficiency in Python and SQL with hands-on Spark experience.
• Bachelor's or Master's in CS/IT or related field.

Responsibilities

• Design and implement robust data ingestion pipelines from APIs, databases, files, and streaming sources.
• Support C4C offline database migration with data accuracy and consistency.
• Integrate data from enterprise systems into centralized data platforms.
• Design and implement data models for workforce planning.
• Forecast service operations.
• Develop optimized schemas for reporting and analytics.
• Ensure data quality, integrity, and consistency across models.

Skills

Data engineering

Pipeline development

Python

SQL

Apache Spark

ETL/ELT

Data warehousing

Independent work

Cross-functional teamwork

Education

Bachelor's or Master's in Computer Science / IT

Tools

Jenkins

GitHub Actions

AWS

Azure

GCP

Job description

Katalyst CRO is seeking a data engineer to design and implement robust ingestion pipelines from APIs, databases, files, and streaming sources. The role includes supporting C4C offline migrations and integrating data into centralized platforms.

The candidate will design data models for workforce planning, forecast service operations, and develop optimized schemas for reporting and analytics, ensuring data quality and consistency across models.