Hybrid Data Engineer: Lakehouse & Pipelines

American College Of Physicians; Philadelphia (Philadelphia County); Hybrid; USD 110,000 - 150,000; Full time

Job summary

The American College of Physicians (ACP) is seeking a Data Engineer to join the Technology division in Philadelphia. This full-time hybrid role requires 2 days in-office per week at the Philadelphia HQ and centers on building enterprise data pipelines, a data lakehouse, and activation platforms that power data-driven decision-making.

You will drive pipeline design, governance, and documentation while collaborating across analytics, development, and data governance teams to deliver reliable,

Qualifications

• Bachelor's degree required in a related field (CS/Software/Systems/Data Science).
• 3+ years designing and developing data pipelines in modern data environments.
• Experience with large-scale customer/behavioral data models (e.g., Customer 360) desired.
• Strong SQL and Python coding skills.
• Experience with data lakehouse architectures and real-time/streaming processes (Kafka).
• Experience with Snowflake, dbt, Fivetran, and cloud architectures (AWS/Azure).
• Excellent verbal and written communication across staff and external resources.

Responsibilities

• Lead enterprise data pipeline design and development, focusing on ingestion, transformations, and activation platforms via the data lakehouse.
• Ensure designs comply with data governance and architecture standards.
• Collaborate with development, analytics, and data administration teams using agile processes.
• Document data models, transformations, and orchestration for staff access.
• Partner with stakeholders to optimize pipelines for quality, reliability, and actionability.
• Contribute to enterprise data architecture design and liaison with consultants/contractors.
• Monitor data systems and pipelines with automated tooling to ensure reliability.

Skills

SQL

Python

Data engineering

ETL/ELT

Apache Kafka

Cloud architectures

Communication

Education

Bachelor's degree (CS/SE/Data Science)

Tools

Snowflake

dbt

Fivetran

Cortex Code (CoCo)

Semantic Views

Job description

The American College of Physicians (ACP) is seeking a Data Engineer to join the Technology division in Philadelphia. This full-time hybrid role requires 2 days in-office per week at the Philadelphia HQ and centers on building enterprise data pipelines, a data lakehouse, and activation platforms that power data-driven decision-making.

You will drive pipeline design, governance, and documentation while collaborating across analytics, development, and data governance teams to deliver reliable,