ETL Data Integration Engineer – Quantum Analytics

International Business Machines Corporation; Town of Yorktown (NY); On-site; USD 120,000 - 155,000; Full time

Job summary

IBM Quantum is seeking a Data Engineer to design and operate data pipelines powering analytics on quantum hardware performance, reliability, and platform operations. You will collaborate with hardware, firmware, cloud, and product teams to turn diverse data into trusted insights guiding IBM Quantum's roadmap.

The role focuses on data integration, ETL/ELT workflows, and scalable lakehouse components. Strong SQL (PostgreSQL/Presto), Python (pandas), and Airflow are essential.

Qualifications

• Design, build, and maintain scalable data pipelines for analytics and hardware insights.
• Contribute towards building IBM Quantum’s Lakehouse by implementing scalable data connectors.
• Develop and operate ETL/ELT workflows with focus on data quality, timeliness, and continuous improvement.
• Apply advanced SQL skills using PostgreSQL and Presto to support analytical workloads.
• Build and operate orchestration workflows in Apache Airflow with dependency management and monitoring.
• Implement data transformations using Python (e.g., pandas).
• Support large-scale batch processing for heterogeneous datasets including telemetry and logs.
• Work with streaming platforms such as Apache Kafka to consume event-driven data.

Responsibilities

• Design Data Integration Solutions: Create and implement ETL processes to transfer data between environments.
• Develop ETL Processes: Build and maintain efficient ETL processes to ensure accurate and timely data flow.
• Ensure Seamless Data Flow: Monitor and troubleshoot data integration issues with stakeholders.
• Optimize Data Integration Solutions: Continuously evaluate and improve data integration for efficiency gains.

Skills

ETL design

SQL

Apache Airflow

Python

Pandas

Data pipelines

Data integration

Education

Master's Degree

Tools

IBM watsonx.data

Presto/Trino

Apache Spark

Apache Kafka

Git

Job description

IBM Quantum is seeking a Data Engineer to design and operate data pipelines powering analytics on quantum hardware performance, reliability, and platform operations. You will collaborate with hardware, firmware, cloud, and product teams to turn diverse data into trusted insights guiding IBM Quantum's roadmap.

The role focuses on data integration, ETL/ELT workflows, and scalable lakehouse components. Strong SQL (PostgreSQL/Presto), Python (pandas), and Airflow are essential.