Data Engineer - ETL & Lakehouse Pipelines

International Business Machines Corporation; United States; À distance; USD 110 000 - 150 000; Plein temps

Avantages offerts par ce poste

Healthcare benefits

Paid time off

Résumé du poste

IBM Quantum is seeking a Data Engineer to design and operate data pipelines powering analytics on quantum hardware performance, reliability, workloads, and platform ops. You will collaborate with hardware, firmware, cloud, and product teams to turn diverse datasets into trusted analytics assets guiding IBM Quantum’s roadmap.

You will build scalable ETL/ELT workflows, leverage SQL (PostgreSQL, Presto), and run orchestration with Airflow, while integrating telemetry, logs, and user activity into a

Qualifications

• Experience designing scalable data pipelines for analytics and hardware insights.
• Experience building data connectors for Lakehouse architectures.
• Strong SQL skills and performance tuning.
• Experience with ETL/ELT workflows and data quality.

Responsabilités

• Design and implement ETL processes for data transfer.
• Build and maintain data pipelines for analytics and telemetry.
• Monitor and troubleshoot data integration issues.
• Collaborate with hardware, software, and analytics teams.

Connaissances

ETL pipelines

SQL

PostgreSQL

Presto/Trino

Airflow

Python

Kafka

Data integration

Data quality

Formation

Bachelor's degree

Master's degree

Outils

IBM watsonx.data

Apache Spark

Docker

Kubernetes

Git

ETL tooling

Description du poste

IBM Quantum is seeking a Data Engineer to design and operate data pipelines powering analytics on quantum hardware performance, reliability, workloads, and platform ops. You will collaborate with hardware, firmware, cloud, and product teams to turn diverse datasets into trusted analytics assets guiding IBM Quantum’s roadmap.

You will build scalable ETL/ELT workflows, leverage SQL (PostgreSQL, Presto), and run orchestration with Airflow, while integrating telemetry, logs, and user activity into a