Data Engineer - GCP Pipeline & BigQuery Expert

Quantum Technologies. LLC; Woodbridge Township (NJ); On-site; USD 90,000 - 130,000; Full time

Job summary

Quantum Technologies LLC seeks an experienced Data Engineer with strong hands-on expertise in GCP, PySpark, and data engineering. The candidate will be responsible for building scalable data pipelines, processing large datasets, and developing cloud-based data solutions.

You will work with BigQuery, Cloud Storage, Dataflow and Dataproc, implement ETL/ELT processes, and promote data quality and best practices in an Agile environment.

Qualifications

• Experience building data pipelines and data integrations in cloud environments.
• Strong SQL and Python development skills for data processing.
• Familiarity with data warehousing concepts and cloud data platforms.
• Hands-on with GCP services like BigQuery, Dataflow, Dataproc, and Cloud Storage.

Responsibilities

• Build scalable data pipelines on GCP and process large datasets.
• Develop cloud-based data solutions and optimize data workflows.
• Implement ETL/ELT processes and ensure data quality and reliability.
• Collaborate with cross-functional teams in an Agile software development environment.

Skills

GCP

Python

SQL

ETL/ELT

Data pipelines

BigQuery

Cloud Storage

Dataflow

Dataproc

Data warehousing

Agile

Job description

Quantum Technologies LLC seeks an experienced Data Engineer with strong hands-on expertise in GCP, PySpark, and data engineering. The candidate will be responsible for building scalable data pipelines, processing large datasets, and developing cloud-based data solutions.

You will work with BigQuery, Cloud Storage, Dataflow and Dataproc, implement ETL/ELT processes, and promote data quality and best practices in an Agile environment.