Senior Data Engineer: Spark, BigQuery & Cloud Pipelines

JobCubby; Hinoba-an; On-site; PHP 8,772,000 - 11,278,000; Full time

Job summary

Target is seeking a Senior Data Engineer to design, develop, and optimize large-scale data platforms and pipelines. You will apply expertise in Big Data, Apache Spark, Scala, and Google BigQuery to build high-performance data solutions, collaborating with engineers, product teams, data scientists, and business partners.

The role covers data ingestion, transformation, storage, processing, quality, and consumption.

Qualifications

• 5+ years of experience in software or data engineering.
• Experience with Spark, Scala, and BigQuery in large-scale data environments.
• Strong SQL skills and experience with complex datasets.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data processing frameworks.
• Build robust ETL/ELT pipelines for high-volume datasets.
• Develop data models and optimize BigQuery tables with partitioning and clustering.
• Design and implement scalable batch and distributed processing solutions.
• Contribute to architecture discussions and collaborate across teams.

Skills

Big Data

Apache Spark

Scala

Google BigQuery

SQL

Distributed Processing

Data Warehousing

Data Modeling

Cloud Platform (GCP)

CI/CD

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or equivalent

Tools

Kafka

Docker

Kubernetes

Jenkins

GitHub Actions

Google Cloud Platform (GCP)

Job description

Target is seeking a Senior Data Engineer to design, develop, and optimize large-scale data platforms and pipelines. You will apply expertise in Big Data, Apache Spark, Scala, and Google BigQuery to build high-performance data solutions, collaborating with engineers, product teams, data scientists, and business partners.

The role covers data ingestion, transformation, storage, processing, quality, and consumption.