Data Engineer: Cloud Big Data Pipelines & ETL

Hammerjack Pty Ltd; Philippines; On-site; PHP 1,200,000 - 2,000,000; Full time

Job summary

Hammerjack Pty Ltd is seeking a skilled Data Engineer to join our team for a cutting-edge Big Data project. You will design, develop and maintain scalable data pipelines and infrastructure to support our data-driven initiatives, leveraging Spark, Hadoop and cloud services.

The role requires strong coding skills in Java, Scala or Python, experience with ETL, and the ability to optimize data warehouses for BI reporting. Collaboration with cross-functional teams and agile practices are key.

Qualifications

• Strong experience building scalable ETL pipelines using big data technologies such as Spark, Hadoop, and AWS Glue.
• Proficient in Java, Scala, or Python for data engineering tasks.
• Experience transforming data in formats like JSON, CSV, Parquet, YAML, Avro and ORC.
• Hands-on experience with SQL databases and cloud data warehouses (Redshift, BigQuery) and Delta Lakes is preferred.
• Familiarity with data visualization tools (Tableau) a plus.
• Ability to design, implement and optimize data pipelines in cloud environments.

Responsibilities

• Design, develop, and maintain cloud-based big data products and services.
• Implement, test, and maintain ETL processes for Analytics and BI systems.
• Analyze data warehouses and optimize SQL queries used for BI reporting.
• Transform structured and unstructured data to provide meaningful reports to business.
• Write code, conduct reviews, write unit tests, and maintain documentation.
• Interface with Product, QA, and Operations teams; participate in agile sprints.
• Create quick proof-of-concept prototypes and contribute to agile teamwork.

Skills

Java

Scala

Python

SQL

ETL pipelines

Teamwork / communication

Tools

Apache Spark

Hadoop

AWS Glue

JSON

CSV

Parquet

YAML

Avro

ORC

Apache Airflow

Redshift

BigQuery

Delta Lake

Tableau

Kubernetes

Job description

Hammerjack Pty Ltd is seeking a skilled Data Engineer to join our team for a cutting-edge Big Data project. You will design, develop and maintain scalable data pipelines and infrastructure to support our data-driven initiatives, leveraging Spark, Hadoop and cloud services.

The role requires strong coding skills in Java, Scala or Python, experience with ETL, and the ability to optimize data warehouses for BI reporting. Collaboration with cross-functional teams and agile practices are key.