Data Engineer

Hammerjack Pty Ltd; Philippines; On-site; PHP 1,200,000 - 2,000,000; Full time

Job summary

Hammerjack Pty Ltd is seeking a skilled Data Engineer to join our team for a cutting-edge Big Data project. You will design, develop and maintain scalable data pipelines and infrastructure to support our data-driven initiatives, leveraging Spark, Hadoop and cloud services.

The role requires strong coding skills in Java, Scala or Python, experience with ETL, and the ability to optimize data warehouses for BI reporting. Collaboration with cross-functional teams and agile practices are key.

Qualifications

• Strong experience building scalable ETL pipelines using big data technologies such as Spark, Hadoop, and AWS Glue.
• Proficient in Java, Scala, or Python for data engineering tasks.
• Experience transforming data in formats like JSON, CSV, Parquet, YAML, Avro and ORC.
• Hands-on experience with SQL databases and cloud data warehouses (Redshift, BigQuery) and Delta Lakes is preferred.
• Familiarity with data visualization tools (Tableau) a plus.
• Ability to design, implement and optimize data pipelines in cloud environments.

Responsibilities

• Design, develop, and maintain cloud-based big data products and services.
• Implement, test, and maintain ETL processes for Analytics and BI systems.
• Analyze data warehouses and optimize SQL queries used for BI reporting.
• Transform structured and unstructured data to provide meaningful reports to business.
• Write code, conduct reviews, write unit tests, and maintain documentation.
• Interface with Product, QA, and Operations teams; participate in agile sprints.
• Create quick proof-of-concept prototypes and contribute to agile teamwork.

Skills

Java

Scala

Python

SQL

ETL pipelines

Teamwork / communication

Tools

Apache Spark

Hadoop

AWS Glue

JSON

CSV

Parquet

YAML

Avro

ORC

Apache Airflow

Redshift

BigQuery

Delta Lake

Tableau

Kubernetes

Job description

Position Summary

We are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.

Role and Responsibilities

Duties & Responsibilities:

• Implement, maintain and evolve cloud-based Big Data products and services
• Responsible for designing, implementing, testing, and maintaining ETL processes for Analytics and Business Intelligence Systems
• Analyze data warehouses and suggest optimizations to SQL Queries used for Business Intelligence reporting
• Modify structured and unstructured data to provide meaningful reports to business
• Write large amounts of code, perform code reviews, write unit tests
• Write documentation
• Interface with other groups including Product Management, QA and Operations
• Create quick proof-of-concept prototypes
• Participate in an agile team

Work Experience:

At least 2 years relevant work experience

Skills & Competencies

• Working experience in software development using Java, Scala, or Python is a must
• Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
• Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc)
• Experience managing and scheduling workflows (Apache Airflow experience is preferred)
• Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
• Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
• Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
• Ability to perform ad-hoc complex SQL queries and query optimization
• Team player with strong communication skills
• Desire to learn fast and pick up latest technologies and tools
• Experience with data visualization software (Tableau preferred) is a plus
• Experience with Kubernetes and Machine Learning is a plus

Please visit to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please click .