Senior Data Engineer - Real-Time Pipelines & AWS Cloud

Coins.ph; Taguig; On-site; PHP 1,200,000 - 1,800,000; Full time

Job summary

Coins.ph in Taguig (National Capital Region, Philippines) is hiring a senior Data Engineer to design, build, and run scalable data pipelines and real‑time processing systems on a Databricks using Spark. You will collaborate with analysts, software engineers, and business teams to translate data requirements into robust solutions.

The role requires 5+ years in data engineering, strong Databricks/Delta Lake experience, and proficiency with Python/Scala/Java, Kafka, and AWS security.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 5+ years of hands‑on experience as a Data Engineer with a proven track record.
• Strong understanding of Databricks platform and Delta Lake.
• Familiar with Dagster as data job scheduler.
• Proficiency in Scala, Java, or Python.
• Deep expertise in Spark for ETL processing and optimization.
• Proficient in Metabase for data visualization and analysis.
• Advanced data modeling, data quality, and governance knowledge.
• Excellent communication and collaboration skills across teams.
• Extensive AWS operational management experience and security practices.
• Terraform for infrastructure as code and automation.

Responsibilities

• Design, develop, and maintain scalable data processing systems with focus on quality and performance.
• Collaborate with data analysts, developers, and stakeholders to design robust solutions.
• Develop and maintain ETL pipelines to load data into the Data-w warehouse on Databricks.
• Lead real-time data processing using Spark Streaming and Kafka.
• Implement data quality checks to ensure accuracy and consistency.
• Troubleshoot data processing issues with cross-functional teams to ensure timely resolution.
• Monitor and optimize data systems for peak performance and reliability using AWS expertise.
• Use AWS services (EC2, S3, Glue, DataBricks) to architect and manage data infrastructure.
• Implement robust security measures and access controls in AWS.
• Stay updated on AWS tech and best practices to improve data capabilities.

Skills

Big data

ETL pipelines

Spark

Scala/Java/Python

Data modeling

Data governance

Communication

AWS security

Education

Bachelor’s or Master’s in CS

Tools

Databricks

Dagster

Terraform

Kafka

Metabase

AWS (EC2/S3/Glue/EMR)

Job description

Coins.ph in Taguig (National Capital Region, Philippines) is hiring a senior Data Engineer to design, build, and run scalable data pipelines and real‑time processing systems on a Databricks using Spark. You will collaborate with analysts, software engineers, and business teams to translate data requirements into robust solutions.

The role requires 5+ years in data engineering, strong Databricks/Delta Lake experience, and proficiency with Python/Scala/Java, Kafka, and AWS security.