Senior Data Engineer: Real-Time Spark & AWS Cloud

Coins.ph; Indonesia; On-site; IDR 253,736,000 - 479,278,000; Full time

Job summary

Coins.ph in the Philippines seeks a Senior Data Engineer to design, build and maintain scalable data pipelines, ensuring data quality across analytics platforms. You will work with Spark Streaming and Kafka, Delta Lake on Databricks, and AWS services to deliver robust real-time and batch processing for business insights.

The role requires 5+ years of hands-on data engineering, strong SQL/Scala/Java/Python skills, and experience with data governance and BI tooling like Metabase.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Minimum of 5 years of hands-on experience as a Data Engineer.
• Strong knowledge of Data-bricks platform and Delta Lake.
• Familiar with data job scheduler tools such as Dagster.
• Proficiency in one or more programming languages (Scala, Java, Python).
• Deep expertise in Spark for ETL processing and optimization.
• Proficient in BI tools such as Metabase for data visualization.
• Experience with AWS (EC2, S3, Glue, EMR) and data security best practices.

Responsibilities

• Design, develop, and maintain scalable data processing systems with emphasis on quality and performance.
• Collaborate with data analysts and stakeholders to understand data requirements and architect robust solutions.
• Develop and maintain ETL pipelines and data warehouse ingestion on Databricks.
• Lead real-time data processing with Spark Streaming and Kafka.
• Ensure data quality and validation across assets.
• Troubleshoot complex data issues and coordinate cross-functional resolutions.
• Monitor and optimize systems for performance, scalability, and reliability on AWS.

Skills

Data pipeline design

Data quality

Data governance

SQL/Scala/Java/Python

Spark

Kafka

Databricks

AWS

Dagster

Metabase

Delta Lake

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Dagster

Databricks

Spark

Terraform

Metabase

Kafka

AWS

Delta Lake

Job description

Coins.ph in the Philippines seeks a Senior Data Engineer to design, build and maintain scalable data pipelines, ensuring data quality across analytics platforms. You will work with Spark Streaming and Kafka, Delta Lake on Databricks, and AWS services to deliver robust real-time and batch processing for business insights.

The role requires 5+ years of hands-on data engineering, strong SQL/Scala/Java/Python skills, and experience with data governance and BI tooling like Metabase.