Senior Data Engineer — Real-Time Data & AWS in Crypto

Coins.ph; Jambur Pulau; On-site; IDR 289,939,000 - 579,878,000; Full time

Job summary

Coins.ph in the Philippines is seeking a Data Engineer to design and optimize scalable data processing systems on AWS, Databricks, Spark and Kafka. You will collaborate with analysts, engineers and stakeholders to translate data requirements into robust ETL pipelines and real-time processing.

You’ll own data quality, security, and governance, implement automation with Terraform and Dagster, and stay current with AWS best practices.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Minimum of 5 years of hands-on data engineering experience designing and implementing complex data processing systems.
• Strong understanding of Data-bricks, Delta Lake, and Spark.
• Familiarity with Dagster and data job schedulers.
• Proficiency in programming languages such as Scala, Java, or Python.
• Deep expertise in big data technologies (Spark) for ETL and optimization.
• Experience with Metabase for data visualization.
• Knowledge of data modeling, quality, and governance best practices.
• Excellent communication and collaboration with diverse stakeholders.
• Extensive AWS operational experience (EC2, S3, Glue, EMR).
• Security best practices and access controls in AWS.
• Terraform for infrastructure as code and automation.

Responsibilities

• Design, develop, and maintain scalable, reliable data processing systems with a focus on code quality and performance.
• Collaborate with data analysts, software developers, and stakeholders to translate data needs into robust solutions.
• Develop and maintain ETL pipelines and data warehouse integration on Databricks.
• Lead real-time data processing using Spark Streaming and Kafka.
• Enforce data quality and validation checks to ensure accuracy and consistency.
• Troubleshoot and resolve complex data processing issues across teams.
• Monitor and optimize data processing, leveraging AWS operational knowledge.
• Utilize AWS services (EC2, S3, Glue, Databricks) to deploy data infrastructure in the cloud.
• Implement robust security measures and access controls in AWS.
• Keep up-to-date with AWS technologies to improve data capabilities.

Skills

Communication

Collaboration

English Proficiency

Education

Bachelor's or Master's in CS

Tools

Data-bricks

Delta Lake

Dagster

Scala/Java/Python

Apache Spark

Kafka

Metabase

Terraform

AWS

Job description

Coins.ph in the Philippines is seeking a Data Engineer to design and optimize scalable data processing systems on AWS, Databricks, Spark and Kafka. You will collaborate with analysts, engineers and stakeholders to translate data requirements into robust ETL pipelines and real-time processing.

You’ll own data quality, security, and governance, implement automation with Terraform and Dagster, and stay current with AWS best practices.