Data Engineer (PH)

Coins.ph; Jambur Pulau; On-site; IDR 289,939,000 - 579,878,000; Full time

Job summary

Coins.ph in the Philippines is seeking a Data Engineer to design and optimize scalable data processing systems on AWS, Databricks, Spark and Kafka. You will collaborate with analysts, engineers and stakeholders to translate data requirements into robust ETL pipelines and real-time processing.

You’ll own data quality, security, and governance, implement automation with Terraform and Dagster, and stay current with AWS best practices.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Minimum of 5 years of hands-on data engineering experience designing and implementing complex data processing systems.
• Strong understanding of Data-bricks, Delta Lake, and Spark.
• Familiarity with Dagster and data job schedulers.
• Proficiency in programming languages such as Scala, Java, or Python.
• Deep expertise in big data technologies (Spark) for ETL and optimization.
• Experience with Metabase for data visualization.
• Knowledge of data modeling, quality, and governance best practices.
• Excellent communication and collaboration with diverse stakeholders.
• Extensive AWS operational experience (EC2, S3, Glue, EMR).
• Security best practices and access controls in AWS.
• Terraform for infrastructure as code and automation.

Responsibilities

• Design, develop, and maintain scalable, reliable data processing systems with a focus on code quality and performance.
• Collaborate with data analysts, software developers, and stakeholders to translate data needs into robust solutions.
• Develop and maintain ETL pipelines and data warehouse integration on Databricks.
• Lead real-time data processing using Spark Streaming and Kafka.
• Enforce data quality and validation checks to ensure accuracy and consistency.
• Troubleshoot and resolve complex data processing issues across teams.
• Monitor and optimize data processing, leveraging AWS operational knowledge.
• Utilize AWS services (EC2, S3, Glue, Databricks) to deploy data infrastructure in the cloud.
• Implement robust security measures and access controls in AWS.
• Keep up-to-date with AWS technologies to improve data capabilities.

Skills

Communication

Collaboration

English Proficiency

Education

Bachelor's or Master's in CS

Tools

Data-bricks

Delta Lake

Dagster

Scala/Java/Python

Apache Spark

Kafka

Metabase

Terraform

AWS

Job description

Join the Pioneer Crypto Brand in the Philippines!

Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.

Coins is fully regulated by the Bangko Sentral ng Pilipinas (BSP) and is the first ever crypto-based company in Asia to hold both Virtual Currency and Electronic Money Issuer licenses from a central bank.

Responsibilities:1. Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.2. Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.3. Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.4. Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.5. Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.6. Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.7. Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.8. Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.9. Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.10. Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.

Requirements:1. Bachelor's or Master's degree in Computer Science or a related field.2. Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.4. Good understanding of Data-bricks platform and Delta Lake.Familiar with data job scheduler tool such as Dagster.5. Proficiency in one or more programming languages such as Scala, Java, or Python.6. Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.7. Proficient in utilizing BI tools such as Metabase for data visualization and analysis.8. Advanced understanding of data modeling, data quality, and data governance best practices.9. Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.10. Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.11. Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.12. Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.13. Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.14. Can read/write in English.

Responsibilities

• Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.
• Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.
• Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.
• Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.
• Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.
• Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.
• Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.
• Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.
• Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.
• Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.
• Good understanding of Data-bricks platform and Delta Lake.
• Familiar with data job scheduler tool such as Dagster.
• Proficiency in one or more programming languages such as Scala, Java, or Python.
• Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.
• Proficient in utilizing BI tools such as Metabase for data visualization and analysis.
• Advanced understanding of data modeling, data quality, and data governance best practices.
• Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.
• Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.
• Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.
• Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.
• Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.

Meaningful Collaborations

- The successful candidate will work cross-functionally with other relevant teams to carry out implementations that will improve and create an impact on customer experience.

Scalable Growth

Be part of a fast-growing organization with the vision to expand its territories outside APAC which will provide opportunities for career advancement.

A Space For Bright Ideas

Let your bright ideas be converted into meaningful changes! Coins culture welcomes new ideas backed up by data to create an impact.