Data Engineer (PH)

Coins.ph; Malaysia; On-site; MYR 80,000 - 133,000; Full time

Job summary

Coins in the Philippines is seeking a Data Engineer with 5+ years of hands-on experience to design, develop, and maintain scalable data processing systems on Data-bricks, Spark, and AWS.

You will collaborate with data analysts and engineers to architect robust ETL pipelines, work on real-time processing with Kafka, and enforce data quality and security across the data platform.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Minimum of 5 years of hands-on experience as a Data Engineer.
• Good understanding of Data-bricks platform and Delta Lake.
• Familiar with data job scheduler tool such as Dagster.
• Proficiency in one or more programming languages such as Scala, Java, or Python.
• Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.
• Proficient in utilizing BI tools such as Metabase for data visualization and analysis.
• Advanced understanding of data modeling, data quality, and data governance best practices.
• Outstanding communication and collaboration skills across diverse stakeholders.
• Experience in AWS operational management including deployment, configuration, and optimization.

Responsibilities

• Design, develop, and maintain highly scalable, reliable data processing systems with emphasis on code quality and performance.
• Collaborate with data analysts, software developers, and stakeholders to understand data requirements and architect robust solutions.
• Develop and maintain ETL pipelines extracting data from diverse sources into our Data-bricks-based warehouse.
• Build real-time data processing systems using Spark Streaming and Kafka.
• Establish data quality checks to uphold accuracy and consistency of data assets.
• Troubleshoot and resolve complex data processing issues with cross-functional teams.
• Monitor and optimize data processing systems for peak performance and reliability using AWS knowledge.
• Leverage AWS services (EC2, S3, Glue, Data-bricks) to deploy and manage data infrastructure.
• Implement robust security measures and access controls to protect data assets.
• Stay updated on AWS technologies and best practices to improve data processing capabilities.

Skills

Data engineering

Spark

Delta Lake

Dagster

Python

Java

Scala

AWS

Metabase

ETL pipelines

Education

Bachelor's or Master's degree

Tools

Data-bricks

Delta Lake

Dagster

Terraform

Metabase

Kafka

Spark Streaming

EC2

S3

Glue

EMR

Job description

Join the Pioneer Crypto Brand in the Philippines!

Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.

Coins is fully regulated by the Bangko Sentral ng Pilipinas (BSP) and is the first ever crypto-based company in Asia to hold both Virtual Currency and Electronic Money Issuer licenses from a central bank.

Responsibilities:1. Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.2. Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.3. Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.4. Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.5. Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.6. Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.7. Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.8. Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.9. Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.10. Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.

Requirements:1. Bachelor's or Master's degree in Computer Science or a related field.2. Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.4. Good understanding of Data-bricks platform and Delta Lake.Familiar with data job scheduler tool such as Dagster.5. Proficiency in one or more programming languages such as Scala, Java, or Python.6. Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.7. Proficient in utilizing BI tools such as Metabase for data visualization and analysis.8. Advanced understanding of data modeling, data quality, and data governance best practices.9. Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.10. Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.11. Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.12. Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.13. Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.14. Can read/write in English.

Responsibilities

• Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.
• Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.
• Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.
• Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.
• Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.
• Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.
• Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.
• Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.
• Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.
• Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.
• Good understanding of Data-bricks platform and Delta Lake.
• Familiar with data job scheduler tool such as Dagster.
• Proficiency in one or more programming languages such as Scala, Java, or Python.
• Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.
• Proficient in utilizing BI tools such as Metabase for data visualization and analysis.
• Advanced understanding of data modeling, data quality, and data governance best practices.
• Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.
• Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.
• Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.
• Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.
• Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.

Meaningful Collaborations

- The successful candidate will work cross-functionally with other relevant teams to carry out implementations that will improve and create an impact on customer experience.

Scalable Growth

Be part of a fast-growing organization with the vision to expand its territories outside APAC which will provide opportunities for career advancement.

A Space For Bright Ideas

Let your bright ideas be converted into meaningful changes! Coins culture welcomes new ideas backed up by data to create an impact.