Senior Data Engineer: Real-Time Big Data & Cloud (AWS)

Coins.ph; Taguig; On-site; PHP 900,000 - 1,700,000; Full time

Job summary

Coins.ph is seeking an experienced Data Engineer to design and maintain scalable data processing systems and ETL pipelines on the Data-bricks platform. You will collaborate with analysts, developers, and stakeholders to build robust, real-time data solutions that ensure data quality and governance.

The role emphasizes AWS-based infrastructure, security, and cutting-edge big data tools. The ideal candidate has 5+ years in data engineering, deep Spark expertise, Delta Lake familiarity, and

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 5+ years hands-on experience as a Data Engineer with scalable data systems.
• Strong knowledge of Data-bricks, Delta Lake, and Spark-based ETL.
• Familiarity with Dagster for data orchestration.
• Proficiency in Scala, Java, or Python and AWS services.
• Experience with BI tools like Metabase and data governance best practices.
• Excellent communication and collaboration with cross-functional teams.
• Hands-on with Terraform and DevOps workflows for IaC.

Responsibilities

• Design, develop, and maintain scalable data processing systems with emphasis on code quality and performance.
• Collaborate with analysts, software developers, and stakeholders to translate data requirements into robust solutions.
• Develop and maintain ETL pipelines moving data into a Data-bricks-based warehouse.
• Lead real-time data processing with Spark Streaming and Kafka where applicable.
• Implement data quality checks to ensure accuracy and consistency.
• Troubleshoot complex data processing issues with cross-functional teams.
• Monitor and optimize data processing systems, leveraging AWS operational knowledge.
• Architect cloud-based data infrastructure using AWS services (EC2, S3, Glue, Data-bricks).
• Apply robust security measures and access controls for sensitive data assets.
• Stay updated on AWS technologies to continually improve capabilities.

Skills

Scala

Java

Python

Spark

Metabase

Data modeling

Communication

DevOps

Education

Bachelor's or Master’s in Computer Science

Tools

Delta Lake

Dagster

Spark

EMR

EC2

S3

Glue

Data-bricks

Terraform

Job description

Coins.ph is seeking an experienced Data Engineer to design and maintain scalable data processing systems and ETL pipelines on the Data-bricks platform. You will collaborate with analysts, developers, and stakeholders to build robust, real-time data solutions that ensure data quality and governance.

The role emphasizes AWS-based infrastructure, security, and cutting-edge big data tools. The ideal candidate has 5+ years in data engineering, deep Spark expertise, Delta Lake familiarity, and