Senior Data Engineer: Build Scalable Pipelines & AI Tools

iScale Solutions; Makati; On-site; PHP 900,000 - 1,500,000; Full time

Benefits offered by this job

Competitive salary

Leave credits

Health coverage

SSS/PhilHealth/Pag-IBIG

Training & mentorship

Team activities

Modern tools

Career growth

Inclusive culture

Job summary

iScale Solutions is seeking a Data Engineer to design, implement, and maintain large-scale data pipelines in a cloud environment, focusing on reliability, scalability, and governance. You will collaborate with analytics, product, engineering, and data science teams to deliver data-driven solutions.

The role requires strong SQL, Hive, Python, and AWS skills, plus experience with Airflow, Spark, and data quality practices.

Qualifications

• 5+ years of professional experience in data engineering with ownership of production data pipelines.
• Strong SQL expertise with complex joins, window functions, transformations, and troubleshooting.
• Proficiency in Python for data processing, automation, integration, and production code.
• Hands-on experience with Amazon S3, Athena, EC2, and EMR.
• Strong experience with Apache Airflow for ETL/workflow orchestration.
• Experience implementing data quality checks, monitoring, and operational support processes.
• Ability to translate business requirements into technical designs with minimal supervision.
• Strong documentation and communication skills for stakeholders.
• Experience using Jira and Confluence for task tracking and documentation.
• Experience mentoring engineers or leading small teams is a plus.

Responsibilities

• Own data pipeline development and maintenance across ingestion, transformation, and delivery of large datasets.
• Lead technical design including data models, integration approaches, and workflow dependencies.
• Develop and optimize data processing with SQL, Hive, and Python; apply Spark where appropriate.
• Build and manage AWS workflows using S3, Athena, EC2, and EMR with monitoring and optimization.
• Orchestrate automated workflows with Airflow, including scheduling, retries, and recovery.
• Monitor pipeline reliability and data freshness; perform root cause analysis and improvements.
• Maintain data quality, governance, lineage documentation, and access controls.
• Lead a 2-3 engineer team; review code and designs, assist troubleshooting, track delivery.
• Collaborate with analytics, product, engineering, and data science teams; manage dependencies.
• Create and update solution designs, data flow diagrams, and data dictionaries in Confluence.
• Apply AI to engineering workflows; validate AI outputs before production use.
• Support agile delivery with Jira; participate in sprints and cross-region coordination.

Skills

SQL

Hive

Python

Spark

Airflow

Data modeling

AWS

Tools

Snowflake

OpenAI Codex

Snowflake Cortex

PySpark

Jira

Confluence

OpenAI Codex

Job description

iScale Solutions is seeking a Data Engineer to design, implement, and maintain large-scale data pipelines in a cloud environment, focusing on reliability, scalability, and governance. You will collaborate with analytics, product, engineering, and data science teams to deliver data-driven solutions.

The role requires strong SQL, Hive, Python, and AWS skills, plus experience with Airflow, Spark, and data quality practices.