Senior Data Engineer — Remote Lead for Scalable Data Pipelines

iScale Solutions; Metro Manila; Remote; PHP 900,000 - 1,500,000; Full time

Benefits offered by this job

Competitive Salary

Vacation & Sick Leave credits

Health Coverage

Government Benefits

Learning Opportunities

Team Engagement

Modern Tools

Career Growth

Inclusive Culture

Job summary

iScale Solutions is seeking a Senior Data Engineer to own end-to-end data pipelines, optimize processing, and lead a small engineering team in a remote capacity. You will design scalable ETL/ELT solutions, implement Airflow-based workflows, and collaborate with analytics and product teams.

Required expertise includes SQL, Hive, Python, Spark, and AWS services (S3, Athena, EC2, EMR). Experience with data governance, AI-assisted automation, and Jira/Confluence is highly valued.

Qualifications

• 5+ years of professional experience in data engineering, with ownership of production data pipelines.
• Strong SQL expertise including complex joins, window functions, transformations and troubleshooting.
• Proficiency in Hive and Hadoop ecosystem, including partitioning and distributed processing concepts.
• Proficiency in Python for data processing, automation, and production code.
• Hands-on experience with Amazon S3, Athena, EC2, and EMR.
• Experience with Apache Airflow or similar ETL/workflow orchestration tools.
• Ability to translate business requirements into technical designs with minimal supervision.
• Strong documentation and communication skills for cross-functional stakeholders.
• Experience with Jira and Confluence for task tracking and documentation.
• Exposure to AI capabilities and basic AI-assisted automation.

Responsibilities

• Own data pipeline development: design, develop, and maintain ETL/ELT pipelines for large-scale datasets across sources.
• Define processing logic, data models, integration approaches, and workflow dependencies; focus on scalability and cost.
• Write SQL, Hive, and Python; apply Spark where appropriate to optimize processing.
• Build and manage AWS workflows using S3, Athena, EC2, and EMR; monitor resources.
• Develop automated workflows with Airflow, including scheduling, retries, and alerting.
• Monitor pipeline performance and data freshness; investigate failures and perform root cause analysis.
• Maintain data quality and governance with validation checks and data dictionaries.
• Lead and mentor 2–3 engineers; review designs and track delivery commitments.
• Collaborate with analytics, product, engineering, and data science teams to align requirements and priorities.
• Maintain solution designs, data flow diagrams, data dictionaries, and runbooks; document in Confluence.
• Apply AI to engineering workflows; build simple AI agents and validate outputs.
• Support agile delivery via Jira; participate in sprint planning and technical reviews.

Skills

SQL

Hive

Python

Airflow

AWS

Spark

OpenAI Codex

Snowflake

Jira

Confluence

Tools

PySpark

Scala

Snowflake

OpenAI Codex

Git

Job description

iScale Solutions is seeking a Senior Data Engineer to own end-to-end data pipelines, optimize processing, and lead a small engineering team in a remote capacity. You will design scalable ETL/ELT solutions, implement Airflow-based workflows, and collaborate with analytics and product teams.

Required expertise includes SQL, Hive, Python, Spark, and AWS services (S3, Athena, EC2, EMR). Experience with data governance, AI-assisted automation, and Jira/Confluence is highly valued.