Hybrid Data Engineer — Spark, SQL & AWS Expert

IT Managers, Inc.; Taguig; Hybrid; PHP 670,000 - 1,339,000; Full time

Job summary

IT Managers, Inc. is seeking an experienced Data Engineer in a hybrid role based near BGC, Taguig. The ideal candidate will design and optimize data pipelines using Python, Spark, PySpark, and SQL within AWS environments.

Responsibilities include building ETL/ELT workflows, managing large datasets via Spark, and leveraging AWS services like S3, Redshift, Glue, and CloudWatch. Candidates should demonstrate data quality focus and collaboration with data teams.

Qualifications

• Hands-on experience developing, maintaining, and optimizing data pipelines on AWS.
• Strong proficiency in Spark and PySpark for large-scale data processing.
• Experience with AWS data services and ETL/ELT workflows.

Responsibilities

• Develop, maintain, and optimize data pipelines using Python, PySpark, and Spark.
• Write and optimize complex SQL queries for data processing and transformation.
• Manage and process large datasets with Apache Spark.
• Develop and maintain data integration and ETL/ELT workflows on AWS.
• Work with AWS S3 and Redshift for storage and warehousing.
• Configure and manage AWS Glue jobs and data workflows.

Skills

Python

SQL

Apache Spark

PySpark

Tools

AWS S3

Amazon Redshift

AWS IAM

AWS Glue

AWS CloudWatch

AWS DataSync

Job description

IT Managers, Inc. is seeking an experienced Data Engineer in a hybrid role based near BGC, Taguig. The ideal candidate will design and optimize data pipelines using Python, Spark, PySpark, and SQL within AWS environments.

Responsibilities include building ETL/ELT workflows, managing large datasets via Spark, and leveraging AWS services like S3, Redshift, Glue, and CloudWatch. Candidates should demonstrate data quality focus and collaboration with data teams.