Data Engineer

IT Managers, Inc.; Taguig; Hybrid; PHP 670,000 - 1,339,000; Full time

Job summary

IT Managers, Inc. is seeking an experienced Data Engineer in a hybrid role based near BGC, Taguig. The ideal candidate will design and optimize data pipelines using Python, Spark, PySpark, and SQL within AWS environments.

Responsibilities include building ETL/ELT workflows, managing large datasets via Spark, and leveraging AWS services like S3, Redshift, Glue, and CloudWatch. Candidates should demonstrate data quality focus and collaboration with data teams.

Qualifications

• Hands-on experience developing, maintaining, and optimizing data pipelines on AWS.
• Strong proficiency in Spark and PySpark for large-scale data processing.
• Experience with AWS data services and ETL/ELT workflows.

Responsibilities

• Develop, maintain, and optimize data pipelines using Python, PySpark, and Spark.
• Write and optimize complex SQL queries for data processing and transformation.
• Manage and process large datasets with Apache Spark.
• Develop and maintain data integration and ETL/ELT workflows on AWS.
• Work with AWS S3 and Redshift for storage and warehousing.
• Configure and manage AWS Glue jobs and data workflows.

Skills

Python

SQL

Apache Spark

PySpark

Tools

AWS S3

Amazon Redshift

AWS IAM

AWS Glue

AWS CloudWatch

AWS DataSync

Job description

Work Setup: Hybrid – 8x onsite per month

Employment Type: Project-Based (For Extension & Absorption)

WE ARE HIRING: DATA ENGINEER

Location: BGC, Taguig

Work Setup: Hybrid – 8x onsite per month

Employment Type: Project-Based (For Extension & Absorption)

JOB OVERVIEW

We are looking for an experienced Data Engineer with strong expertise in Python, Spark, PySpark, SQL, and AWS data services. The ideal candidate should have hands-on experience developing, maintaining, and optimizing data pipelines and AWS-based data processing solutions.

KEY RESPONSIBILITIES

• Develop, maintain, and optimize data pipelines using Python, PySpark/Spark.
• Write and optimize complex SQL queries for data processing and transformation.
• Manage and process large datasets using Apache Spark.
• Develop and maintain data integration and ETL/ELT workflows.
• Work with AWS S3 and Amazon Redshift for data storage and warehousing.
• Configure and manage AWS Glue jobs and data workflows.
• Manage AWS IAM roles, users, and policies.
• Monitor data pipelines and troubleshoot issues using AWS CloudWatch.
• Perform data synchronization using AWS DataSync.
• Ensure data quality, accuracy, and consistency across data pipelines.
• Collaborate with data architects, analysts, and other technical teams.

REQUIRED SKILLS & QUALIFICATIONS

Programming & Data Processing

• Python
• SQL
• Apache Spark
• PySpark

AWS Services & Tools

• AWS S3
• Amazon Redshift
• AWS IAM (Roles, Users, and Policies)
• AWS Glue
• AWS CloudWatch
• AWS DataSync

Additional Skills

• ETL/ELT Development
• Data Pipeline Development
• Data Integration
• Data Transformation
• Data Processing & Optimization
• Data Quality Management