Data Engineer: Build Scalable AWS ETL Pipelines

IT Managers, Inc.; Philippines; Remote; PHP 600,000 - 1,000,000; Full time

Job summary

IT Managers, Inc. in the Philippines seeks a Data Engineer to design, develop, and maintain data pipelines and ETL/ELT processes using AWS services such as S3, Redshift, Glue, and CloudWatch.

The role focuses on optimizing SQL queries, using Python for data processing, and ensuring data quality across systems. Collaboration with analysts and engineers is essential for accurate data delivery and governance.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• 3+ years of experience in Data Engineering or a related role.
• Strong hands-on experience with SQL and Python.
• Experience working with AWS S3 and AWS Redshift.
• Hands-on experience with AWS Glue for ETL/data processing.
• Knowledge of AWS IAM, including Roles, Users, and Policies.
• Experience with AWS CloudWatch for monitoring and troubleshooting.
• Experience with data synchronization, ETL/ELT, and data pipeline development.
• Strong understanding of data processing, transformation, and validation.
• Strong analytical and problem-solving skills.
• Good communication and collaboration skills.

Responsibilities

• Design, develop, and maintain data pipelines and ETL/ELT processes using AWS services.
• Develop and optimize SQL queries for data extraction, transformation, validation, and analysis.
• Use Python for data processing, automation, and pipeline development.
• Manage and process data using AWS S3 and AWS Redshift.
• Develop and maintain ETL workflows using AWS Glue.
• Configure and manage AWS IAM roles, users, and policies to support secure data access.
• Monitor data pipelines, jobs, and AWS resources using AWS CloudWatch.
• Perform data synchronization and ensure consistency across systems.
• Troubleshoot data pipeline failures, performance issues, and data quality concerns.
• Implement data validation and reconciliation processes to ensure accuracy and completeness.
• Collaborate with Data Analysts, Software Engineers, Business Analysts, and other stakeholders to understand data requirements.
• Maintain technical documentation for data pipelines, processes, and AWS environments.
• Follow data security, governance, and access control best practices.

Skills

SQL

Python

Data engineering

ETL/ELT

Data processing

Data validation

Analytical thinking

Collaboration

Communication

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field

Tools

AWS S3

AWS Redshift

AWS Glue

AWS IAM

AWS CloudWatch

Apache Spark/PySpark

AWS Lambda

Athena

RDS

Step Functions

Job description

IT Managers, Inc. in the Philippines seeks a Data Engineer to design, develop, and maintain data pipelines and ETL/ELT processes using AWS services such as S3, Redshift, Glue, and CloudWatch.

The role focuses on optimizing SQL queries, using Python for data processing, and ensuring data quality across systems. Collaboration with analysts and engineers is essential for accurate data delivery and governance.