AWS Glue Data Engineer

Accenture in the Philippines; Philippines; On-site; PHP 900,000 - 1,200,000; Full time

Job summary

Accenture in the Philippines is seeking a Data Platform Engineer to assist with designing and building the data platform architecture. The role involves collaborating with Integration and Data Architects to ensure cohesive data models and system integration.

The position emphasizes hands-on development of ETL/ELT pipelines using AWS Glue, Python, PySpark, and related AWS data services, along with automation, performance tuning, and CI/CD support to deliver scalable data solutions.

Qualifications

• 3+ years of hands-on experience in data engineering, ETL/ELT development, or cloud-based data integration.

Responsibilities

• Serve as SME for AWS Glue-based data integration and ETL solutions.
• Design, develop, maintain, and optimize ETL/ELT pipelines using AWS Glue, Python, PySpark, and AWS data services.
• Develop reusable frameworks and automation to improve data engineering efficiency.
• Troubleshoot and resolve complex data processing, performance, and integration issues across environments.
• Monitor and optimize data pipelines for performance, scalability, and cost.
• Work with AWS services (S3, Glue Data Catalog, Lambda, IAM, CloudWatch, Step Functions, Redshift) to build end-to-end data solutions.
• Support CI/CD implementation, code reviews, testing, and deployment for data engineering solutions.

Skills

AWS Glue

Python

PySpark

SQL

Data pipelines

Data lakes

Data warehousing

Data governance

CI/CD

Agile

Communication

Tools

S3

Lambda

IAM

CloudWatch

Step Functions

Redshift

Job description

Job Description:

Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Summary:

As a Data Platform Engineer, you will spend your day supporting the development and design of the data platform architecture. Your role involves working closely with various architects to ensure seamless integration of systems and data models. You will engage in collaborative efforts to align platform components and contribute to the overall data strategy, ensuring that the platform meets organizational needs efficiently and effectively.

Roles & Responsibilities:

• Serve as a subject matter expert (SME) for AWS Glue-based data integration and ETL solutions.


• Design, develop, maintain, and optimize ETL/ELT pipelines using AWS Glue, Python, PySpark, and other AWS data services.


• Develop reusable frameworks, utilities, and automation solutions to improve data engineering efficiency and reliability.


• Troubleshoot and resolve complex data processing, performance, and integration issues across multiple environments.


• Monitor, tune, and optimize data pipelines to meet performance, scalability, and cost-efficiency requirements.


• Work with AWS services such as S3, Glue Data Catalog, Lambda, IAM, CloudWatch, Step Functions, and Redshift to build end-to-end data solutions.


• Support CI/CD implementation, code reviews, testing, and deployment activities for data engineering solutions.

Professional & Technical Skills:

• Required Skill: AWS Glue, Python, and PySpark for large-scale data processing.


• Experience working with AWS services including S3, Lambda, IAM, CloudWatch, Step Functions, and Redshift.


• Strong knowledge of SQL and relational databases.


• Experience designing and implementing data pipelines, data lakes, and data warehousing solutions.


• Understanding of data modeling, data quality frameworks, and data governance principles.


• Experience with source control, CI/CD pipelines, and Agile development methodologies.


• Strong analytical, problem-solving, and communication skills.


• Ability to work independently while collaborating effectively with multiple teams and stakeholders.

Additional Information:

• More than 3 years of hands-on experience in data engineering, ETL development, or cloud-based data integration.


• This position is based at our Manila office.

Requirements: