Senior AWS Data Engineer: Lead End-to-End Data Pipelines

ITC Infotech; Kuala Lumpur; On-site; MYR 180,000 - 260,000; Full time

Benefits offered by this job

On-site role

Client-facing exposure

Job summary

ITC Infotech in KL is seeking a Senior AWS Data Engineer for an on-site, client-facing role. You will lead architecture discussions, design end-to-end data pipelines, and translate business needs into scalable solutions for our clients.

Responsibilities include building ETL pipelines on AWS (Glue, PySpark, S3), using Step Functions and EventBridge for orchestration, and enforcing data quality and security best practices in a production environment.

Qualifications

• 7–10 years of hands-on AWS Data Engineering experience.
• Strong Client-Facing Experience: able to lead on-site conversations and present to diverse stakeholders.
• Architectural mindset with ability to plan end-to-end data implementations and defend design choices.
• Deep expertise in AWS Glue, PySpark, and data processing on S3.
• Production-level orchestration using AWS Step Functions and EventBridge.
• Terraform for Infrastructure as Code (IaC) proficiency.
• Strong SQL and data modeling skills.
• Experience building data validation, reconciliation, and quality frameworks.
• Solid understanding of cloud security, IAM, and AWS best practices.

Responsibilities

• Lead on-site customer workshops to understand business requirements and design end-to-end data flows.
• Articulate and justify architectural design decisions and data design patterns.
• Plan and sequence end-to-end data engineering implementations with clear roadmaps.
• Map theoretical knowledge to real-world client solutions.
• Design and develop metadata-driven ETL pipelines using AWS Glue and PySpark on S3.
• Implement complex data transformations (joins, aggregations, conditional logic, business rules).
• Optimize data pipelines for performance, scalability, and reliability.
• Implement data quality checks including integrity, completeness, and reconciliation.

Skills

AWS Data Engineering

Client-facing

Architectural mindset

AWS Glue

PySpark

S3 data processing

AWS Step Functions

EventBridge

Terraform

SQL

Data modeling

Data validation & quality

Cloud security & IAM

DynamoDB

CI/CD tools

Job description

ITC Infotech in KL is seeking a Senior AWS Data Engineer for an on-site, client-facing role. You will lead architecture discussions, design end-to-end data pipelines, and translate business needs into scalable solutions for our clients.

Responsibilities include building ETL pipelines on AWS (Glue, PySpark, S3), using Step Functions and EventBridge for orchestration, and enforcing data quality and security best practices in a production environment.