Senior Data Engineer: AWS Data Platform Lead

NorthBay - Pakistan; Karachi Division; Hybrid; PKR 3,000,000 - 6,000,000; Full time

Job summary

NorthBay - Pakistan is seeking a Lead Data Engineer to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines. The role requires 5–8+ years of hands-on experience with PySpark, AWS Glue, EMR, Redshift, and SQL-based data warehousing.

You will collaborate with a UAE-based customer, align with UAE working hours, and drive performance tuning and data governance across distributed teams.

Qualifications

• 5–8+ years of data engineering and data warehousing experience.
• Hands-on PySpark expertise.
• Extensive AWS Glue experience.
• Experience building workloads on Amazon EMR.
• Strong Amazon Redshift expertise.
• Excellent SQL development and optimization skills.
• Knowledge of data warehousing concepts and ETL/ELT.
• Experience with large-scale distributed data processing.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark, AWS Glue, and EMR.
• Build and optimize data ingestion, transformation, and processing for structured and semi-structured data.
• Develop and maintain enterprise data warehouses using Redshift.
• Write complex SQL queries and data transformations for analytics and reporting.
• Implement ETL/ELT processes to move data across systems.
• Perform performance tuning of Spark jobs, ETL pipelines, and Redshift workloads.
• Ensure data quality, integrity, security, and governance.
• Troubleshoot production issues and perform root cause analysis.
• Collaborate with stakeholders, analysts, architects, and engineers to understand data requirements.
• Participate in code reviews and technical design discussions.
• Monitor data pipelines and identify opportunities for optimization and automation.
• Create and maintain technical documentation, data models, and procedures.

Skills

PySpark

AWS Glue

Amazon EMR

Amazon Redshift

SQL

Data Warehousing

Performance tuning

Data processing

Education

Bachelor's degree in Computer Science/Software Engineering/IT

Tools

AWS Services (S3, IAM, CloudWatch, Lambda, Step Functions)

Job description

NorthBay - Pakistan is seeking a Lead Data Engineer to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines. The role requires 5–8+ years of hands-on experience with PySpark, AWS Glue, EMR, Redshift, and SQL-based data warehousing.

You will collaborate with a UAE-based customer, align with UAE working hours, and drive performance tuning and data governance across distributed teams.