Senior Data Engineer — PySpark & AWS Glue Expert

NorthBay - Pakistan; Karachi Division; Hybrid; PKR 1,200,000 - 2,400,000; Full time

Job summary

NorthBay - Pakistan is seeking a Senior Data Engineer with 5–8 years of experience to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines. The role requires hands-on PySpark, AWS Glue, EMR, Redshift, and SQL-based data warehousing expertise.

You will collaborate with a UAE-based customer and distributed teams, aligning with UAE working hours and holidays while operating in a hybrid Pakistan-based environment.

Qualifications

• 5–8 years of experience in Data Engineering and Data Warehousing.
• Hands-on PySpark experience.
• Extensive AWS Glue experience.
• Experience with Amazon EMR and Redshift.
• Strong SQL development and optimization skills.
• Knowledge of data warehousing concepts and ETL/ELT processes.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark, AWS Glue, and EMR.
• Build and optimize data ingestion, transformation, and processing for structured and semi-structured data.
• Develop and maintain data warehouse solutions using Redshift.
• Write complex SQL queries, stored procedures, and data transformations for analytics and reporting.
• Implement ETL/ELT processes to move data across systems and platforms.
• Tune performance of Spark jobs, ETL pipelines, SQL queries, and Redshift workloads.
• Ensure data quality, security, and governance across platforms.
• Troubleshoot production issues and perform root cause analysis.

Skills

PySpark

AWS Glue

Amazon EMR

Amazon Redshift

SQL

Data Warehousing

ETL/ELT

Performance Tuning

Distributed Data Processing

Troubleshooting

Education

Bachelor's degree in Computer Science or related field

Tools

AWS S3

IAM

CloudWatch

Lambda

Step Functions

Job description

NorthBay - Pakistan is seeking a Senior Data Engineer with 5–8 years of experience to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines. The role requires hands-on PySpark, AWS Glue, EMR, Redshift, and SQL-based data warehousing expertise.

You will collaborate with a UAE-based customer and distributed teams, aligning with UAE working hours and holidays while operating in a hybrid Pakistan-based environment.