Lead Data Engineer — AWS Data Platform | PySpark & Redshift

NorthBay Solutions

Islamabad

Hybrid

PKR 2,500,000 - 5,000,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

NorthBay Solutions is seeking a Lead Data Engineer (AWS Data Platform) with 5–8+ years of experience to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines. You will lead technical initiatives, mentor teammates, and collaborate with distributed teams across time zones.

The role requires hands-on expertise in PySpark, AWS Glue, Amazon EMR, Amazon Redshift, and SQL-based data warehousing, plus performance tuning, data quality, governance, and strong communication with

Qualifications

5–8+ years of experience in Data Engineering and Data Warehousing.
Hands-on experience with PySpark.
Extensive experience with AWS Glue.
Experience building and managing workloads on Amazon EMR.
Strong expertise with Amazon Redshift.
Excellent SQL development and query optimization skills.
Understanding of data warehousing concepts, dimensional modeling, and ETL/ELT processes.
Performance tuning of Spark jobs, ETL pipelines, and warehouse workloads.

Responsibilities

Design, develop, and maintain scalable data pipelines using PySpark, AWS Glue, and EMR.
Build and optimize data ingestion, transformation, and processing frameworks for structured and semi-structured data.
Develop and maintain data warehouse solutions using Amazon Redshift.
Write complex SQL queries, stored procedures, and data transformations to support analytics and reporting.
Implement ETL/ELT processes to move data across systems.
Perform performance tuning and optimization of Spark jobs and queries.
Ensure data quality, integrity, security, and governance across platforms.
Troubleshoot production issues and perform root cause analysis.
Collaborate with stakeholders and cross-functional teams to understand data requirements.