Senior Data Engineer

HR WAYS; Lahore; On-site; PKR 14,116,000 - 19,763,000; Full time

Job summary

An IT consultancy firm in Lahore is seeking a Senior Data Engineer to architect and maintain scalable data pipelines. The ideal candidate has over 5 years of experience, strong expertise in AWS Redshift, and proficiency in Python. Responsibilities include designing OLTP and OLAP data schemas, developing ETL processes, and ensuring data quality and compliance. This is an onsite position based in DHA, Lahore.

Qualifications

• 5+ years of experience in data engineering or similar roles.
• Strong expertise in AWS Redshift and relational databases.
• Proficiency in Python (v3.8+) is required.

Responsibilities

• Architect and maintain scalable data pipelines.
• Design and optimize OLTP and OLAP data schemas.
• Develop ETL processes for data integration.

Skills

Data engineering

AWS Redshift

Python

SQL query optimization

ETL processes

Database architecture

Tools

AWS services

ORM frameworks

Job description

About the job Senior Data Engineer

Sr. Data Engineer - Onsite - Lahore

Company Overview:

Hiring for one of our IT consultancy firm in Lahore.

Key Responsibilities

1. Architect, build, and maintain scalable data pipelines for structured and unstructured data across various sources.
2. Design and optimize OLTP and OLAP data schemas for efficient storage, retrieval, and processing.
3. Develop and manage ETL processes to transform and integrate data from Aurora/MySQL to and from AWS Redshift, and other sources.
4. Implement best practices in data governance, performance optimization, and security across databases.
5. Collaborate with data scientists and analysts to ensure data availability for machine learning and analytical workloads.
6. Utilize Python and ORM frameworks for data modeling, transformation, and workflow automation.
7. Monitor and improve database performance, identifying bottlenecks and implementing optimizations.
8. Work with AWS services such as EC2, ECS, S3, and Lambda for scalable data processing.
9. Ensure data quality, consistency, and compliance with regulatory standards (GDPR, CCPA, etc.).

Required Skills & Experience

1. 5+ years of experience in data engineering, database architecture, or similar roles.
2. Strong expertise in AWS Redshift, Aurora / MySQL, and other relational databases.
3. Proficiency in Python (v3.8+) and experience with ORM frameworks.
4. Experience designing and implementing ETL pipelines for large-scale transactional and analytical data.
5. Familiarity with data modeling best practices for OLTP and OLAP workloads.
6. Experience handling high-throughput OLTP processes with transactional integrity.
7. Strong understanding of SQL query optimization and database indexing strategies.
8. Excellent problem-solving and troubleshooting skills for debugging data inconsistencies and performance issues.

Preferred Qualifications

1. Exposure to machine learning workflows and the integration of ML models into data pipelines is a big plus.
2. Hands-on experience with data warehousing best practices in AWS Redshift.
3. Understanding of server less architectures and cloud-native data solutions.
4. Experience working with large-scale distributed systems

Other Details:

Experience : 7+ years

Location : DHA, Lahore

Timings : Mon to Fri (10 am to 6pm)