Principal Data Engineer - II

Pakistan Single Window; Karachi Division; On-site; PKR 3,500,000 - 6,000,000; Full time

Benefits offered by this job

Competitive salary

Fuel Card

Health benefits

Professional development opportunities

Inclusive work culture & much more

Job summary

Pakistan Single Window is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and storage solutions in a fast-paced environment.

You will work with Data Scientists and Analysts to define data requirements, implement both real-time and batch processing, and ensure data quality and governance across the stack.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field.
• 7 to 8 years of experience as a Data Engineer or in a similar role, with expertise in building and maintaining data pipelines and infrastructure.
• Hands-on experience with big data tools, cloud platforms, and data integration techniques.
• Expertise in SQL and working with relational and NoSQL databases.
• Experience with data orchestration tools (e.g., ODI, SSIS, Apache Airflow, dbt, Prefect).
• Proficiency in programming languages like Python, Java, or Scala.
• Familiarity with data processing frameworks (e.g., Apache Spark, Kafka).
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.
• Ability to work in a fast-paced, team-oriented environment.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.
• Implement real-time data streaming and batch processing solutions to support diverse business needs.
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases.
• Ensure data systems and pipelines are scalable, secure, and performant.
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning.
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions.
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary.
• Troubleshoot and resolve data-related issues, ensuring minimal downtime.
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies.
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions.
• Provide technical expertise and guidance on data engineering best practices.
• Stay updated on emerging tools, technologies, and industry trends.
• Evaluate and recommend technologies to enhance data engineering capabilities

Skills

ETL/ELT pipelines

Real-time streaming

Batch processing

Data storage design

SQL

Python/Java/Scala

Data governance

Data quality

Collaboration with Analysts

Problem solving

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Apache Airflow

dbt

Prefect

ODI

SSIS

Kafka

Spark

Python

SQL

NoSQL databases

Job description

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.
• Implement real-time data streaming and batch processing solutions to support diverse business needs.
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases.
• Ensure data systems and pipelines are scalable, secure, and performant.
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning.
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions.
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary.
• Troubleshoot and resolve data-related issues, ensuring minimal downtime.
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies.
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business
• Teams, to understand requirements and deliver data solutions.
• Provide technical expertise and guidance on data engineering best practices.
• Stay updated on emerging tools, technologies, and industry trends.
• Evaluate and recommend technologies to enhance data engineering capabilities

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.

7 to 8 years of experience as a Data Engineer or in a similar role, with expertise in building and maintaining data pipelines and infrastructure.

Hands-on experience with big data tools, cloud platforms, and data integration techniques.

Expertise in SQL and working with relational and NoSQL databases.

Experience with data orchestration tools (e.g., ODI, SSIS, Apache Airflow, dbt, Prefect).

Proficiency in programming languages like Python, Java, or Scala.

Familiarity with data processing frameworks (e.g., Apache Spark, Kafka).

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Ability to work in a fast-paced, team-oriented environment.

• Competitive salary
• Fuel Card
• Health benefits
• Professional development opportunities
• Inclusive work culture & much more