Senior PySpark Data Architect — Scalable Pipelines

iSystems Ltd; Punjab; On-site; PKR 1,200,000 - 1,800,000; Full time

Job summary

iSystems Ltd is seeking a Data Architect with strong hands-on PySpark expertise to design and maintain scalable data processing solutions. You will work on ETL/ELT pipelines, develop reusable PySpark components, and optimize performance across cloud or on-prem environments.

The ideal candidate has 8+ years in data engineering, deep SQL skills, and experience with Databricks, Delta Lake, and CI/CD practices.

Qualifications

• 8+ years in Data Engineering or related field.
• Hands-on PySpark experience required.
• Production-grade PySpark code experience mandatory.
• Strong SQL with complex queries, joins, aggregations, and performance optimization.

Responsibilities

• Design, develop, and maintain scalable PySpark pipelines.
• Optimize PySpark jobs for performance and memory usage.
• Implement data validation, logging, and monitoring in pipelines.
• Collaborate with data stakeholders on requirements and design.
• Mentor junior engineers and review code.

Skills

PySpark

Python

SQL

Spark Architecture

Git

CI/CD

Tools

Databricks

Delta Lake

Azure Data Lake

Kafka

Hive

Git

Job description

iSystems Ltd is seeking a Data Architect with strong hands-on PySpark expertise to design and maintain scalable data processing solutions. You will work on ETL/ELT pipelines, develop reusable PySpark components, and optimize performance across cloud or on-prem environments.

The ideal candidate has 8+ years in data engineering, deep SQL skills, and experience with Databricks, Delta Lake, and CI/CD practices.