Data Engineer - Pyspark

Systems Limited; Punjab; Presencial; PKR 3.500.000 - 5.500.000; Jornada completa

Descripción de la vacante

Systems Limited is seeking an experienced data engineer to design and implement scalable data warehousing solutions on Azure Synapse. The role includes migrating data systems to Azure Cloud, optimizing data pipelines, and contributing to data architecture while ensuring governance and security.

You will interact with stakeholders, provide technical leadership, and document architectures and procedures. The ideal candidate has 4+ years in cloud data engineering, strong proficiency in

Formación

• Bachelor’s or master's degree in computer science, Engineering, Information Technology, or a related field.
• 4+ years of experience in data engineering with a strong focus on cloud-based solutions.
• Expertise in Azure Synapse Analytics, including data integration, management, and security.
• Proficient with SQL, Python, PySpark, and other scripting languages commonly used in data engineering.
• Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep or Terraform
• Deep knowledge of ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes and experience with Azure Data Factory.
• Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.
• Proven consulting or advisory roles in the design and deployment of large-scale data solutions in Azure environments.
• Experience working directly with clients or stakeholders in a consulting capacity, translating business needs into technical specifications and actionable plans.
• Demonstrated ability to contribute to project leadership, coordinate across client functional groups, and manage client relationships.
• Microsoft Certified: Azure Solutions Architect Expert preferrable

Responsabilidades

• Design and implement highly scalable, high performance data warehousing solutions in Azure Synapse.
• Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.
• Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.
• Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.
• Implement data security and privacy policies in line with industry best practices and organizational standards.
• Optimize data integration pipelines for performance and scalability.
• Develop and maintain documentation regarding data architectures, procedures, and solutions.

Conocimientos

Data engineering

Azure Synapse

SQL

Python

PySpark

IaC

ARM/Terraform

ETL/ELT

Data modeling

Data warehousing

Data governance

Azure Data Factory

Consulting

Stakeholder mgmt

Security

Educación

Bachelor’s or Master’s in CS/Engineering/IT

Herramientas

Azure Synapse Analytics

Azure Data Factory

ARM/Terraform

Descripción del empleo

Systems Ltd is looking for a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of accomplishment of delivering scalable and efficient data solutions to meet complex business requirements.

Key Responsibilities

• Design and implement highly scalable, high performance data warehousing solutions in Azure Synapse.
• Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.
• Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.
• Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.
• Implement data security and privacy policies in line with industry best practices and organizational standards.
• Optimize data integration pipelines for performance and scalability.
• Develop and maintain documentation regarding data architectures, procedures, and solutions.

Required Skills & Experience

• Bachelor’s or master's degree in computer science, Engineering, Information Technology, or a related field.
• 4+ years of experience in data engineering with a strong focus on cloud-based solutions.
• Expertise in Azure Synapse Analytics, including data integration, management, and security.
• Proficient with SQL, Python, PySpark, and other scripting languages commonly used in data engineering.
• Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep or Terraform
• Deep knowledge of ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes and experience with Azure Data Factory.
• Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.
• Proven consulting or advisory roles in the design and deployment of large-scale data solutions in Azure environments.
• Experience working directly with clients or stakeholders in a consulting capacity, translating business needs into technical specifications and actionable plans.
• Demonstrated ability to contribute to project leadership, coordinate across client functional groups, and manage client relationships.
• Microsoft Certified: Azure Solutions Architect Expert preferrable