Data Architect

Confiz; Lahore; On-site; PKR 2,750,000 - 3,500,000; Full time

Job summary

A leading technology firm in Lahore is looking for an experienced Data Architect to lead the architectural strategy for their data platforms. The ideal candidate will have over 12 years of progressive experience in data engineering and architecture, with significant expertise in Python, SQL, and streaming architectures. This role focuses on setting data governance frameworks, designing lakehouse architectures, and mentoring engineering teams. Attractive work culture and collaboration are emphasized.

Benefits

Cutting-edge technologies

Collaboration-focused culture

Learning and development opportunities

Qualifications

• 12+ years of experience in data engineering and architecture, with at least 3+ years in a lead/architect role.
• Expert-level knowledge in Python, SQL, and scalable distributed systems.
• Deep expertise in streaming architectures with Kafka, Flink, and Spark Streaming.

Responsibilities

• Define and evolve the data architecture roadmap, ensuring alignment with business goals.
• Lead the design of lakehouse architectures leveraging technologies such as Apache Spark, Delta Lake, Iceberg, and Parquet.
• Mentor and guide senior and mid-level data engineers across solutioning and technical decisions.

Skills

Python

SQL

Kafka

Apache Flink

Apache Spark

Azure

Docker

Kubernetes

Apache Airflow

Terraform

Education

Bachelor’s or Master’s degree in Computer Science or related discipline

Tools

Apache Kafka

Apache Flink

Azure Data Factory

Docker

Kubernetes

Job description

We are looking for an experienced Data Architect with 12+ years of progressive experience in data engineering, architecture design, and technical leadership. You will lead the architectural strategy and execution for our real-time and batch data platforms, ensuring scalability, reliability, and performance across a modern cloud-native ecosystem. This role is suited for a visionary technologist who can drive enterprise-grade solutions, establish best practices, and mentor high-performing engineering teams.

Key Responsibilities:

• Define and evolve the data architecture roadmap, ensuring alignment with business goals and scalability of data platforms.


• Architect real-time streaming and batch data pipelines using Kafka, Apache Flink, and Spark Structured Streaming.


• Lead the design of lakehouse architectures leveraging technologies such as Apache Spark (PySpark), Delta Lake, Iceberg, and Parquet.


• Establish governance, security, and compliance frameworks across data platforms and pipelines.


• Set standards for data orchestration using tools like Apache Airflow and Azure Data Factory.


• Guide the containerization strategy with Docker, Kubernetes, and Helm for scalable deployment of data applications.


• Architect and optimize analytics engines such as Trino or Presto for high-performance query execution.


• Define and implement observability frameworks to monitor SLAs, lineage, data quality, and pipeline health.


• Collaborate with DevOps on infrastructure-as-code (IaC) using Terraform and CI/CD automation through Azure DevOps.


• Establish and advocate best practices for coding standards, modular development, and testing in Python and SQL.


• Collaborate cross-functionally with product owners, data scientists, platform teams, and engineering leads.


• Lead architecture reviews, POCs, and technology evaluations to guide technology adoption and innovation.


• Mentor and guide senior and mid-level data engineers across solutioning, technical decisions, and design patterns.

Required Skills & Experience:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related discipline.


• 12+ years of experience in data engineering and architecture, with at least 3+ years in a lead/architect role.


• Must have the ability to take things to completion overcoming challenges like unavailability of stakeholders or information.


• Expert-level knowledge in Python, SQL, and scalable distributed systems.


• Deep expertise in streaming architectures with Kafka, Flink, and Spark Streaming.


• Strong experience designing and implementing batch data workflows using Apache Spark (PySpark).


• In-depth knowledge of cloud data platforms, particularly Azure (preferred).


• Extensive experience with data orchestration tools like Airflow and Azure Data Factory.


• Proven ability to design and implement data lakehouse architectures with formats like Parquet, Delta Lake, and Iceberg.


• Proficiency in containerization (Docker), orchestration (Kubernetes), and deployment via Helm.


• Solid experience implementing observability, lineage, and data quality frameworks, such as Great Expectations.


• Strong background in infrastructure as code (Terraform) and CI/CD integrations.


• Deep understanding of data governance, metadata management, and data privacy standards.


• Excellent communication skills with the ability to influence stakeholders and present architectural strategies to leadership.


• Experience working in agile development environments and fostering team-wide engineering excellence.


• Experience with large-scale API architecture and scalable data access layers is a plus.


• Familiarity with AI/ML-integrated data systems or tools (e.g., text-to-SQL) is a bonus.

We have an amazing team of 700+ individuals working on highly innovative enterpriseprojects & products. Our customer base includes Fortune 100 retail and CPGcompanies, leadingstore chains, fast-growth fintech, and multipleSilicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015,27001:2013 & 20000-1:2018 certified. We have a vibrant culture of learning via collaboration and making the workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.

To know more about Confiz Limited, visit:https://www.linkedin.com/company/confiz-pakistan/