Big Data Architect

iSystems Ltd; Punjab; On-site; PKR 1,000,000 - 2,500,000; Full time

Benefits offered by this job

null

Job summary

iSystems Ltd in Pakistan seeks an experienced Big Data expert to lead our platform's design, development, and maintenance, collaborating with data engineers and BI professionals across platform layers to deliver high-quality data products.

The role requires 10–14 years in enterprise data architecture, hands-on Spark Streaming and Kafka, plus Azure Databricks, Synapse, and Power BI, with a willingness to travel to the UK (about 25%).

Qualifications

• 10–14 years of enterprise data architecture, integration, and analytics experience.
• Experience architecting streaming pipelines, leading data engineers and BI developers.
• Bachelor’s degree in CS or related field; Master’s preferred.
• Strong cloud/Big Data stack knowledge including Azure and related tools.
• Awareness of data mgmt best practices and ML is a plus.

Responsibilities

• Facilitate and lead roadmap and enhancements for the enterprise Big Data platform.
• Lead Data Engineers, BI Developers, and analysts to deliver solutions meeting business needs.
• Ensure designs and code are production-ready with security and compliance in mind.
• Participate in daily project and production status meetings; provide technical support.
• Mentor and train future big data developers and architects.
• Design and implement scalable, near real-time data ingestion pipelines for low-latency analytics.
• Architect and optimize streaming solutions for high throughput with data consistency and fault tolerance.

Skills

Big data architecture

Streaming pipelines

Team leadership

Azure cloud

Education

Bachelor's degree in computer science or related field

Master's degree preferred

Tools

Apache Spark Streaming

Apache Kafka

Databricks

Azure Data Factory

Azure Synapse

Power BI

Job description

We seek an experienced Big Data expert to lead our Big Data platform's design, development, and maintenance. Collaborating with data engineers and Big Data Business Analysts across various platform layers, you'll demonstrate a commitment to collaborative problem-solving, sophisticated design, and delivering high-quality products.

Responsibilities:

• Facilitate and lead the roadmap and enhancements for the enterprise Big Data platform.
• Lead Data Engineers, Business Analysts, and BI engineers to architect and deliver the solutions that fulfill the Business information needs.
• Ensure the design, code, and procedural aspects of the solution are production-ready, in terms of operational, security, and compliance standards.
• Participate in day-to-day project and production delivery status meetings, and provide technical support for faster resolution of issues.
• Yearning for continuous learning and training/mentoring future big data developers and architects.
• Design and implement scalable, near real-time data ingestion pipelinesto enable low-latency data processing and analytics.
• Architect and optimize data streaming solutions to handle high-throughput, distributed systems while ensuring data consistency, reliability, and fault tolerance in near real-time workflows.

Qualifications:

• 10-14 years of experience in enterprise data architecture, integration, and analytics, with a proven track record of design and implementation of big data and analytics solutions in recent years.
• Must have experience with architecting streaming pipelines.
• Experience in leading a team of Data Engineers and BI Developers.
• Bachelor’s degree in computer science or relevant field from an accredited college or university; Master’s degree from an accredited college or university preferred.
• Strong technical experience in the following:
• Big data stack and solutions, including cloud technologies.
• Must have: Apache Spark Streaming, Apache Kafka
• Data lake architecture, including data model design and implementation (incl. relational, dimensional, and No-SQL).
• Enterprise Application and Data Integration design and implementation (e.g. ETL, messaging, replication, and APIs).
• Telco Domain Experience
• Azure Solutions Architect Certification
• Databricks, Azure Data Lake, Azure Data Factory, Azure SQL, Apache NiFi, Azure Synapse, Power BI
• Awareness of Data management best practices (e.g. data quality, metadata management, data lineage).
• Awareness of Machine Learning techniques is nice to have
• Willingness to travel to UK (25% travelling might be required)