Big Data Architect

Systems Limited; Punjab; On-site; PKR 4,000,000 - 6,500,000; Full time

Job summary

Systems Limited seeks an experienced Big Data expert to lead the design, development, and maintenance of our enterprise Big Data platform. You will collaborate with data engineers, BI developers, and analysts across multiple layers to deliver high-quality, scalable data solutions.

You will oversee the roadmap, guide streaming pipelines, and ensure production-readiness with strong security and compliance. UK travel (up to 25%) may be required as part of engagement.

Qualifications

• 14 years of enterprise data architecture, integration, and analytics experience.
• Experience architecting streaming pipelines and leading data teams.
• Strong knowledge of Azure data services and big data stack.
• Bachelor's degree; Master’s preferred.

Responsibilities

• Lead roadmap and enhancements for the enterprise Big Data platform.
• Architect and deliver data solutions meeting business information needs.
• Ensure production-ready design, security, and compliance.
• Mentor and train future big data developers and architects.
• Coordinate with data engineers, BI engineers, and analysts.
• Support near real-time ingestion and analytics pipelines.

Skills

Big data architecture

Streaming pipelines

Leadership

Data integration

Cloud technologies

Spark Streaming

Apache Kafka

ETL design

Data quality

Data governance

Travel willingness

Education

Bachelor’s degree in CS or related field

Master’s degree preferred

Tools

Databricks

Azure Data Lake

Azure Data Factory

Azure Synapse

Apache NiFi

Power BI

Job description

We seek an experienced Big Data expert to lead our Big Data platform's design, development, and maintenance. Collaborating with data engineers and Big Data Business Analysts across various platform layers, you'll demonstrate a commitment to collaborative problem-solving, sophisticated design, and delivering high-quality products.

Responsibilities:

• Facilitate and lead the roadmap and enhancements for the enterprise Big Data platform.
• Lead Data Engineers, Business Analysts, and BI engineers to architect and deliver the solutions that fulfill the Business information needs.
• Ensure the design, code, and procedural aspects of the solution are production-ready, in terms of operational, security, and compliance standards.
• Participate in day-to-day project and production delivery status meetings, and provide technical support for faster resolution of issues.
• Yearning for continuous learning and training/mentoring future big data developers and architects.
• Design and implement scalable, near real-time data ingestion pipelinesto enable low-latency data processing and analytics.
• Architect and optimize data streaming solutions to handle high-throughput, distributed systems while ensuring data consistency, reliability, and fault tolerance in near real-time workflows.

Requirements:

• 14 years of experience in enterprise data architecture, integration, and analytics, with a proven track record of design and implementation of big data and analytics solutions in recent years.
• Must have experience with architecting streaming pipelines.
• Experience in leading a team of Data Engineers and BI Developers.
• Bachelor’s degree in computer science or relevant field from an accredited college or university; Master’s degree from an accredited college or university preferred.
• Strong technical experience in the following:
• Big data stack and solutions, including cloud technologies.
• Must have: Apache Spark Streaming, Apache Kafka
• Data lake architecture, including data model design and implementation (incl. relational, dimensional, and No-SQL).
• Enterprise Application and Data Integration design and implementation (e.g. ETL, messaging, replication, and APIs).
• Telco Domain Experience
• Azure Solutions Architect Certification
• Databricks, Azure Data Lake, Azure Data Factory, Azure SQL, Apache NiFi, Azure Synapse, Power BI
• Awareness of Data management best practices (e.g. data quality, metadata management, data lineage).
• Awareness of Machine Learning techniques is nice to have
• Willingness to travel to UK (25% travelling might be required)