Data Engineer: Scalable Pipelines for AI & Analytics

Halian | Managed Services, Recruitment Agency & Contract Staffing; Abu Dhabi; On-site; AED 300,000 - 520,000; Full time

Job summary

Halian is seeking a Data Engineer in Abu Dhabi to join a growing technology team building scalable data platforms for analytics, AI, and decision making. You will design, develop, and maintain high-performance data pipelines, working with scientists, architects, product teams and stakeholders to deliver robust data solutions.

The role emphasizes data security, governance, and observability, with a focus on batch and real-time processing, lakehouse architectures, and modern data tooling.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related field.
• 3-5 years of experience in Data Engineering, Big Data Engineering, or related disciplines.
• Proven experience building and supporting enterprise-scale data platforms.
• Strong understanding of modern data architecture patterns and distributed systems.
• Experience delivering production-grade data solutions within Agile environments.

Responsibilities

• Design, build, and maintain scalable data platforms capable of supporting large-scale analytics and operational workloads.
• Develop robust batch and real-time data pipelines for ingesting, transforming, and processing structured and unstructured data.
• Build and optimise data architectures supporting business intelligence, advanced analytics, machine learning, and AI initiatives.
• Implement data models, lakehouse architectures, and change data capture solutions.
• Develop high-performance systems capable of processing large volumes of data with low latency and high reliability.
• Ensure all data pipelines are secure, observable, monitored, and aligned with agreed service levels.
• Implement data quality frameworks, validation rules, lineage tracking, and governance controls.
• Monitor and optimise platform performance, scalability, and operational costs.
• Troubleshoot and resolve production issues across data pipelines and processing platforms.
• Support ongoing improvements to data platform reliability and operational excellence.
• Partner with Product, Engineering, Data Science, and Analytics teams to deliver high-value data solutions.
• Work closely with internal and external stakeholders to integrate new data sources and systems.
• Participate in Agile ceremonies, sprint planning, and technical design discussions.
• Contribute to architectural decisions and provide recommendations on emerging technologies and best practices.
• Support the delivery of AI and data-driven initiatives through the provision of scalable datasets and data services.

Job description

Halian is seeking a Data Engineer in Abu Dhabi to join a growing technology team building scalable data platforms for analytics, AI, and decision making. You will design, develop, and maintain high-performance data pipelines, working with scientists, architects, product teams and stakeholders to deliver robust data solutions.

The role emphasizes data security, governance, and observability, with a focus on batch and real-time processing, lakehouse architectures, and modern data tooling.