AI & Data Center of Excellence - Abu Dhabi, UAE Role Overview As a Data Engineer, you will be responsible for building and maintaining scalable, reliable, & secure data platforms that power analytics & AI use cases across the organization. This role is critical in enabling data-driven decision-making in financial services environments. You will work closely with data scientists, AI engineers, & business stakeholders to ensure data systems are robust, performant, & aligned with regulatory & operational requirements.
Experience Bands
- Senior Data Engineer: 8-10 years of experience
- Data Engineer: 5-7 years of experience
Key Responsibilities
- Design and implement robust ETL/ELT pipelines for structured & unstructured data
- Build and manage scalable data lakes, data warehouses, & real-time data pipelines
- Ensure data quality, lineage, governance, & compliance across data platforms
- Enable reliable data availability for analytics, reporting, & AI systems
- Optimize data infrastructure for performance, scalability, & cost efficiency
- Collaborate with Data Science & AI teams to productionize machine learning pipelines
- Monitor & troubleshoot data workflows & system performance
- Implement best practices for data security & reliability
Financial Services Use Cases (Preferred)
Candidates with experience in financial data environments will be highly valued, particularly in:
- Transaction data pipeline development & management
- Regulatory reporting & compliance data systems
- Risk & finance data marts
- Customer 360 & customer analytics platforms
Technical Skills
- Data Platforms
- Snowflake
- BigQuery
- Amazon Redshift
- Databricks
- Data Processing Technologies
- Apache Spark
- Apache Kafka
- Apache Flink
- Databases
- SQL databases
- NoSQL databases
- DevOps & Engineering Practices
- CI/CD pipelines
- Version control systems (e.g., Git)
- Containers & Infrastructure
- Cloud Platforms
- AWS
- Azure
- Google Cloud Platform (GCP)
Evaluation Criteria
- Complexity & scale of data systems built & maintained
- Reliability & performance of data pipelines & production environments
- Experience implementing data governance & compliance standards
- Exposure to AI & machine learning data pipelines
- Ability to design scalable & resilient data architectures
Key Performance Indicators (KPIs)
- Reliability of data pipelines (uptime, failure rate)
- Data latency & freshness
- Data quality & integrity metrics
- Cost optimization & efficiency of data infrastructure
- Stability & scalability of data platforms
Preferred Profile
- Experience working within financial data ecosystems
- Understanding of regulatory data requirements & compliance standards
- Exposure to MLOps & machine learning data pipelines
- Experience working in distributed or cross-functional teams
- Strong problem-solving & ownership mindset