Data Engineer

Confidential Jobs; Abu Dhabi; On-site; AED 350,000 - 600,000; Full time

Benefits offered by this job

Continuous learning & certifications

Diversity and inclusion

Stable, forward-thinking organization

Job summary

Confidential Jobs is seeking a Data Platform Engineer with 7+ years in data engineering to design, build, and optimize scalable data platforms. You will lead pipelines, governance, and cross-functional collaboration to meet business objectives and regulatory requirements.

The role emphasizes performance, security, and cost optimization while enabling batch and real-time data processing across enterprise systems.

Qualifications

• :Bachelor’s degree required.
• :Proficient in Arabic is a plus.
• :Excellent communication and presentation skills for all levels.
• :Strong teamwork and collaboration skills.

Responsibilities

• :Implement scalable, high-performance data platform architecture using Databricks.
• :Lead development of data pipelines, standards, practices, and tools.
• :Provide technical expertise for data platform initiatives.
• :Collaborate with data scientists, BI, and stakeholders to align platforms with business goals.
• :Develop and deploy data platform solutions ensuring performance, security, and compliance.
• :Optimize data ingestion, storage, and processing to reduce costs.
• :Develop data warehousing, models, and performance optimization.
• :Establish data integration and ETL/ELT processes with governance.
• :Ensure integration with existing systems and support batch and real-time data.

Skills

Leadership

Communication

Problem solving

Teamwork

Education

Bachelor’s degree

Tools

Databricks

Big data tech

ETL/ELT

Job description

This role is responsible for the design, development, and optimization of data platforms that support the organization's strategic data & analytics goals. This role will work on the implementation of data platform solutions, ensuring scalability, performance, and reliability. This role requires deep expertise in data platform engineering, a strong understanding of data architecture, and the ability to drive innovation and promote automation of work.

Key Responsibilities:

• Implement scalable, high-performance data platform architecture and technologies using Databricks.
• Lead the development of data engineering pipelines, standards, practices, and tools.
• Provide technical expertise for data platform initiatives.
• Collaborate with stakeholders (data scientists, business analysts, and others) to align data platform implementation with business plan and objectives.
• Work on and oversee the development and deployment of data platform solutions (acquisition, storage, transformation, query, analysis, consumption), ensuring they meet performance, security, and compliance requirements.
• Deliver industry best practices data orchestration to minimize data pipeline downtime and efficient use of resources. Optimize data ingestion, storage, retrieval, and processing technology and operations with a focus to improve performance and reduce costs.
• Develop and manage data warehousing solutions, including data models, schema design, and database performance optimization.
• Develop processes for data integration, ETL/ELT processes, and data quality controls within data pipelines. Ensure adherence and compliance to data governance policies.
• Ensure seamless integration of data platforms with existing systems and data sources (including big data), supporting both batch and real-time data ingestion and processing. Implement and maintain data storage structures (e.g., data lake, lake house, ODS etc.), in addition to data warehousing, to support data analysis, reporting, and business intelligence needs.
• Work with cross-functional business and data management teams, including data science, business intelligence, and technology teams, to ensure platform solutions meet diverse needs.

The responsibilities and duties outlined above are not exhaustive and may evolve over time. The role may require additional tasks and responsibilities as assigned by the line manager or higher authorities, in alignment with organizational needs.

What We’re Looking For

Education:

• Educated with at least bachelor’s degree
• Proficient in Arabic is a plus
• Excellent communication and presentation skills for all levels
• Strong teamwork skills
• Certifications in Databricks, and relevant big data and data integration technologies
• Proficiency in Vietnamese, Russian, Turkish, or Central Asian languages is a plus

Experience:

• 7+ years of experience in data engineering, data platform development, or a related field
• Extensive experience with big data technologies and data platforms
• Strong understanding of data modelling, data warehousing, and ETL/ELT processes
• Proven experience in designing and optimizing large-scale data solutions
• Experience in project management
• Excellent leadership, communication, and problem-solving skills
• Able to lead a project team
• Able to deal with varied tasks and to work under pressure to meet deadlines and target
• Able to work effectively and responsibly without close supervision
• Able to foster a culture of collaboration, innovation, transparency, and accountability
• Able to execute clear strategies and corporate requirements
• Able to articulate ideas to both technical and non-technical audiences
• Professional demeanour and presentation, leads by example
• Demonstrates ability to manage change and foster teamwork

Why Join Us?

• Opportunities for continuous learning, certifications, and professional development.
• Dedicated to building a diverse and inclusive workplace where everyone feels valued and empowered to be their authentic selves.
• Committed to building a stable, forward-thinking organization where innovation thrives.