EN
602
Data Specialist jobs in United Arab Emirates
Data Engineer (3-5 Yrs)
Solanalytics
Dubai
On-site
AED 120,000 - 180,000
Full time
30+ days ago
Job summary
A leading company in data engineering is seeking a skilled Data Engineer to design and optimize data pipelines and governance frameworks. The ideal candidate will have extensive experience in data storage solutions, ETL processes, and cloud computing platforms while providing technical leadership to the team. This opportunity offers strategic alignment with organizational goals and robust career growth.
Qualifications
- 3-5 years of experience in data engineering is required.
- Proficiency in Python, Scala, or Java for data systems.
- Strong knowledge of cloud computing platforms and services.
Responsibilities
- Architect and optimize scalable data storage solutions.
- Develop robust ETL processes for reliable data ingestion.
- Establish data governance policies for data quality and security.
Skills
Data Engineering
Python
Scala
Java
Data Governance
Cloud Computing
SQL Optimization
Data Modeling
Education
Bachelor's degree in Software Engineering
Bachelor's degree in Computer Science
Bachelor's degree in Engineering
Tools
AWS Glue
Azure Data Factory
Google Dataflow
Microsoft SQL Server
Job description
Job DescriptionData Pipeline Architecture and Development:
- Architect and optimize scalable data storage solutions, including data lakes, warehouses, and NoSQL databases, supporting large-scale analytics.
- Design and maintain efficient data pipelines using technologies such as Apache Spark, Kafka, Fabric Data Factory, and Airflow, based on cross-functional team requirements.
- Develop robust ETL processes for reliable data ingestion, utilizing tools like SSIS, ADF, and custom Python scripts to ensure data quality and streamline workflows.
- Optimize ETL performance through techniques like partitioning and parallel processing.
- Define and implement data models and schemas for structured and semi-structured sources, ensuring consistency and efficiency while collaborating with data teams to optimize performance.
- Establish and enforce data governance policies, ensuring data quality, security, and compliance with regulations, using tools like Microsoft SQL Server.
- Implement access controls, encryption, and auditing to protect sensitive data and collaborate with IT to address vulnerabilities.
- Manage and optimize cloud and on-prem infrastructure for data processing, monitor system performance, and implement disaster recovery enhancements.
- Leverage automation for provisioning, configuration, and deployment to improve operational efficiency.
- Provide technical leadership, mentoring team members in best practices and cloud technologies, while aligning data engineering initiatives with strategic goals.
- Bachelor's degree or higher in Software Engineering, Computer Science, Engineering, or a related field.
- 3-5 years of experience in data engineering, with a proven history of designing and implementing complex data infrastructure.
- Proficient in Python, Scala, or Java, with experience in scalable, distributed systems.
- Strong knowledge of cloud computing platforms and related services like AWS Glue, Azure Data Factory, or Google Dataflow.
- Expertise in data modeling, schema design, and SQL query optimization for both relational and NoSQL databases.
- Excellent communication and leadership skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.