Senior Data Engineer

Flatgigs; United Arab Emirates; On-site; AED 60,000 - 100,000; Full time

Job summary

An innovative firm is seeking a Senior Data Engineer to join a dynamic team focused on designing and implementing cutting-edge data solutions. This role provides an exciting opportunity to work with advanced analytics and machine learning initiatives, collaborating closely with cross-functional teams. The ideal candidate will have extensive experience in data engineering, proficiency in programming languages, and hands-on knowledge of big data tools. Join this mission-driven organization dedicated to climate action and enjoy competitive salary packages and opportunities for professional growth in a collaborative environment.

Benefits

Competitive salary

Potential equity opportunities

Opportunities for professional growth

Regular international travel within the Middle East

Qualifications

• 4+ years of experience in data engineering or related roles.
• Hands-on experience with big data tools and cloud platforms.
• Strong knowledge of relational and NoSQL databases.

Responsibilities

• Design and implement scalable data pipelines and infrastructure.
• Collaborate with data scientists and engineers for data solutions.
• Monitor and optimize data processing and storage solutions.

Skills

Python

Java

Scala

Data Engineering

ETL Processes

Data Modeling

Data Warehousing

Big Data Technologies

Data Quality Management

Education

Bachelor's degree in Computer Science

Master's degree in relevant field

Tools

Hadoop

Spark

Kafka

AWS

Azure

GCP

SQL

MySQL

PostgreSQL

MongoDB

Cassandra

Snowflake

Redshift

Docker

Kubernetes

Job description

FlatGigs is pleased to announce an excellent career opportunity with one of our distinguished clients. We are seeking a highly experienced Senior Data Engineer to join a fast-paced and innovative team. This role offers the chance to design and implement cutting-edge data solutions that support advanced analytics and machine learning initiatives.

Role Overview

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure. The role involves collaboration with cross-functional teams, including data scientists, analysts, and software engineers, to ensure efficient and innovative data-driven solutions.

Responsibilities

• Data Architecture and Engineering
• Develop and maintain scalable data pipelines and infrastructure for optimal data extraction, transformation, and storage
• Evaluate and select appropriate technologies and tools for data processing
• Data Integration and ETL
• Design and implement efficient ETL processes to integrate data from multiple sources
• Ensure data quality through validation, cleansing, and transformation
• Big Data Technologies
• Utilize big data tools such as Hadoop, Spark, and Kafka for processing and analysis
• Optimize workflows for performance and cost-efficiency
• Data Modeling and Warehousing
• Design and implement data models and data warehousing solutions to meet operational and analytical requirements
• Manage data lakes and warehouses, ensuring security and compliance
• Collaboration and Leadership
• Work closely with data scientists and engineers to deliver scalable data solutions
• Mentor junior team members and promote best practices
• Monitoring and Optimization
• Monitor data pipelines and infrastructure to identify and resolve issues
• Continuously improve performance and efficiency of data processing and storage solutions
• Documentation and Compliance
• Maintain comprehensive documentation of data workflows and architecture
• Ensure adherence to data privacy regulations and organizational policies
  
  

Requirements

Essential:

• Bachelor's degree in Computer Science, Engineering, or related field (Master's degree preferred)
• 4+ years of experience in data engineering or related roles
• Proficiency in programming languages such as Python, Java, or Scala
• Hands-on experience with big data tools (Hadoop, Spark, Kafka) and cloud platforms (AWS, Azure, GCP)
• Strong knowledge of relational (SQL, MySQL, PostgreSQL) and NoSQL databases (MongoDB, Cassandra)
• Experience with data warehousing solutions (e.g., Snowflake, Redshift) and data modeling techniques
  
  

Desirable:

• Certifications in cloud platforms or relevant technologies
• Familiarity with Agile development methodologies and CI/CD pipelines
• Experience with containerization tools (Docker, Kubernetes)
  
  

Benefits

• Join a mission-driven organization dedicated to climate action
• Competitive salary and potential equity opportunities
• Exposure to regular international travel within the Middle East
• Opportunities for professional growth in an innovative environment