Big Data Engineer

Müller's Solutions; Dubai; On-site; AED 240,000 - 420,000; Full time

Benefits offered by this job

Attractive Package

Family Benefits

Visa

Air Tickets

Job summary

A leading technology solutions firm in Dubai is looking for an experienced Big Data Engineer to design and develop scalable big data solutions. The role requires proficiency in big data technologies like Apache Spark, Hadoop, and Kafka, along with strong coding skills in Java, Scala, or Python. Candidates should have at least 3 years of experience and be familiar with cloud platforms such as AWS or Azure. This position offers a competitive package and various family benefits, including visa and air tickets.

Qualifications

• 3+ years of experience as a Big Data Engineer or similar role.
• Proficiency in big data technologies like Apache Spark, Hadoop, and Kafka.
• Strong coding skills in Java, Scala, or Python.
• Strong programming in Java, Scala, or Python.
• Familiarity with ETL tools and data processing frameworks.
• Experience with cloud platforms and data storage (HDFS, S3, BigQuery).
• Analytical mindset and strong problem-solving abilities.
• Excellent communication and teamwork skills.
• Self-motivated with ability to manage multiple tasks and deadlines.

Responsibilities

• Design and maintain scalable data pipelines using big data technologies.
• Collaborate with teams to identify data requirements.
• Ensure high data quality and implement validation processes.
• Monitor and troubleshoot data processing workflows.
• Monitor and troubleshoot data workflows to ensure timely data delivery.
• Document data architectures, processes, and workflows for knowledge sharing and compliance.
• Stay ahead of industry trends and best practices in big data technologies.

Skills

Apache Spark

Hadoop

Apache Kafka

Java

Scala

Python

ETL tools

Cloud platforms (AWS/Azure/GC)

Data processing & analytics

Data modeling

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Tools

AWS

Azure

Google Cloud

HDFS

S3

BigQuery

Docker

Kubernetes

Job description

Müller's Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka
• Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs
• Ensure high data quality and integrity by implementing robust data validation and testing processes
• Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments
• Monitor and troubleshoot data processing workflows to ensure timely data delivery
• Document data architectures, processes, and workflows for knowledge sharing and compliance
• Stay ahead of industry trends and best practices in big data technologies and methodologies

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field
• 3+ years of experience as a Big Data Engineer or in a similar data engineering role
• Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka
• Strong coding skills in programming languages like Java, Scala, or Python
• Familiarity with data processing frameworks and ETL tools
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery)
• Analytical mindset and excellent problem-solving abilities
• Strong communication skills to collaborate effectively with technical and non-technical stakeholders
• A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines

Preferred Qualifications

• Experience with machine learning frameworks and algorithms is a plus
• Knowledge of data governance and security best practices
• Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes

Benefits

• Attractive Package
• Family Benefits
• Visa
• Air Tickets