Data Engineer

Lancesoft Europe; United Arab Emirates; On-site; AED 293,000 - 368,000; Full time

Job summary

A leading technology consulting firm is seeking a Data Engineer with extensive experience in the Big Data space, particularly with the Hadoop stack and various NoSQL stores. Candidates should have strong skills in Java, Python, and SQL with 7-10 years of relevant experience. Responsibilities include leading a data team, managing partnerships, and designing scalable data models. This role offers an opportunity to contribute significantly to innovative data solutions in a dynamic environment.

Qualifications

• 7-10+ years of experience as a Big Data Engineer.
• In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
• Good knowledge of Big Data querying tools like Pig, Hive, and Impala.
• Strong knowledge of scripting languages including Python and Java.

Responsibilities

• Lead a Backend/Distributed Data Systems team while being hands-on.
• Manage business intelligence team and vendor partners.
• Design and build dimensional data models to improve data accessibility.
• Write and tune complex Java, MapReduce, and Hive jobs.

Skills

Big Data querying tools

Java

Python

Spark

SQL

Hadoop

Machine Learning

Data Engineering

Tools

Hadoop

Spark

Hive

Azure

Cassandra

Job description

Description

Role : Data Engineer

Extensive experience in Big Data space (Hadoop Stack like M / R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc.) across Fractal and contributes to open-source Big Data technologies.

Write and tune complex Java, MapReduce, and Hive jobs.

Responsibilities

• Experience leading a Backend / Distributed Data Systems team while remaining hands‑on.
• Manage the business intelligence team and vendor partners, prioritizing projects according to customer and internal needs, and developing top‑quality dashboards using industry best practices.
• Manage a team of data engineers (both full‑time associates and/or third‑party resources).
• Analyze and confirm the integrity of source data to be evaluated.
• Lead deployment and auditing of models and attributes for accuracy.
• Experience with stream‑processing systems : Spark‑Streaming, Strom etc.
• Experience with object‑oriented/object function scripting languages : Python, Scala etc.
• Design and build dimensional data models to improve accessibility, efficiency, and quality of data.
• Write Advanced SQLs, performance tuning of SQLs, experience with data science and machine learning tools and technologies.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with Azure cloud services is a plus.
• Financial Services Knowledge is a plus.

Requirements

• Previous experience 7‑10+ as a big data engineer.
• In‑depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
• Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
• Own most deliverables for the Big Data team from a delivery perspective.
• Ability to solve complex networking, data, and software issues.
• Able to effectively plan & organize work.
• Strong interpersonal communication.
• Assist others in the completion of their tasks to support the group goals.
• Build and maintain cooperative work relationships with others.
• Enable skills‑based hiring.