Enable job alerts via email!

Sr. DevOps Data Hadoop Engineer

Synechron

Dubai

On-site

AED 180,000 - 240,000

Full time

Today
Be an early applicant

Job summary

A leading technology services provider in Dubai is seeking a Technology Engineer to implement and drive change within the platform environment. The ideal candidate has extensive experience with Cloudera and automation technologies, along with a solid understanding of Agile methodologies. This role involves working closely with various teams to optimize platform features and ensure successful project deliveries.

Qualifications

  • At least 4 years of production Hadoop experience.
  • 8 years of hands-on Technology experience.
  • Excellent communication and articulation skills.

Responsibilities

  • Implement design and build of the platform from inception to maturity.
  • Drive change and deliver new technology by onboarding customers.
  • Work closely with other Platforms and Product teams.

Skills

Cloudera production experience
Automation Ansible
Automated pipelines/workflows
Python programming
Kubernetes/OpenShift
Linux OS basics
Git source control

Education

IT or similar bachelor's degree

Tools

GitHub Actions
Jenkins
Podman
Docker
Job description
Job Purpose

Group IT has a matrix management structure. The Technology Engineer role will have line management and reporting into the VP Technology Chapter but will be assigned to a Platform squad for task management and prioritisation. The engineer will implement the design and build of the platform along with all associated components from inception to maturity of the running environment over time. The role will be responsible for driving change and delivering new technology into the Bank by onboarding customers and applications to the Platform via self‑service and automation.

The engineer will work closely with other Platforms and Product teams in educating them on the new Platform services and features to ensure any transition and consumption is optimal. Teams work using Agile DevOps Product Management methodologies delivering work packages based on the priority in the backlog.

Job Content

Key Results

Performance Measures

Main Tasks

Technology Engineering
  • Hands on Tier 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation Ansible data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions Jenkins ArgoCD etc.) for data projects. Python based preferred.
  • Shell Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization Podman Docker
  • Container Management Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)
  • Agile engineering and practices
  • Some Python programming experience
Relationship Management
  • Trustful and professional relationships with key stakeholders
  • Has developed synergies across services optimizing re-use promoting simplification and demonstrating speed‑to‑market benefits
  • Commercial and business focused to improve IT services
  • Trustful and pragmatic approach to problem solving
  • Ability to adopt the Groups values and drive adoption of the values across the team
Delivery Experience
  • Ability to work on projects from inception to delivery
  • Decision making to decide on best solution based on cost time and quality of options
  • Cross skills in delivery but also operational support as per the new DevOps model
  • Implementing robust solutions to minimize operational effort
Internal / External Relationships and Committee Memberships

Interface (Int/Ext)

Reason

Committee

Reason

Technical Platforms

Work with the wider infrastructure team to ensure consistency of the deliverables.

Security Chapter

Align with Security standards and collaborate on different design forums

Architecture Chapter

Align with Architecture standards and collaborate on different design forums

Business Platforms

Work with the wider application and product teams to ensure consistency of the deliverables.

Data Chapter

Align with Data standards and collaborate on different design forums

Agile Chapter

Align with Agile standards and collaborate on different design forums

Problems & Decisions

Desired Outcome

Non‑Standardized stack or product

Establish an updated stack of standard products

High TCO of the products

Look for improvements and automate where possible

Platform Strategy is not well defined

Drive Product Roadmaps and backlog

Person Specifications
Specifications
Description of Knowledge / Skill etc.
Desirable or Essential
Education
  • General
  • Professional
  • IT or similar bachelors degree or higher
  • Equivalent work experience
Experiences

(Years & Type)

  • Industry
  • Regional
  • Functional
  • At least 4 years production Hadoop experience
  • 8 years hands on Technology experience
  • Experience with large and complex global enterprises defined by high availability broad observability and high level of reliability.
  • At least 1 project experience in Data Science project/products
  • Excellent communication and articulation skills
Knowledge & Skills
  • Technical/Functional:
    • Hands on Tier 2 production experience with Cloudera:
      • Installing and maintenance
      • Optimizing cluster performance
      • Working with data engineers to optimize Spark job performance
      • Automation Ansible data/analytics jobs CI/CD
      • Observability
    • Automated pipelines/workflows (GitHub Actions Jenkins ArgoCD etc.) for data projects. Python based preferred.
    • Some Python programming experience
    • Shell Groovy scripting experience
    • Automating security/regulatory checks
    • Automated patching
    • Containerization Podman Docker
    • Container Management Kubernetes/OpenShift
    • Linux OS & Networking basics
    • Source control (git)
  • Agile engineering and practices
  • Nice to have:
    • Public cloud exposure
    • Data Science projects/products
Behavioral Competencies
  • Collaboration
  • Self‑starter with strong initiative
  • Innovative and experimental mindset
  • Calm under pressure
  • Pragmatic and focused
SYNECHRONS DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.

All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.

Candidate Application Notice

Required Experience:

Senior IC

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.