Sr. DevOps Data Hadoop Engineer

Synechron

Dubai

Presencial

AED 360.000 - 600.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Synechron in Dubai seeks a Technology Engineer within Group IT to drive platform design, onboarding customers, and automation across the stack from inception to maturity. The engineer will onboard applications to the Platform via self-service and automation, and work with Platform, Data, and Security teams to ensure efficient transitions and optimal consumption.

You will apply Agile DevOps practices, deliver end-to-end from concept to production, and contribute to continued platform maturity

Formación

  • IT or similar bachelor’s degree or higher.
  • Equivalent work experience.
  • At least 4 years production Hadoop experience.
  • 8 years hands on Technology experience.
  • Experience with large and complex global enterprises defined by high availability, broad observability and high level of reliability.
  • At least 1 project experience in Data Science projects/products.
  • Excellent communication and articulation skills.

Responsabilidades

  • Hands on Tier 2 production experience with Cloudera: Installing and maintenance.
  • Optimization of cluster performance.
  • Working with data engineers to optimize Spark job performance.
  • Automation Ansible data/analytics jobs CI/CD.
  • Observability.
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD) for data projects; Python based preferred.
  • Shell Groovy scripting experience.
  • Automating security/regulatory checks.
  • Automated patching.
  • Containerization Podman Docker.
  • Container Management Kubernetes/OpenShift.
  • Linux OS & Networking basics.
  • Source control (git).
  • Agile engineering and practices.
  • Some Python programming experience.

Conocimientos

Cloudera production experience
Spark performance optimization
Automation Ansible CI/CD
Observability
GitHub Actions
Jenkins
ArgoCD
Python
Groovy scripting
Docker
Kubernetes/OpenShift
Linux networking basics
Git
Agile engineering
Data pipelines

Educación

IT or similar bachelor’s degree or higher
Equivalent work experience

Herramientas

GitHub Actions
Jenkins
ArgoCD
Podman
Docker
Kubernetes/OpenShift
Ansible

Descripción del empleo

Job Purpose

Group IT has a matrix management structure. The Technology Engineer role will have line management and reporting into the VP Technology Chapter but will be assigned to a Platform squad for task management and prioritisation. The engineer will implement the design and build of the platform along with all associated components from inception to maturity of the running environment over time. The role will be responsible for driving change and delivering new technology into the Bank by onboarding customers and applications to the Platform via self-service and automation.

The engineer will work closely with other Platforms and Product teams in educating them on the new Platform services and features to ensure any transition and consumption is optimal. Teams work using Agile DevOps Product Management methodologies delivering work packages based on the priority in the backlog.

Job Content
Key Results
Performance Measures
Main Tasks
Technology Engineering
  • Hands on Tier 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation Ansible data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions Jenkins ArgoCD etc.) for data projects. Python based preferred.
  • Shell Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization Podman Docker
  • Container Management Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)
  • Agile engineering and practices
  • Some Python programming experience
Relationship Management
  • Trustful and professional relationships with key stakeholders
  • Has developed synergies across services optimizing re-use promoting simplification and demonstrating speed-to-market benefits
  • Commercial and business focused to improve IT services
  • Trustful and pragmatic approach to problem solving
  • Ability to adopt the Groups values and drive adoption of the values across the team
Delivery Experience
  • Ability to work on projects from inception to delivery
  • Decision making to decide on best solution based on cost time and quality of options
  • Cross skills in delivery but also operational support as per the new DevOps model
  • Implementing robust solutions to minimize operational effort
Internal / External Relationships and Committee Memberships
Interface (Int/Ext)
Reason
Committee
Reason
Technical Platforms

Work with the wider infrastructure team to ensure consistency of the deliverables.

Security Chapter

Align with Security standards and collaborate on different design forums

Architecture Chapter

Align with Architecture standards and collaborate on different design forums

Business Platforms

Work with the wider application and product teams to ensure consistency of the deliverables.

Data Chapter

Align with Data standards and collaborate on different design forums

Agile Chapter

Align with Agile standards and collaborate on different design forums

Problems & Decisions
Problems and Decision
Desired Outcome
  • Non-Standardized stack or product
  • Establish an updated stack of standard products
  • High TCO of the products
  • Look for improvements and automate where possible
  • Platform Strategy is not well defined
  • Drive Product Roadmaps and backlog
Person Specifications
Specifications
Description of Knowledge / Skill etc.
Desirable or Essential
Education
  • General
  • Professional
  • IT or similar bachelors degree or higher
  • Equivalent work experience
Experiences

(Years & Type)

  • Industry
  • Regional
  • Functional
  • At least 4 years production Hadoop experience
  • 8 years hands on Technology experience
  • Experience with large and complex global enterprises defined by high availability broad observability and high level of reliability.
  • At least 1 project experience in Data Science project/products
  • Excellent communication and articulation skills
Knowledge & Skills
  • Hands on Tier 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation Ansible data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions Jenkins ArgoCD etc.) for data projects. Python based preferred.
  • Some Python programming experience
  • Shell Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization Podman Docker
  • Container Management Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)

Agile engineering and practices

Nice to have:

  • Public cloud exposure
  • Data Science projects/products
Behavioral Competencies
  • Collaboration
  • Self-starter with strong initiative
  • Innovative and experimental mindset
  • Calm under pressurePragmatic and focused

Synechron DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.
All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.

Candidate Application Notice

Required Experience:

Senior IC

Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full-Time
Experience: years
Vacancy: 1

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Market Data Engineer
Senior Market Data Engineer

BHFT • Dubai

A distancia
AED 180.000 - 360.000
Remote work from anywhere
Health insurance
Professional training
+1
Data Engineer
Data Engineer

HCL Technologies Limited • Dubai

Presencial
AED 180.000 - 280.000
PM - Credit Origination
PM - Credit Origination

Synechron • Abu Dhabi

Presencial
AED 300.000 - 500.000
Finacle Software Engineer
Finacle Software Engineer

Synechron • Dubai

Presencial
AED 420.000 - 660.000
PM - Credit Origination
PM - Credit Origination

Synechron Technologies LLC_DUBAI Company • Dubai

Presencial
AED 350.000 - 700.000
PM - Credit Origination
PM - Credit Origination

Synechron Technologies Pvt. Ltd._INDIA Company • Dubai

Presencial
AED 180.000 - 300.000
Cloudera Data Engineer
Cloudera Data Engineer

Midis Group • Dubai

Presencial
AED 400.000 - 700.000
Senior Data Engineer (Investment Data)
Senior Data Engineer (Investment Data)

Luxoft • Abu Dhabi

Presencial
AED 391.000 - 614.000
Lead Business Analyst – Treasury
Lead Business Analyst – Treasury

Synechron Technologies LLC_DUBAI Company • Dubai

Presencial
AED 240.000 - 360.000
Lead Business Analyst/ SME
Lead Business Analyst/ SME

Synechron Technologies LLC_DUBAI Company • Dubai

Presencial
AED 240.000 - 360.000
Ubicaciones