Data Engineer 4

Amadeus; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Amadeus in Bengaluru seeks a Data Engineer 4 to design, develop, and maintain our data pipelines and data products. You will collaborate with product definition analysts, data scientists, data engineers and architects to ensure reliability, scalability, and performance of data assets.

The ideal candidate has hands-on production code in Scala or PySpark, deep experience with Spark, Hadoop, Kafka, Impala, and scripting in Bash or Python.

Qualifications

• Production-quality code in Scala or PySpark.
• Experience with big data tech: Spark, Hadoop, Kafka, Impala.
• Strong understanding of Apache Spark architecture.
• Scripting with Bash and Python.
• Experience with NoSQL databases like MongoDB is a plus.
• DevOps pipelines experience is a plus.
• Familiarity with analytics tools like Tableau is a plus.

Responsibilities

• Design, implement, deploy, and maintain data marts, ETL processes and systems.
• Ensure reliability, scalability, and performance of data assets.
• Design and maintain quality indicators, monitoring and alerting.
• Troubleshoot issues and document according to Amadeus standards.
• Apply continuous improvement to data-related issues, systems, and processes.
• Keep up with industry standards, security recommendations and best practices.

Skills

Scala

PySpark

Bash

Python

Tools

MapR filesystem

Apache Spark

Hadoop

Kafka

Impala

MongoDB

Job description

Summary

As a Data Engineer, you will be responsible for designing, developing, and maintaining our data pipelines and data products. You will work closely with our product definition analysts, data scientists, data engineers and architects to ensure the reliability, scalability, and performance of our data assets.

Job Title

Data Engineer 4

Summary

As a Data Engineer, you will be responsible for designing, developing, and maintaining our data pipelines and data products. You will work closely with our product definition analysts, data scientists, data engineers and architects to ensure the reliability, scalability, and performance of our data assets.

Key Responsibilities

• Design, implement, deploy, and maintain data marts, ETL (extract, transform, load) processes and systems. A.k.a. as our assets.
• Ensure the reliability, scalability, and performance of our data assets.
• Design and maintain quality indicators as well as the corresponding monitoring and alerting means.
• Troubleshoot and document issues respecting Amadeus standards.
• Continuous improvement mindset applied to data related issues, systems, and processes.
• Technical and expertise awareness to keep up with industry standards, security recommendations and best practices within Offer organization.

About The Ideal Candidate

• Hands-on experience writing Production quality code in Scala (preferred) or PySpark.
• Hands-on experience on big data technologies, including the mapr filesystem, Apache Spark, Hadoop, Kafka & Impala.
• Proven experience with the Apache Spark Architecture and components.
• Hands-on experience on scripting languages including Bash scripting and Python.
• Knowing different kinds of database technologies.
• Previous work with no-SQL databases, like MongoDB will be a plus.
• Experience on building and maintaining DevOps pipelines will be a plus.
• Familiarity with analytics platforms like Tableau will be a plus.

Diversity & Inclusion

Amadeus aspires to be a leader in Diversity and Inclusion in the tech industry, enabling every employee to reach their full potential by fostering a culture of belonging and fair treatment, attracting the best talent from all backgrounds, and as a role model for an inclusive employee experience.

Amadeus is an equal opportunity employer and committed to an accessible recruitment process. All qualified applicants will receive consideration for employment without regard to gender, race, ethnicity, sexual orientation,age, beliefs, disability or any other characteristics protected by law.