Engineer- Big Data (Hadoop, Pyspark, Hive)

American Express Services Europe Limited; Gurugram District; Hybrid; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Flexible working model

Comprehensive medical and dental benefits

Career development opportunities

Job summary

A global financial services company is seeking an Engineer specialized in Big Data with expertise in Spark Core and Hive, and a Bachelor's degree in Engineering or Computer Science. The ideal candidate has 3-7 years of relevant experience and will support the Compliance and Operations Risk big data delivery team. This role offers a flexible working model, comprehensive benefits, and the chance to work with cutting-edge technologies in a global environment.

Qualifications

• 3 to 7 years experience is required.
• Experience on Big Data (Spark Core and Hive is must).
• Willingness to understand the business and participate in discussions about project requirements.

Responsibilities

• Lead and assist in the design and development of applications.
• Manage projects and take business specifications.
• Independently run projects/tasks delegated to you.

Skills

Big Data

Spark Core

Hive

GCP

Hadoop Architecture

UNIX shell scripting

Education

Bachelor degree in Engineering or Computer Science

Job description

STAGING / TEST ENVIRONMENT for AMEX Internal purposes only. If you are attempting to apply for a job at American Express, please visit our Career Portal.

Job Description - Engineer- Big Data (Hadoop, Pyspark, Hive) (24001512)

Description

You Lead the Way. We’ve Got Your Back.

With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create a career journey that’s unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally.

At American Express, you’ll be recognized for your contributions, leadership, and impact—every colleague has the opportunity to share in the company’s success. Together, we’ll win as a team, striving to uphold our company values and powerful backing promise to provide the world’s best customer experience every day. And we’ll do it with the utmost integrity, and in an environment where everyone is seen, heard and feels like they belong.

Join Team Amex and let's lead the way together.

From building next-generation apps and microservices in Kotlin to using AI to help protect our franchise and customers from fraud, you could be doing entrepreneurial work that brings our iconic, global brand into the future. As a part of our tech team, we could work together to bring ground-breaking and diverse ideas to life that power our digital systems, services, products and platforms. If you love to work with APIs, contribute to open source, or use the latest technologies, we’ll support you with an open environment and learning culture to grow your career.

Function Description

American Express is looking for energetic, high-performing and highly skilled Engineers to help shape our technology and product roadmap. Our Software Engineers not only understand how technology works, but how that technology intersects with the people who count on it every day. Today, innovative ideas, insight and new perspectives are at the core of how we create a more powerful, personal and fulfilling experience for our customers and colleagues. Centric to it is Big Data and batch/real-time analytical solutions leveraging transformational technologies to deliver innovative solutions across multiple business units.

This Engineering role is based in our Global Risk and Compliance Technology organization and will have a keen focus on platform modernization, bringing to life the latest technology stacks to support the ongoing needs of the business as well as compliance against global regulatory requirements.

Qualifications

• Support the Compliance and Operations Risk big data delivery team in India to lead and assist in the design and actual development of applications.
• Responsible for specific functional areas within the team, this involves project management and taking business specifications.
• The individual should be able to independently run projects/tasks delegated to them.

Technical Skills

• Bachelor degree in Engineering or Computer Science or equivalent
• 3 to 7 years experience is required
• Experience on Big Data (Spark Core and Hive is must)
• Familiar with GCP offerings, experience building data pipelines on GCP a plus
• Expert on Hadoop Architecture having knowledge on Hadoop, Map Reduce, Hbase.
• Experience in UNIX shell scripting is good to have
• Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows
• Willingness to understand the business and participate in discussions about project requirements

Minimum Qualifications

We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:

Benefits

• Support for financial-well-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

Additional Note for US Applicants: American Express does not currently utilize the AI capabilities of its application management platform in making employment decisions.

If you have a disability and would like to request an accommodation in order to apply for a position you may contact us by emailing [e-mail]. Please indicate if you would prefer a response via email or phone. US applicants may also contact us by using the US Toll Free number 1-833-707-1981.