Senior Hadoop Developer

Bank of America Corporation; Chennai; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Bank of America in Chennai is seeking a Senior Hadoop Data Engineer to join the Analytics and Intelligence Engine (AIE) under Global Business Services. The role focuses on building and maintaining big data solutions for consumer insights and personalization across onshore/offshore teams.

The ideal candidate has 15+ years of hands-on experience in Hadoop ecosystem, Spark, Scala, Python, and real-time streaming with Kafka/Spark Streaming, and will mentor peers while delivering strategic data

Qualifications

• 15+ years of application development experience in Big Data.
• Deep hands-on expertise with Hadoop stack: Spark, Hive, Yarn, Sqoop, Impala, Hue, HDFS.
• Strong programming in Python, Scala, and Bash/Shell.
• Experience with NoSQL like MongoDB, SingleStore, HBase.
• Ability to mentor junior developers and translate business requirements.
• Knowledge of security, compliance, and resiliency in large data systems.
• Experience with real-time streaming: Spark Streaming, Kafka.

Responsibilities

• Develop high-performance, scalable insights using Big Data platform.
• Design data processing workflows with Hadoop stack.
• Implement real-time streaming with Spark Streaming and Kafka.
• Collaborate with cross-functional teams to optimize performance.
• Define Big Data strategies and roadmaps.
• Apply NoSQL skills for diverse data types.
• Mentor junior teammates.

Skills

Hadoop ecosystem

Spark

Hive

YARN

Sqoop

Impala

Hue

HDFS

Python

Scala

Bash/Shell

MongoDB

SingleStore

HBase

Kafka

Spark Streaming

Kerberos

Azure

AWS

GCP

Education

Graduation / Post Graduation B.E. / B. Tech / M.E. / M. Tech / MCA

Tools

Spark

Hadoop

Hive

Sqoop

Impala

Kafka

HDFS

Job description

Senior Engineer - GBS IND Job Description

About Us

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day. Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates’ physical, emotional, and financial wellness through affordable, competitive and flexible benefits. We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve. Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs. At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!

Global Business Services

Global Business Services delivers Technology and Operations capabilities to Lines of Business and Staff Support Functions of Bank of America through a centrally managed, globally integrated delivery model and globally resilient operations.

Global Business Services is recognized for flawless execution, sound risk management, operational resiliency, operational excellence and innovation.

In India, we are present in five locations and operate as BA Continuum India Private Limited (BACI), a non-banking subsidiary of Bank of America Corporation and the operating company for India operations of Global Business Services.

Process Overview

• Global Operations Technology and Client Data Platforms: Development / Support/ testing of the technology solutions for the bank’s Marketing line of business applications.

Job Description

The Analytics and Intelligence Engine (AIE) team transforms analytical and operational data into Consumer and Wealth Client insights and enables personalization opportunities that are provided to Associate and Customer-facing operational applications. The Big data technologies used in this are Hadoop /PySpark / Scala, HQL as ETL, Unix as file Landing environment, and real time streaming applications, like Spark Streaming, Kafka. We are actively seeking a skilled Senior Hadoop Developer to develop and maintain insights, with strong technical expertise in Hadoop and related technologies, and who excels at collaborating with both onshore and offshore team members. The role requires both hands-on coding and collaboration with stakeholders to drive strategic design decisions. While functioning as an individual contributor for one or more teams, the Senior Hadoop Data Engineer may also lead and take responsibility for end-to-end solution design and delivery, based on the scale of implementation and required skillsets.

Responsibilities

• Develop high-performance and scalable solutions for Insights, using the Big Data platform to facilitate the collection, storage, and analysis of massive data sets from multiple channels.
• Utilize your in-depth knowledge of Hadoop stack and storage technologies, including HDFS, Spark, Scala, MapReduce, Yarn, Hive, Sqoop, Impala, Hue, and Oozie, to design and optimize data processing workflows.
• Implement Near real-time and Streaming data solutions to provide up-to-date information to millions of Bank customers using Spark Streaming, Kafka.
• Collaborate with cross-functional teams to identify system bottlenecks, benchmark performance, and propose innovative solutions to enhance system efficiency.
• Take ownership of defining Big Data strategies and roadmaps for Enterprise, aligning them with business objectives.
• Apply your expertise in NoSQL technologies like MongoDB, SingleStore, or HBase to efficiently handle diverse data types and storage requirements.
• Stay abreast of emerging technologies and industry trends related to Big Data, continuously evaluating new tools and frameworks for potential integration.
• Provide guidance and mentorship to junior teammates.

Requirements

• Education: Graduation / Post Graduation B.E. / B. Tech/M.E. /M. Tech/ MCA Certifications If Any: Not Mandatory
• Experience Range: 15+ Years
• Foundational Skills: Must have 15+ years of application development experience, focused on hands-on work in the Big Data domain. Highly skilled in Hadoop stack technologies, such as Spark, Hive, Yarn, Sqoop, Impala, Hue, HDFS. Strong proficiency in programming languages such as Python, Scala, and Bash/Shell Scripting. Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications. Must understand common Hadoop architectural patterns, design patterns, frameworks and programming best practices, automations. Support production incident troubleshooting and planned application production releases. Must be able to work with Product Owners to translate business requirements into technical requirements and explain to the offshore developers, as required. Should understand common non-functional requirements, such as those related to security, compliance, operations/ resiliency, scalability, automation etc. Having experience mentoring relatively junior and/or peer developers in a technical sense is a further plus.
• Desired skills: Effective communication, Strong stakeholder engagement skills, Proven ability in leading and mentoring a team of software engineers in a dynamic environment. Experience in Real-time streaming technologies like Spark Streaming, Kafka, Flink. Proficiency in Data Integration and Data Security within the Hadoop ecosystem, including knowledge of Kerberos. Working knowledge of emerging Generative AI technologies (for example Copilot, Agentic AI, prompt design, embeddings, and retrieval frameworks). Proficiency in NoSQL technologies like HBase, MongoDB, SingleStore, etc. Familiarity with Cloud Technologies such as Azure, AWS, or GCP. Working knowledge of machine learning algorithms, and programming languages to conduct data analysis and develop models to uncover patterns and trends. Having experience leading development teams in any capacity.

Work Timings

12:30 PM - 9:30 PM

Job Location

Chennai

Experience Level

Senior Level