Hadoop Solutions Engineer Lead

Bank of America; Jacksonville (FL); On-site; USD 112,000 - 174,000; Full time

Benefits offered by this job

Discretionary incentive

Benefits

Job summary

Bank of America is seeking a Hadoop Engineer (SME) to lead end-to-end technology stacks on NextGen Platforms. You will guide design solutions, optimize performance, and ensure enterprise standards across clusters and data services.

Key responsibilities include mentoring engineers, collaborating with product and infrastructure teams, and delivering scalable, reliable Hadoop-based solutions in a collaborative, in-office environment.

Qualifications

• Experience with Hadoop ecosystem components and cluster management.
• Strong knowledge of Hadoop architecture and security.
• Proficient in scripting and automation for deployment and monitoring.

Responsibilities

• Define and lead engineering approach across end-to-end tech stacks.
• Mentor engineers on performance evaluation and deployment practices.
• Collaborate with cross-functional teams to design scalable solutions.
• Manage Hadoop and Data Science platform operations including upgrades, DR, and monitoring.

Skills

Hadoop

Kafka

Spark

Impala

HBase

Unix/Linux

Java

Python

Shell scripting

Ansible

Jenkins

SVN

Bitbucket

Docker

OpenShift

Kubernetes

Tools

Ansible

Jenkins

SVN

Bitbucket

Job description

Job Description:

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.

Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates’ physical, emotional, and financial wellness through affordable, competitive and flexible benefits.

We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve.

Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs.

At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!

Job Description:

This job is responsible for defining and leading the engineering approach across end-to-end technology stacks. Key responsibilities include leading teams to deliver design solutions, engaging in development environments to identify and improve performance/capacity issues, and ensuring system design solutions comply with enterprise standards. Job expectations include demonstrating technical expertise within domains, decomposing objectives into work units, advancing efficient solution delivery practices, and promoting exceptional design, engineering and organizational practices.

Position Summary

• Hadoop Engineer (SME) role supporting NextGen Platforms built around Big Data Technologies (Hadoop,Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc.
• Hadoop Engineer is involved in the full life cycle of an application and part of an agile development process.
• They require the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, vendors, and other partners.
• The following section is intended to serve as a general guideline for each relative dimension of project complexity, responsibility and education/experience within this role.

Responsibilities:

• Ensures that execution aligns with product strategy by working with product management, product owners, and other stakeholders, contributing to the technology strategy for their technical domain
• Mentors and guides Solution Engineer resources and more junior engineers on performance evaluation and validation methods and tools ensuring system design technology solutions comply with enterprise system design and engineering standards
• Participates in solution-driven discussions, such as various Communities of Practice (COPs), contributes to the design of large or highly complex architectural designs, and finds creative solutions through their knowledge of the domain and operational constraints
• Collaborates with Development and Infrastructure teams to understand technical solutions and provide the performance capabilities required in the application across the technology stacks provided by peer Engineering Leads
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework - He / She will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident / problem / capacity management
• Serves as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs

Required Qualifications

• Hadoop, Kafka, Spark, Impala, Hive, Hbase etc.
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator’s role
• Intimate knowledge of fully integrated AD/Kerberos authentication
• Experience setting up optimum cluster configurations
• Debugging knowledge of YARN.
• Hands-on with analyzing various Hadoop log files,
• compression, encoding, & file formats
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka,Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres
• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.
• Experience in Monitoring & Alerting, and Job Scheduling Systems
• Being comfortable with frequent, incremental code testing and deployment
• Strong grasp of automation / DevOps tools – Ansible,Jenkins, SVN, Bitbucket

Desired Qualifications

• Experience working on Big Data Technologies
• Cloudera Admin / Dev Certification
• Certification in Cloud, Docker-Container, OpenShift Technologies

Skills:

• Analytical Thinking
• Collaboration
• Innovative Thinking ...
• Solution Delivery Process
• Solution Design
• Architecture
• Automation
• Influence
• Risk Management
• Technical Strategy Development
• Adaptability
• Application Development
• Business Acumen
• DevOps Practices
• Production Support

Shift:

1st shift (United States of America)

Hours Per Week:

40

Pay Transparency details

US - IL - Chicago - 540 W Madison St - Bank Of America Plaza (IL4540)

Pay and benefits information

Pay range

$111,600.00 - $173,700.00 annualized salary, offers to be determined based on experience, education and skill set.

Discretionary incentive eligible

This role is eligible to participate in the annual discretionary plan. Employees are eligible for an annual discretionary award based on their overall individual performance results and behaviors, the performance and contributions of their line of business and/or group; and the overall success of the Company.

Benefits

This role is currently benefits eligible. We provide industry‑leading benefits, access to paid time off, resources and support to our employees so they can make a genuine impact and contribute to the sustainable growth of our business and the communities we serve.