Lead Solutions Engineer: Big Data & Hadoop Platform

Bank of America; Town of Charlotte (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

Bank of America is seeking a Hadoop Engineer (SME) to lead end-to-end Big Data platform initiatives. The role focuses on designing scalable architectures, cluster administration, and performance tuning across a Cloudera ecosystem with exposure to OpenShift and containerized deployments.

You will mentor engineers, participate in COPs, and collaborate with product and infrastructure teams to deliver robust data solutions for enterprise workloads.

Qualifications

• 9+ years experience with Hadoop, Kafka, Spark, Impala, Hive, Hbase.
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator’s role.
• Intimate knowledge of fully integrated AD/Kerberos authentication.
• Experience setting up optimum cluster configurations.
• Debugging knowledge of YARN.
• Hands-on with analyzing Hadoop log files, compression, encoding, & file formats.
• Expert knowledge of Cloudera Hadoop components: HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, Postgres.
• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.
• Experience in Monitoring & Alerting, and Job Scheduling Systems.
• Being comfortable with frequent, incremental code testing and deployment.
• Strong grasp of automation / DevOps tools – Ansible,Jenkins, SVN, Bitbucket.

Responsibilities

• Ensures alignment with product strategy by working with product management and stakeholders.
• Mentors and guides engineers on performance evaluation and validation methods and tools.
• Participates in solution-driven discussions and architectures, finding creative domain solutions.
• Collaborates with Development and Infrastructure teams to understand solutions and performance needs.
• Works on complex tasks across multiple projects requiring diverse expertise.
• Provide SME guidance in Hadoop and Data Science Platform operations (Cloudera, Jupyter, OpenShift, Docker).
• Manage platform operations across environments including upgrades, deployments, monitoring, DR, incidents and capacity management.
• Liaises between client partners and vendors to address user needs with technical solutions.

Skills

Hadoop ecosystem

Hadoop cluster

YARN

Unix/Linux

Java

Python

DevOps

Automation

Troubleshooting

Tools

Cloudera Hadoop

OpenShift

Docker

Ansible

Jenkins

Postgres

Job description

Bank of America is seeking a Hadoop Engineer (SME) to lead end-to-end Big Data platform initiatives. The role focuses on designing scalable architectures, cluster administration, and performance tuning across a Cloudera ecosystem with exposure to OpenShift and containerized deployments.

You will mentor engineers, participate in COPs, and collaborate with product and infrastructure teams to deliver robust data solutions for enterprise workloads.