Engineering Lead, Hadoop & Big Data Platform

Bank Of America; Charlotte (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

Bank of America is seeking a Hadoop Engineer (SME) to lead end-to-end technology solutions for NextGen Platforms built on Hadoop/Spark/Kafka. The role demands deep expertise in Cloudera Hadoop, data science tools, and enterprise security like AD/Kerberos.

You will mentor engineers, architect complex designs, and collaborate with product, development, and infrastructure teams to ensure high-performance, scalable platforms. 40-hour weeks in the US with in-office collaboration.

Qualifications

• 9+ years experience with Hadoop, Kafka, Spark, Impala, Hive, Hbase
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's role
• Intimate knowledge of fully integrated AD/Kerberos authentication
• Experience setting up optimum cluster configurations
• Debugging knowledge of YARN
• Hands-on with analyzing Hadoop log files, compression, encoding, & file formats
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres
• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure
• Experience in Monitoring & Alerting, and Job Scheduling Systems
• Being comfortable with frequent, incremental code testing and deployment
• Strong grasp of automation / DevOps tools – Ansible,Jenkins, SVN, Bitbucket

Responsibilities

• Ensures that execution aligns with product strategy by working with product management, product owners, and other stakeholders, contributing to the technology strategy for their technical domain
• Mentors and guides Solution Engineer resources and more junior engineers on performance evaluation and validation methods and tools ensuring system design technology solutions comply with enterprise system design and engineering standards
• Participates in solution-driven discussions, such as various Communities of Practice (COPs), contributes to the design of large or highly complex architectural designs, and finds creative solutions through their knowledge of the domain and operational constraints
• Collaborates with Development and Infrastructure teams to understand technical solutions and provide the performance capabilities required in the application across the technology stacks provided by peer Engineering Leads
• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework - He / She will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident /problem / capacity management
• Serves as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs

Skills

Analytical Thinking

Collaboration

Innovative Thinking

Solution Delivery

Solution Design

Architecture

Automation

Influence

Risk Management

Technical Strategy

Adaptability

Application Development

Business Acumen

DevOps Practices

Production Support

Job description

Bank of America is seeking a Hadoop Engineer (SME) to lead end-to-end technology solutions for NextGen Platforms built on Hadoop/Spark/Kafka. The role demands deep expertise in Cloudera Hadoop, data science tools, and enterprise security like AD/Kerberos.

You will mentor engineers, architect complex designs, and collaborate with product, development, and infrastructure teams to ensure high-performance, scalable platforms. 40-hour weeks in the US with in-office collaboration.