Software Engineer II - Hadoop Developer

Bank of America; Plano (TX); On-site; USD 110,000 - 160,000; Full time

Job summary

Bank of America is seeking an experienced Hadoop Developer to design, develop, and deliver end-to-end data solutions in a big data environment. You will work with Hadoop, Hive, Spark, Python, Scala, and SQL to ingest, transform, and provide insights across large data sets.

The role requires CI/CD practices and collaboration with cross-functional teams in a fast-paced setting. On-site in Plano, TX, you will contribute to data security, governance, and analytics delivery while supporting reporting

Qualifications

• Bachelor’s degree or equivalent work experience.
• 5+ years of experience in data warehousing and big data.
• Strong knowledge of Hadoop ecosystem (Cloudera).
• Experience with Python, SQL, Spark, and Scala.
• Familiarity with CI/CD and Agile methodologies.

Responsibilities

• Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
• Utilizes multiple architectural components (across data, application, business) in design and development.
• Performs Continuous Integration and Continuous Development (CI/CD) activities.
• Contributes to story refinement and definition of requirements.
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
• Contributes to existing test suites (integration, regression, performance), analyzes test reports, and triages issues.
• Design, develop, and implement applications using Hadoop technologies.
• Create ETL processes - Ingest data from multiple sources, transform the data and create reporting views.
• Process large volumes of data efficiently - Analyze datasets to identify trends and insights.
• Support reporting and analytics requirements.
• Implement data security controls, ensure data privacy and regulatory compliance.
• Test applications and data pipelines, debug production issues and performance bottlenecks.
• Work on the stories assigned and provide updates in the daily scrum meetings.
• Lead some of the initiatives within the team and coordinate requirements with the line of business.

Skills

Hadoop

Hive

Spark

Python

Scala

SQL

Autosys

CI/CD

Agile

Distributed systems

Data warehousing

Cloudera

Education

Bachelor’s degree or equivalent

Tools

Autosys

Job description

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day. Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates’ physical, emotional, and financial wellness through affordable, competitive and flexible benefits. We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve.

Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs.

At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact.

Job Description: This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, coding solutions, unit testing, and ensuring the solution can be integrated successfully into the overall application/system with clear, robust and well-tested interfaces. Job expectations include an awareness of development and testing practices in the industry. Data solution delivery team is looking for an experienced Hadoop Developer. Candidate should have in-depth knowledge of Hadoop technologies, SQL and ETL processes. Candidate should possess excellent analytical capabilities, get a deep understanding of the data and build co-relation between various data elements/objects. Data solution delivery team is also responsible for ingesting the data from multiple sources, the candidate should be able to support the ingestion process using the big data tools and frameworks.

Responsibilities:

• Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
• Utilizes multiple architectural components (across data, application, business) in design and development of client requirements
• Performs Continuous Integration and Continuous Development (CI-CD) activities
• Contributes to story refinement and definition of requirements
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle
• Contributes to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
• Design, develop, and implement applications using Hadoop technologies.
• Create ETL (Extract, Transform, Load) processes - Ingest data from multiple sources, transform the data and create reporting views
• Process large volumes of data efficiently - Analyze datasets to identify trends and insights,
• Support reporting and analytics requirements
• Implement data security controls,
• Ensure data privacy and regulatory compliance
• Test applications and data pipelines, Debug production issues and performance bottlenecks, Resolve runtime and data quality problems
• Work on the stories assigned and provide updates in the daily scrum meetings
• Lead some of the initiatives within the team and co-ordinate the requirements with the line of business

Required Qualifications:

• 5+ years of relevant work experience
• Proficiency in programming language(s) required for the role
• 5+ years of experience in data warehousing architectural approaches in big data.
• Sound understanding and experience with Hadoop ecosystem (Cloudera).
• Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
• Experience in working with a Big Data implementation in production environment.
• Must have experience with Big Data technologies like Hadoop, Hive, Spark, python, scala etc.
• Experience in python and Unix shell scripting.
• Experience in scheduling tool like Autosys
• Understanding of Agile methodologies and technologies
• Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
• Exposure to and strong working knowledge of distributed systems.
• Excellent understanding of client-service models and customer orientation in service delivery.
• Ability to grasp the 'big picture' for a solution by considering all potential options in impacted area.
• Aptitude to understand and adapt to newer technologies.
• The ability to work with teammates in a collaborative manner to achieve a mission.
• Experience in query optimization, performance tuning of the complex SQL queries.
• Benchmark and debug critical issues with algorithms and software as they arise

Desired Qualifications:

• Previous experience in the financial services industry
• BofA technical experience and good understanding of existing testing/operational processes and an open mind on how to enhance those
• Understanding of industry trends and relevant application technologies
• Experience in designing and implementing analytical environments and business intelligence solutions

Skills:

• Application Development
• Automation
• Collaboration
• DevOps Practices
• Solution Design
• Agile Practices
• Architecture
• Result Orientation
• Solution Delivery
• Process
• User Experience Design
• Analytical Thinking
• Data Management
• Risk Management
• Technical Strategy Development
• Test Engineering

Minimum Education Requirement: Bachelor’s degree or equivalent work experience.

Shift: 1st shift (United States of America)

Hours Per Week: 40

Privacy Statement: https://careers.bankofamerica.com/en-us/privacy-notice

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day. One of the keys to driving Responsible Growth is being a great place to work for our teammates around the world. We’re devoted to being a diverse and inclusive workplace for everyone. We hire individuals with a broad range of backgrounds and experiences and invest heavily in our teammates and their families by offering competitive benefits to support their physical, emotional, and financial well-being. Bank of America believes both in the importance of working together and offering flexibility to our employees. We use a multi-faceted approach for flexibility, depending on the various roles in our organization. Working at Bank of America will give you a great career with opportunities to learn, grow and make an impact, along with the power to make a difference.

Partnering Locally Learn about some of the ways Bank of America is making a difference in the communities we serve. Global Impact Learn about the six areas that guide Bank of America's efforts to help make financial lives better for customers, clients, communities and our teammates.

Opportunity and Inclusion Each employee brings unique skills, background and opinions. We see opportunity and inclusion as our platform for innovation and a key component in our success.

Our Values Learn about our four values that represent what we believe.

Pay Transparency: https://careers.bankofamerica.com/en-us/pay-transparency