Software Engineer II - Big Data/Hadoop
Bank of America
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
Bank of America is seeking an experienced Senior Big Data Engineer to build and optimize large-scale data platforms. You will design data pipelines, implement robust data processing, and ensure integration with broader applications and systems.
Your focus will be on Hadoop ecosystem, Spark, Hive, and modern data tools, collaborating with cross-functional teams to deliver reliable, scalable data solutions in an agile environment.
Qualifications
- 4+ years of relevant work experience.
- Proficiency in programming language(s) required for the role.
- Experience in Big Data and Data Engineering.
- Strong hands-on expertise with Hadoop ecosystem including Cloudera Hadoop, Hive, Spark, HDFS/Ozone, SQL performance tuning, Python, Scala, and Unix scripting.
- Proven experience supporting large-scale production data platforms, troubleshooting distributed systems, and delivering reliable Big Data solutions.
- Experience with Cloudera platform administration, capacity planning, performance tuning, and optimization of Hadoop workloads.
- Strong understanding of Hive, Spark, YARN, storage and compute performance tuning, including root cause analysis.
- Hands-on experience with Cloudera Private Cloud Data Services including implementation, onboarding, migration, and operational support.
- Solid understanding of data warehousing, modern data platform architectures, and Agile delivery practices.
- Experience with workload migrations, platform onboarding, platform modernization, and cloud-enabled data services is preferred.
- Strong analytical and problem-solving skills, customer focus, and ability to collaborate with cross-functional teams.
Responsibilities
- Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
- Utilizes multiple architectural components in design and development of client requirements
- Performs CI/CD activities
- Contributes to story refinement and definition of requirements
- Participates in estimating work necessary to realize a story through the delivery lifecycle
- Contributes to existing test suites, analyze test reports, and triage issues
- Performs spike/proof of concept to mitigate risk or implement new ideas
Skills
Education
Tools
Job description
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day. Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates' physical, emotional, and financial wellness through affordable, competitive and flexible benefits. We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve. Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs. At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact.
Join us!
This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, coding solutions, unit testing, and ensuring the solution can be integrated successfully into the overall application/system with clear, robust, and well-tested interfaces. Job expectations include an awareness of development and testing practices in the industry.
Data Solutions Center team is looking for an experienced Senior Big Data Engineer.
Candidate should have strong knowledge of Hadoop technologies, SQL, Spark, and data engineering processes.
Candidate should possess excellent analytical and problem-solving skills, develop a deep understanding of data and platform architecture, and support performance optimization and modernization initiatives.
The role involves supporting large-scale data platforms, data ingestion, workload migrations, and onboarding applications using modern Big Data tools and frameworks.
- Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
- Utilizes multiple architectural components (across data, application, business) in design and development of client requirements
- Performs Continuous Integration and Continuous Development (CI-CD) activities
- Contributes to story refinement and definition of requirements
- Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle
- Contributes to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause
- Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
- 4+ years of relevant work experience
- Proficiency in programming language(s) required for the role
- Experience in Big Data and Data Engineering.
- Strong hands-on expertise with the Hadoop ecosystem, including Cloudera Hadoop, Hive, Spark, HDFS/Ozone, SQL performance tuning, Python, Scala, and Unix scripting.
- Proven experience supporting large-scale production data platforms, troubleshooting distributed systems, and delivering reliable Big Data solutions.
- Experience with Cloudera platform administration, capacity planning, performance tuning, and optimization of Hadoop workloads.
- Strong understanding of Hive, Spark, YARN, storage, and compute performance tuning, including root cause analysis of platform and application performance issues.
- Hands-on experience with Cloudera Private Cloud Data Services (Data Engineering, Data Warehouse, and Machine Learning services), including implementation, onboarding, migration, and operational support.
- The ideal candidate has a solid understanding of data warehousing, modern data platform architectures, and Agile delivery practices.
- Experience with workload migrations, platform onboarding, platform modernization, and cloud-enabled data services is preferred.
- Success in this role requires strong analytical and problem-solving skills, excellent customer focus, and the ability to collaborate effectively with application development, platform, and engineering teams.
- Experience in financial services and enterprise-scale data modernization programs is highly desirable.
- Knowledge of Cloudera Data Platform (CDP), Ozone, Data Services, and modern data architectures.
- Experience optimizing large-scale Hadoop environments, improving platform performance, and supporting migration of workloads from traditional Hadoop services to modern data platforms and cloud-native services.
- Application Development Automation
- Collaboration
- DevOps Practices
- Solution Design
- Agile Practices
- Architecture
- Result Orientation
- Solution Delivery
- Process
- User Experience Design
- Analytical Thinking
- Data Management
- Risk Management
- Technical Strategy Development
- Test Engineering
- Bachelor's degree or equivalent work experience.
1st shift (United States of America)
40
https://careers.bankofamerica.com/en-us/privacy-notice
Learn about some of the ways Bank of America is making a difference in the communities we serve.
Learn about the six areas that guide Bank of America's efforts to help make financial lives better for customers, clients, communities and our teammates.
Each employee brings unique skills, background and opinions. We see opportunity and inclusion as our platform for innovation and a key component in our success.
Learn about our four values that represent what we believe.
https://careers.bankofamerica.com/en-us/pay-transparency
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
