Senior Data Security Engineer – Cloud & Big Data

Bank of America; Washington (District of Columbia); On-site; USD 104,000 - 158,000; Full time

Benefits offered by this job

Industry-leading benefits

Paid time off

Job summary

Bank of America is seeking a senior data engineer to lead the development and delivery of complex data solutions supporting operational and analytics data needs. You will partner with stakeholders to refine requirements, design scalable architectures, and supervise data pipelines and governance practices.

The role emphasizes deep experience with Hadoop/Cloudera, cloud platforms (AWS/Azure), PySpark, SQL, and CI/CD practices, with an expectation to mentor junior engineers and drive engineering

Qualifications

• 8+ years of hands-on data engineer/software development experience.
• Experience with big data processing systems such as Hadoop and Cloudera.
• Experience with cloud services/technologies such as AWS and Azure.
• Python programming with PySpark experience.
• Strong SQL and UNIX experience.
• Experience with data stores such as HIVE, HBase and Elastic.
• Experience with code versioning systems such as Bitbucket.
• Experience with CI/CD pipelines.
• Good knowledge of data engineering principles and SDLC processes.
• Ability to detect early and articulate challenges and gaps in requirements with business partners.
• Ability to guide junior engineers toward project completion and deliveries.

Responsibilities

• Partner with stakeholders to refine requirements, define user stories, and estimate delivery effort across the development lifecycle.
• Design and develop scalable data solutions using multiple architectural components to meet business and technical requirements.
• Build, integrate, transform, and manage complex datasets that support operational and analytical data needs.
• Develop and maintain data pipelines, data structures, metadata frameworks, and data quality controls to enable informed decision-making.
• Collaborate with development teams to ensure data architectures are feasible, scalable, and accurately implemented.
• Resolve technical challenges, support solution delivery, and drive continuous improvement of data engineering practices.
• Contribute to integration, regression, and performance testing by analyzing results, identifying defects, and resolving root causes.
• Document deployment, maintenance, support, and business processes while adhering to release management and code deployment standards.
• Monitor key performance indicators, maintain internal controls, and identify gaps in data management standards and governance practices.
• Lead proof-of-concept and experimentation initiatives while mentoring junior engineers and coaching teams on CI/CD, automation, and engineering best practices.

Skills

Analytical Thinking

Application Development

Data Management

DevOps Practices

Solution Design

Agile Practices

Collaboration

Decision Making

Risk Management

Test Engineering

Architecture

Business Acumen

Data Quality Management

Financial Management

Solution Delivery Process

Tools

Hadoop

Cloudera

AWS

Azure

PySpark

SQL

Bitbucket

Job description

Bank of America is seeking a senior data engineer to lead the development and delivery of complex data solutions supporting operational and analytics data needs. You will partner with stakeholders to refine requirements, design scalable architectures, and supervise data pipelines and governance practices.

The role emphasizes deep experience with Hadoop/Cloudera, cloud platforms (AWS/Azure), PySpark, SQL, and CI/CD practices, with an expectation to mentor junior engineers and drive engineering