BigData-Hadoop/Scala Engineer, AVP

Deutsche Bank AG; Pune District; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Deutsche Bank AG in Pune, India seeks a BigData-Hadoop/Scala Engineer AVP to design, develop, and maintain high‑performance data pipelines using Spark, Hadoop ecosystems, and GCP services such as Airflow, Dataproc, and BigQuery.

You will collaborate with data scientists and analysts to translate requirements into scalable solutions, optimize ETL/ELT processes for cost and performance, ensure data quality and security, participate in code reviews, and mentor junior engineers.

Qualifications

• Strong proficiency in Java and/or Scala for big data application development.
• Extensive experience with Apache Spark for large-scale data processing.
• Hands-on knowledge of Google Cloud Platform services: Airflow, Dataproc, BigQuery.
• Experience with relational databases, particularly Oracle.
• Unix/Linux scripting for automation and admin tasks.

Responsibilities

• Design, develop, and maintain high-performance, fault-tolerant data pipelines using modern big data technologies.
• Implement data processing solutions to ETL data from multiple sources into data platforms.
• Collaborate with data scientists, analysts and engineers to meet business needs.
• Optimize data processing jobs for performance and cost efficiency.
• Ensure data quality, integrity, and security across data assets.
• Mentor junior team members and participate in code reviews.

Skills

Java/Scala

Apache Spark

GCP Airflow

Dataproc

BigQuery

Data warehousing

ETL/ELT

Version control (Git)

Problem-solving

Communication

Angular/React

Python (data manipulation)

Oracle

Unix/Linux scripting

CI/CD/DevOps

Data governance

Financial services experience

UI development (Angular/React)

AI tools usage

Job description

Job Title: BigData-Hadoop/Scala Engineer, AVP Location: Pune, India

Role Description An Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected, with maintainability and ease of testing built in from the outset, and that they can be integrated successfully into the end-to-end business process flow. They will have gained significant experience through multiple implementations and have begun to develop both depth and breadth in a number of engineering competencies. They have extensive knowledge of design and architectural patterns. They will provide engineering thought leadership within their teams, and will play a role in mentoring and coaching of less experienced engineers.

What we’ll offer you As part of our flexible scheme, here are just some of the benefits that you’ll enjoy

• Best in class leave policy
• Gender neutral parental leaves
• 100% reimbursement under childcare assistance benefit (gender neutral)
• Sponsorship for Industry relevant certifications and education
• Employee Assistance Program for you and your family members
• Comprehensive Hospitalization Insurance for you and your dependents
• Accident and Term life Insurance
• Complementary Health screening for 35 yrs. and above

Your key responsibilities Design, develop, and maintain high-performance, fault-tolerant data pipelines using modern big data technologies. Implement data processing solutions to extract, transform, and load (ETL) data from various sources into our data platforms. Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver solutions that meet business needs. Optimize data processing jobs for performance and cost efficiency. Ensure data quality, integrity, and security across all data assets. Participate in code reviews, contribute to technical discussions, and mentor junior team members. Stay current with emerging technologies and best practices in the big data ecosystem.

Must-Have Skills

• Strong proficiency in Java and/or Scala for big data application development.
• Extensive experience with Apache Spark for large-scale data processing.
• Demonstrable knowledge and hands-on experience with Google Cloud Platform (GCP) services, specifically: Airflow for workflow orchestration.
• Dataproc for managed Spark/Hadoop clusters.
• BigQuery for data warehousing and analytics.
• Solid understanding of data warehousing concepts, ETL/ELT principles, and data modeling.
• Experience with version control systems (e.g., Git).
• Strong problem-solving skills and the ability to troubleshoot complex data issues.
• Excellent communication and collaboration skills.
• Understanding of Angular/React frameworks.
• Good-to-Have Skills: Proficiency in Python for data manipulation, scripting, or data science-related tasks.
• Experience with relational databases, particularly Oracle.
• Competency in Unix/Linux scripting for automation and system administration tasks.
• Familiarity with other cloud platforms (e.g., AWS, Azure) is a plus.
• Knowledge of CI/CD pipelines and DevOps practices.
• Understanding of data governance and data security best practices.
• Experience working in the financial services industry.
• Experience developing UI using Angular/React.
• Proven ability to leverage AI tools to enhance productivity, optimise workflows to solve business problems, while applying critical judgment to ensure responsible and ethical use of data and AI outputs.

How we’ll support you

• Training and development to help you excel in your career
• Coaching and support from experts in your team
• A culture of continuous learning to aid progression
• A range of flexible benefits that you can tailor to suit your needs

About us and our teams

Please visit our company website for further information: https://www.db.com/company/company.html

We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively. Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group. We welcome applications from all people and promote a positive, fair and inclusive work environment. For over 150 years, our dedication to being the Global Hausbank for our clients has been driven by our people – in around 60 countries and across more than 150 nationalities. Their deep understanding, insights, expertise, and passion help our clients navigate an increasingly complex world – be it in our Corporate Bank, our Private Bank, our Investment Bank or our Asset Management (DWS) division. Together we can make a great impact for our clients at home and abroad, securing their lasting success and financial security.

More information at: Deutsche Bank Careers (db.com)