Staff Data Engineer

TigerHire

Bengaluru

On-site

INR 1,500,000 - 2,300,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CommBank is seeking a Staff Data Engineer in Bangalore to drive data and analytics initiatives.

You will build end-to-end data centric solutions, define ETL strategy, and collaborate with stakeholders across BB Tech to improve risk, compliance, and performance of data platforms. The role demands experience with Spark/Scala, AWS, Python, and Teradata/Hadoop ecosystems.

Qualifications

  • Bachelor’s in computer science, B. Tech IT, Mathematics, Statistics or equivalent.
  • Experience in end-to-end data centric solutions and data pipelines.

Responsibilities

  • Lead ETL strategy definition and execution.
  • Develop data staging, architecture and interfaces.
  • Collaborate with business users and infrastructure teams to ensure guideline adherence.
  • Participate in full Agile lifecycle from ideation to implementation.
  • Build robust, secure, and highly available data solutions.
  • Improve engineering standards and health of solutions.
  • Mentor teams on best practices and continuous improvement.

Skills

ETL design
Spark
Scala programming
Python
AWS cloud
Data warehousing
SQL performance tuning
GenAI integration
LangChain/Llama/HuggingFace
Unix Shell scripting

Education

Bachelors in CS/IT or quantitative discipline

Tools

GDE
Express-IT
Control Center
Teradata
Hadoop
Tableau
OBIEE
SAS

Job description

At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Staff Data Engineer

Location Bangalore

This role reports to a Chapter Lead (Engineering Manager) and is key member of the team responsible for all development work.

Impact & Contribution

To ensure the Group achieves sustainable competitive advantage through data & analytics, you will need to play a key role in supporting the BB Tech in executing to the Groups data strategy.

As an Engineer, you will be required to build strong working relationships with key business and stakeholders to improve outcomes, drive engineering standards across the group, identify engineering improvement opportunities to improve our status on risk, compliance, vulnerabilities and general health of our technical solutions, while improving our E2E engineering outcomes to drive better technical outcomes across BB Tech. You will adopt tools and templates used across analytics systems that underpin our data and analytics capabilities for the Group.

  • Understand our customers' core business objectives and build end-to-end data centric solutions to address them.
  • Lead or participate in the definition, execution and communication of ETL strategy and technical solution.
  • Development of data staging, architecture and consuming internal and external application interfaces
  • Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards.
  • Participate in the full lifecycle of agile projects (ideation through implementation)
  • Designs technical solutions and consumption patterns for business requirements with increasing complexity.
  • Adhere to the Code of Conduct. The Code of Conduct sets the standards of behavior, actions and decisions we expect from our people.
  • Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks
  • Influence and guide stakeholders to ensure that solutions are robust, secure and highly available
  • Uplift the quality of technical solutions by applying industry best practice
  • Role model continuous improvement mindset in team and project interactions
  • 7-11 years of experience in design or development in Analytics and Data Warehousing projects.
  • Experience in designing and building end-to-end solutions with the Big data platform, Spark or scala programming.
  • 8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
  • Experience in building data pipelines using AWS services in Cloud Ecosystem.
  • Experience in Python and any other programming language is highly recommended.
  • Experience in building AI/GenAI powered engineering applications is highly recommended.
  • Experience in utilizing GenAI framework (Langchain, Llama, Hugging Face) and automation applications is highly desirable.
  • Experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
  • Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
  • Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
  • Education Qualification: Bachelor’s in computer science, B. Tech IT, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience.
  • We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Engineer
Staff Data Engineer

Cba (CommBank Careers) • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Staff Data Engineer
Staff Data Engineer

Commonwealth Bank • Bengaluru

On-site
INR 2,000,000 - 4,500,000
Staff Data Engineer
Staff Data Engineer

CBA Cross Border Associates • Bengaluru

On-site
INR 3,500,000 - 5,500,000
Senior Data Engineer
Senior Data Engineer

Commonwealth Bank • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Staff Software Engineer - Java
Staff Software Engineer - Java

Commonwealth Bank of Australia • Bengaluru

On-site
INR 4,200,000 - 6,200,000
Staff Software Engineer - .NET
Staff Software Engineer - .NET

Commonwealth Bank • Bengaluru

On-site
INR 3,000,000 - 5,400,000
Senior Staff Software Engineer (.NET)
Senior Staff Software Engineer (.NET)

Commonwealth Bank of Australia • Bengaluru

On-site
INR 3,500,000 - 5,500,000
Staff Software Engineer (Harrier)
Staff Software Engineer (Harrier)

Commonwealth Bank of Australia • Bengaluru

On-site
INR 1,800,000 - 2,800,000
Staff Software Engineer (Harrier)
Staff Software Engineer (Harrier)

Commonwealth Bank • Bengaluru

On-site
INR 4,200,000 - 6,000,000
Executive Manager - Customer Data Domain
Executive Manager - Customer Data Domain

Commonwealth Bank of Australia • Bengaluru

On-site
INR 4,000,000 - 7,000,000