Data Engineer II - Snowflake and DBT

svb; Bengaluru; Hybrid; INR 1,500,000 - 2,100,000; Full time

Job summary

SVB in Bengaluru is seeking a Data Engineer II to design, build, and maintain scalable data pipelines for enterprise data warehouses and data lakes.

You will work in a hybrid setup, collaborate with global teams, leverage Snowflake, AWS, Python, and Airflow to deliver timely, high-quality data solutions that drive regulatory and business outcomes.

Qualifications

• 5+ years of experience building data pipelines in Data Warehouse/Data Lake environments.
• Strong knowledge of Snowflake for enterprise implementations and migrations.
• Proficient in SQL and Python; experienced with Unix scripting.
• Experience with ELT tools like DBT and data integration platforms.
• Hands-on with Airflow for data pipeline orchestration and CI/CD (GitLab).
• Knowledge of data modeling (Logical/Physical) and data governance is a plus.

Responsibilities

• Build and maintain data pipelines for Enterprise Data Warehouse/ODS/Data Marts with secure data access and governance.
• Develop data ingestion pipelines from diverse sources (files, databases, APIs, SharePoint).
• Create reusable data pipelines/frameworks using Python and ETL/ELT patterns.
• Implement scheduled and event-driven ingestion using scheduling tools.
• Tune performance of pipelines and SQL objects for optimal throughput.
• Collaborate in Agile ceremonies with cross-functional teams and product owners.

Skills

Team Player

Communication

Problem Solving

Partnership and Collaboration

Attention to Detail

Tools

Snowflake

AWS

DBT

Qlik Replicate

Snowpark

SQL

Python

Airflow

GitLab

Unix

S3

Lambda

Glue

Step Functions

CloudWatch

Job description

Job Description

Value Proposition:

Responsible for designing and building data pipelines for enterprise data through ETL/ELT processes.

Develop and maintain large-scale data platforms, data lakes and cloud solutions.

Job Details

Position Title: Data Engineer II

Career Level: P2

Job Category: Senior Associate

Role Type: Hybrid

Job Location: Bangalore

About the Team

The data engineering team is community of dedicated professionals committed to designing, building, and maintaining data platform solutions for the organization.

Impact

Enterprise data warehouse supports several critical business functions for the bank including Regulatory Reporting, Finance, Risk steering, and Customer 360. This role is vital for building and maintaining enterprise data platform, data processes, and to support business objectives. Our values - inclusivity, transparency, and excellence - drive everything we do. Join us and make a meaningful impact on the organization.

Key Deliverables

• Responsible for building and maintaining data platform that supports data integrations for Enterprise Data Warehouse, Operational Data Store or Data Marts etc. with appropriate data access, data security, data privacy and data governance.
• Create data ingestion pipelines in data warehouses and other large-scale data platforms.
• Create Data Ingestion pipeline for a variety of sources - File (Flat, delimited, Excel), DB, API (With Apigee integration), and SharePoint.
• Build reusable Data pipelines / frameworks using Python.
• Creating scheduled as well as trigger-based ingestion patterns using scheduling tools.
• Create performance optimized DDLs as per Logical Data Model.
• Performance tuning of complex data pipelines and SQL queries.
• Performs impact analysis of proposed changes on existing architecture, capabilities, system priorities, and technology solutions.
• Working in Agile Framework, participating in various agile ceremonies, co-ordination with scrum master, tech lead, and PO on sprint planning, backlog creation, refinement, demo, and retrospection.
• Working with Product Owners to understand PI goals, PI planning, requirement clarification, and delivery coordination.
• Technical support for production incidents and failures
• Work with global technology teams across different time zones (primarily US) to deliver timely business value.

Skills and Qualification

Functional Skills

• Team Player: Support peers, team, and department management.
• Communication: Excellent verbal, written, and interpersonal communication skills.
• Problem Solving: Excellent problem-solving skills, incident management, root cause analysis, and proactive solutions to improve quality.
• Partnership and Collaboration: Develop and maintain partnership with business and IT stakeholders
• Attention to Detail: Ensure accuracy and thoroughness in all tasks.

Technical/Business Skills

• Data Engineering:
• 5+ years of experience in building data pipelines in Data Warehouse and Data Lake platforms. Good knowledge of data warehouse principles, and concepts.
• Strong knowledge of Snowflake data platform and solutions for enterprise level implementation, and migration from legacy or on-prem systems
• Technical expertise of AWS cloud related services such as S3, Lamda, Glue, Step Function, CloudWatch, etc.
• Data integration skills:
• Experience in design and development of complex data pipelines
• Technical expertise in ELT tools such as DBT, Qlik Replicate, Snowpark, etc.
• Expert in SQL
• Experience with Unix and Python scripting
• Experience in data pipeline orchestration using Airflow
• Data Model: Knowledge of Logical and Physical Data Model using Relational or Dimensional Modeling practices, high volume ETL/ETL processes. Good to have Data Vault 2.0 experience.
• Performance tuning of data pipelines and DB Objects to deliver optimal performance.
• Experience in Gitlab version control and CI/CD processes.
• Experience working in Financial Industry is a plus.

Relationships & Collaboration

Reports to: Senior Manager - Data Engineering

Partners: Senior leaders and cross-functional teams

Collaborates: A team of Data Engineering associates

Accessibility Needs We a