Consultant, Application Development - Data Engineering [T500-29642]

CIBC India; Hyderabad; Hybrid; INR 1,200,000 - 2,100,000; Full time

Benefits offered by this job

MomentMakers recognition program

Competitive pay

Performance-based incentives

Family-first benefits

Retirement contributions

Generous time off & leaves

Wellbeing support

Job summary

CIBC India is seeking a Development Engineer to design, build, and maintain scalable data pipelines and data lake solutions on the Azure cloud. You will operate in a hybrid model, collaborating with cross-functional teams to advance banking data initiatives.

The role requires 6–9 years of data engineering experience, strong PySpark/Python and SQL skills, and deep knowledge of data warehousing concepts. Join a global team driving innovative data solutions for clients worldwide.

Qualifications

• 6–9 years of experience in data engineering or a related role.
• Strong hands-on experience with Azure Cloud services (Data Factory, ADLS Gen2, Azure Databricks, Synapse).
• Proficiency in PySpark and Python for large-scale data processing.
• Advanced SQL skills (stored procedures, performance tuning, CTEs, window functions).
• Solid understanding of data warehousing concepts — dimensional modeling, ETL/ELT patterns, data quality frameworks.
• Experience in banking/financial services domain (trade data, regulatory reporting, risk).
• Familiarity with SDLC methodologies (Agile/Scrum) and DevOps practices (CI/CD).
• Ability to work effectively in a hybrid project execution model (onsite + remote).
• Strong communication and coordination skills for working with multiple teams and stakeholders.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory, Databricks, PySpark, and Python.
• Build and optimize data models within enterprise data warehousing environments.
• Write complex SQL queries for data transformation, validation, and reconciliation across large datasets.
• Develop and deploy solutions on Microsoft Azure (Data Factory, Data Lake Storage, Databricks SQL, Synapse Analytics).
• Collaborate with business analysts, QA, and downstream reporting teams to ensure data accuracy and availability.
• Participate in the full SDLC — requirements gathering, design, development, testing, deployment, and production support.
• Coordinate with cross-functional teams including risk, compliance, operations, and front-office stakeholders.
• Identify opportunities for automation and leverage AI/ML-based tooling to improve data engineering workflows.
• Monitor and troubleshoot scheduled jobs, ensuring SLA adherence for batch and real-time data processing.
• Maintain documentation for data flows, lineage, and transformation logic.

Skills

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

Data Modeling

Data Warehousing

Agile/Scrum

DevOps CI/CD

Hybrid collaboration

Education

Degree in CS/Engineering/MIS

Tools

Autosys

Power BI

Git

Cognos

Azure DP-203

Job description

CIBC is a leading North American bank, with a history of more than 150 years of living our purpose - to help make your ambition a reality. Client relationships are at the center of our strategy, and our growth is enabled by a highly engaged and connected global team. From digital banking to community impact, we’re proud to drive progress for our clients and our communities. Recognized for our culture, award-winning innovation and community investment, CIBC continues to evolve by putting people and progress at the centre of everything we do.

About CIBC India:

CIBC India is a technology and operations hub in Hyderabad, where you’ll be part of our highly engaged and global team, and play a central role in supporting our growth. Whether you’re driving innovation in digital banking or streamlining client onboarding, you’ll be part of a culture recognized for excellence and investment in people. At CIBC India, people and progress are at the center of what we do: you’ll develop skills, collaborate with industry leaders, and see your ideas realized in a culture that values progress and belonging. We provide cutting-edge resources, ongoing learning, and a supportive environment where people come first. If you’re ready to create meaningful change and build your future, CIBC India is where your ambition meets opportunity.

What CIBC India Offers:

• competitive fixed pay
• performance-based incentive programs
• family-first benefits program
• employer contributions for your retirement
• attractive time off and leave offerings
• wellbeing support
• MomentMakers, our social, points-based recognition program

Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients worldwide

We cultivate a culture where you can express your ambition through initiatives like Purpose Day, a paid day off dedicated for you to use to invest in your growth and development.

What You’ll Be Doing (position summary):

The Development Engineer is responsible for designing, building, and maintaining scalable data pipelines and data lake solutions on the Azure cloud platform. This role combines strong technical expertise with an understanding of banking data landscapes and thrives in a hybrid project execution model. The incumbent will develop robust data solutions, ensure data accuracy, and support cross-functional collaboration to advance business outcomes.

At CIBC India we enable the work environment most optimal for you to thrive in your role. Details on your work arrangement (including on-site and remote work) will be discussed at the time of your interview.

How You’ll Succeed (responsibilities):

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory, Databricks, PySpark, and Python.
• Build and optimize data models within enterprise data warehousing environments (star schema, snowflake schema, slowly changing dimensions, etc.).
• Write complex SQL queries for data transformation, validation, and reconciliation across large datasets.
• Develop and deploy solutions on Microsoft Azure (Data Factory, Data Lake Storage, Databricks SQL, Synapse Analytics).
• Collaborate with business analysts, QA, and downstream reporting teams to ensure data accuracy and availability.
• Participate in the full SDLC — requirements gathering, design, development, testing, deployment, and production support.
• Coordinate with cross-functional teams including risk, compliance, operations, and front-office stakeholders.
• Identify opportunities for automation and leverage AI/ML-based tooling to improve data engineering workflows.
• Monitor and troubleshoot scheduled jobs, ensuring SLA adherence for batch and real-time data processing.
• Maintain documentation for data flows, lineage, and transformation logic.

CROSS-FUNCTIONAL RELATIONSHIPS:

• Collaborates with business analysts, QA, and reporting teams to ensure data accuracy and availability.
• Coordinates with risk, compliance, operations, and front-office stakeholders for requirements gathering and solution delivery.
• Works closely with technology partners to optimize data engineering workflows and support enterprise objectives.

COMPLIANCE REQUIREMENTS/RESPONSIBILITIES:

As an employee of CIBC, the incumbent must comply with all applicable CIBC and Line of Business policies, standards, guidelines and controls.

AUTHORITIES/DECISION RIGHTS:

As a key contributor to the business unit, this job has the authority to recommend changes to business processes in order to enhance operational efficiency and effectiveness.

JOB DIMENSIONS:

• Responsible for designing, building, and maintaining scalable data solutions for banking operations.
• Supports mission-critical data pipelines and warehouse solutions on Azure cloud platform.
• Ensures data accuracy, availability, and integrity across multiple business domains.
• Contributes to automation and process improvement initiatives within the team.

Experience: 6 – 9 years of experience

Who You Are (skills/qualifications):

Education- Degree/diploma in Computer Science, Engineering, MIS, or related field or relevant certifications and/or completion of a relevant bootcamp.

Must Have Skills:

• 6-9 years of experience in data engineering or a related role
• Strong hands-on experience with Azure Cloud services (Data Factory, ADLS Gen2, Azure Databricks, Synapse)
• Proficiency in PySpark and Python for large-scale data processing
• Advanced SQL skills (stored procedures, performance tuning, CTEs, window functions)
• Solid understanding of data warehousing concepts — dimensional modeling, ETL/ELT patterns, data quality frameworks
• Experience working in the banking/financial services domain (trade data, regulatory reporting, risk, or similar)
• Familiarity with SDLC methodologies (Agile/Scrum) and DevOps practices (CI/CD for data pipelines)
• Ability to work effectively in a hybrid project execution model (onsite + remote coordination)
• Strong communication and coordination skills for working with multiple teams and stakeholders.

Good to Have:

• Experience with job scheduling tools such as Autosys, or similar enterprise schedulers
• Exposure to reporting/BI tools like Power BI or Cognos for building or supporting dashboards and reports
• Awareness of AI/Generative AI tools and their application in data engineering (e.g., Copilot, automated testing, intelligent monitoring)
• Knowledge of data governance, metadata management, and data cataloging
• Experience with version control (Git)
• Relevant Azure certifications (DP-203, AZ-900, or similar)

Privacy:

By proceeding with the creation of a profile and submitting an application in response to this job posting, you acknowledge and agree that your personal data will be collected, used, retained and disclosed by CIBC India and its affiliates, as described in the Candidate Privacy Statement.