Senior Data Engineer IND

Colonial Group; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

OSB India Pvt Ltd in Bangalore is seeking a Sr. Data Engineer to translate business needs into Azure-based data solutions.

You will build data pipelines, data lakes and data warehouses using ADL, Databricks and Synapse, and work with product owners to align data strategy with the organisation. The ideal candidate has 8+ years in data engineering, strong Python/SQL skills, and experience delivering scalable data platforms in a banking or financial services context.

Qualifications

• Bachelor’s or Master’s degree in computer science, information systems, or related field.

Responsibilities

• Implement robust ETL/ELT pipelines using Azure Data Factory/Synapse Pipelines and Azure Databricks (PySpark) for batch and streaming data.

Skills

Python

SQL

SparkSQL

PySpark

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Azure SQL

Azure Data Lake

Delta Lake

Kafka

CI/CD pipelines

Kubernetes

Pipelines

Education

Bachelor’s or Master’s degree in computer science / information systems

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure SQL

Delta Lake

Job description

Job Description

Job Title: Sr. Data Engineer

Department: IT- Data

Reporting to: Sr. Data Engineering Manager

Location: Bangalore

Version date: 09/02/2026

This role aligns with the Employee/Line Manager version of OSB’s Value Driven Behaviours framework

About OneSavings Bank plc

OneSavings Bank plc (OSB) the specialist lending and retail savings group began trading as a bank on 1 February 2011 and was admitted to the main market of the London Stock Exchange in June 2014 (OSB.L). OSB joined the FTSE 250 index in June 2015.

The Group, which is headquartered in Chatham, Kent OSB is authorised by the Prudential Regulation Authority, part of the Bank of England, and regulated by the Financial Conduct Authority and Prudential Regulation Authority.

OSB primarily targets underserved market sub-sectors that offer high growth potential and attractive risk-adjusted returns in which it can take a leading position and where it has established expertise, platforms and capabilities. These include private rented sector Buy-to-Let, commercial and semi-commercial mortgages, residential development finance, bespoke and specialist residential lending and secured funding lines. It is differentiated through its use of high skilled, bespoke underwriting and efficient operating model. OSB lends through the Kent Reliance, InterBay Commercial, Prestige Finance and Heritable Development Finance brands, originating organically through specialist brokers and independent financial advisers.

OSB is predominantly funded by retail savings originated through the long established Kent Reliance name, which includes online and postal channels, as well as a network of branches in the South East of England. Diversification of funding is currently provided by participation in the Funding for Lending Scheme and access to a securitisation programme. The majority of the Group’s administrative support functions are performed by its wholly owned OSB India operation, based in Bangalore, India

About OSB India Pvt Ltd

OSB India is an offshore subsidiary of One Savings Bank Group plc., the UK based Challenger Bank. OSB India was incorporated in 2004 as a key part of the OneSavings Bank business strategy to provide operational service support.

OSB India works with the Bank’s trading brands in the UK, providing exceptional customer support and service delivery to new and existing customers.

OSB India also prides itself for offering operational excellence by devising and utilizing process improvements and functional efficiencies.

Job Purpose

The Sr. Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for the data modernisation program. You will be responsible for building complex data pipelines, data warehouses, and data lakes using Azure services like Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.

The Sr. Data Engineer will work closely with other members of the data engineering team and product owners ensuring Data strategy and platforms fulfil current needs and are aligned with the overall vision of the organisation. They will be responsible for delivery of enterprise scale data transformation/modernisation programmes.

The ideal candidate will be an experienced data technologist and have a blend of experience across delivery and the practical application of contemporary data technologies. Experience in working within the Banking Industry (in banking, vendors or a large tech firm) is highly desirable.

Core Responsibilities

• Implement robust ETL/ELT pipelines using Azure Data Factory/Synapse Pipelines and Azure Databricks (PySpark/Spark SQL) for batch and streaming data.
• Ingest and process streams using Azure Event Hubs / Kafka, Databricks Structured Streaming, or Azure Stream Analytics.
• Develop Delta Lake/Lakehouse layers on ADLS Gen2; build curated datasets and dimensional models on Synapse Dedicated SQL Pools.
• Tune Spark clusters, SQL pools, and pipelines for performance, reliability, and cost.
• Implement DQ frameworks (expectations/unit tests), lineage, and monitoring.
• Implement DevOps workflows with Azure DevOps/GitHub Actions, Bicep/Terraform/ARM, environment promotion, and release governance.
• Triage incidents, conduct root cause analysis, and drive post-incident improvements and runbooks.
• Analyse current business practices, processes, and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics Services
• Develop best practices including reusable code, libraries, patterns, and consumable frameworks for Azure cloud-based data warehousing and data pipelines.
• Work closely with the Azure Data engineering Manager and technical leads to ensure the execution of plans corresponds with what is being promised.
• Data processing efficiency improvement, migrations from on-prem to public cloud platforms.

Experience Requirements

• Overall 8+ years of IT experience preferably in Azure Data and Analytics implementation.
• Minimum 6 years of Data engineering (Azure) delivery experience including analysis / development / configuration/ deployment.
• 5 years of implementation experience in Azure Data engineering projects
• Proficiency in Python/SQL/SparkSQL/PySpark
• Expert level understanding on Azure Data Factory, Azure Synapse Analytics, Azure SQL, Azure Data Lake, Datra bricks, perview and Azure App Service is required.
• Proven delivery of end-to-end data platforms (data lake -> curated/serving -> BI/ML consumption).
• Experience building high-volume, low-latency pipelines and Lakehouse implementations with Delta Lake.
• Demonstrated cost control in Azure (cluster policies, job orchestration, storage tiering, optimization).
• Understanding of data governance and security best practices
• Experience in Streaming and batch architecture (e.g., Kafka, Kafka streams, Spark, Flink)
• Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage.
• Development of data pipelines using API ingestion and Streaming ingestionmethods.
• Experience in working in a fast-paced agile environment.

Knowledge Requirements

• Excellent understanding of data technologies landscape/ecosystem (Both On-prem and Cloud)
• Azure Databricks (PySpark/Spark SQL), Synapse Analytics (SQL Pools & Spark), ADF/Synapse Pipelines.
• ADLS Gen2, Azure SQL/MI, Delta Lake, Parquet/ORC, partitioning/bucketing.
• Streaming: Event Hubs/Kafka, Structured Streaming, Checkpointing/Exactly-once semantics.
• Scheduling/Orchestration: Triggers, tumbling windows, dependency handling, idempotent re-runs.
• Lakehouse and Dimensional Modeling (Star/Snowflake, SCD Types, CDC via ADF/Databricks/SQL).
• Medallion Architecture (Bronze/Silver/Gold), data vault (nice to have).
• Performance & Cost: file sizes, small files problem, AQE, broadcast/hash joins, Z-Order, OPTIMIZE/VACUUM.
• RBAC/AAD, Managed Identities, Key Vault, Private Link, Network Security Groups.
• Git, Branching strategies, PR reviews, unit/integration tests for data.
• Detailed knowledge of Software development essential.
• Proven ability to build, manage and foster a team-oriented environment
  - Proven ability to work creatively and analytically in a problem-solving environment
  - Excellent communication (written and oral) and interpersonal skills
  - Excellent organizational, multi-tasking, and time-management skills

Required Qualifications/Certifications

• Bachelor’s or master’s degree in computer science, information systems, or related field, and / or equivalent work experience is essential.
• Azure Certifications (Related to Design and Development)
• Professional IT accreditation or qualification is desirable.

This job description defines the role as it exists now. It is not meant to represent an exclusive description of the job holder’s responsibilities as these may vary from time to time in line with the needs of the business. The role may change and evolve over time and any changes will be communicated as necessary

JD Template last updated: 12/9/18