Senior Data Engineer IND

OSBIndia Private Ltd.; Bengaluru; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

OSB India Pvt Ltd is seeking a Sr. Data Engineer to translate business requirements into Azure cloud-based big data solutions. You will build data pipelines, warehouses, and lakes using ADF, Databricks, and Synapse, delivering enterprise-scale data transformations and modernisation.

You will work with data teams and product owners to ensure data platforms meet current needs and align with the organisation's vision, with a focus on scalable cloud architecture and governance.

Qualifications

• 8+ years IT experience, preferably in Azure Data & Analytics.
• 6+ years Data engineering (Azure) delivery experience incl analysis/development/deployment.
• 5 years experience in Azure Data engineering projects.
• Proficiency in Python/SQL/SparkSQL/PySpark.
• Expert understanding of Azure Data Factory, Synapse, SQL, Data Lake, Delta Lake.
• Proven delivery of end-to-end data platforms (data lake to BI/ML).
• Experience building high-volume, low-latency pipelines and Lakehouse with Delta Lake.
• CI/CD exposure; Kubernetes is a plus.
• Experience in agile environments.

Responsibilities

• Implement robust ETL/ELT pipelines using Azure Data Factory/Synapse Pipelines and Azure Databricks (PySpark) for batch and streaming data.
• Ingest and process streams using Azure Event Hubs / Kafka and Databricks Structured Streaming.
• Develop Delta Lake/Lakehouse layers on ADLS Gen2; build curated datasets and dimensional models on Synapse.
• Tune Spark clusters, SQL pools, and pipelines for performance, reliability and cost.
• Implement data quality frameworks, lineage and monitoring.
• Implement DevOps workflows with Azure DevOps/GitHub Actions, IaC using Bicep/Terraform/ARM.
• Triage incidents, perform root cause analysis and drive improvements.
• Analyze current business processes and identify opportunities for Azure Data & Analytics adoption.
• Develop best practices, reusable code, libraries, and patterns for Azure data platforms.
• Collaborate with Data Engineering Manager to ensure delivery aligned with plans.
• Drive data processing efficiency and migrations from on-prem to cloud.

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Python

SQL

SparkSQL

PySpark

Kafka

Delta Lake

DevOps

Education

Bachelor’s or Master’s in Computer Science/Information Systems/related field

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure SQL

ADLS Gen2

Databricks

Job description

Job Description

Job Title: Sr. Data Engineer

Department: IT- Data

Reporting to: Sr. Data Engineering Manager

Location: Bangalore

Version date: 09/02/2026

This role aligns with the Employee/Line Manager version of OSB’s Value Driven Behaviours framework

About OneSavings Bank plc

OneSavings Bank plc (OSB) the specialist lending and retail savings group began trading as a bank on 1 February 2011 and was admitted to the main market of the London Stock Exchange in June 2014 (OSB.L). OSB joined the FTSE 250 index in June 2015.

The Group, which is headquartered in Chatham, Kent OSB is authorised by the Prudential Regulation Authority, part of the Bank of England, and regulated by the Financial Conduct Authority and Prudential Regulation Authority.

OSB primarily targets underserved market sub-sectors that offer high growth potential and attractive risk-adjusted returns in which it can take a leading position and where it has established expertise, platforms and capabilities. These include private rented sector Buy-to-Let, commercial and semi-commercial mortgages, residential development finance, bespoke and specialist residential lending and secured funding lines. It is differentiated through its use of high skilled, bespoke underwriting and efficient operating model. OSB lends through the Kent Reliance, InterBay Commercial, Prestige Finance and Heritable Development Finance brands, originating organically through specialist brokers and independent financial advisers.

OSB is predominantly funded by retail savings originated through the long established Kent Reliance name, which includes online and postal channels, as well as a network of branches in the South East of England. Diversification of funding is currently provided by participation in the Funding for Lending Scheme and access to a securitisation programme. The majority of the Group’s administrative support functions are performed by its wholly owned OSB India operation, based in Bangalore, India

About OSB India Pvt Ltd

OSB India is an offshore subsidiary of One Savings Bank Group plc., the UK based Challenger Bank. OSB India was incorporated in 2004 as a key part of the OneSavings Bank business strategy to provide operational service support.

OSB India works with the Bank’s trading brands in the UK, providing exceptional customer support and service delivery to new and existing customers.

OSB India also prides itself for offering operational excellence by devising and utilizing process improvements and functional efficiencies.

Job Purpose

The Sr. Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for the data modernisation program. You will be responsible for building complex data pipelines, data warehouses, and data lakes using Azure services like Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.

The Sr. Data Engineer will work closely with other members of the data engineering team and product owners ensuring Data strategy and platforms fulfil current needs and are aligned with the overall vision of the organisation. They will be responsible for delivery of enterprise scale data transformation/modernisation programmes.

The ideal candidate will be an experienced data technologist and have a blend of experience across delivery and the practical application of contemporary data technologies. Experience in working within the Banking Industry (in banking, vendors or a large tech firm) is highly desirable.

Core Responsibilities

• Implement robust ETL/ELT pipelines using Azure Data Factory/Synapse Pipelines and Azure Databricks (PySpark/Spark SQL) for batch and streaming data.
• Ingest and process streams using Azure Event Hubs / Kafka, Databricks Structured Streaming, or Azure Stream Analytics.
• Develop Delta Lake/Lakehouse layers on ADLS Gen2; build curated datasets and dimensional models on Synapse Dedicated SQL Pools.
• Tune Spark clusters, SQL pools, and pipelines for performance, reliability, and cost.
• Implement DQ frameworks (expectations/unit tests), lineage, and monitoring.
• Implement DevOps workflows with Azure DevOps/GitHub Actions, Bicep/Terraform/ARM, environment promotion, and release governance.
• Triage incidents, conduct root cause analysis, and drive post-incident improvements and runbooks.
• Analyse current business practices, processes, and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics Services
• Develop best practices including reusable code, libraries, patterns, and consumable frameworks for Azure cloud-based data warehousing and data pipelines.
• Work closely with the Azure Data engineering Manager and technical leads to ensure the execution of plans corresponds with what is being promised.
• Data processing efficiency improvement, migrations from on-prem to public cloud platforms.

Experience Requirements

• Overall 8+ years of IT experience preferably in Azure Data and Analytics implementation.
• Minimum 6 years of Data engineering (Azure) delivery experience including analysis / development / configuration/ deployment.
• 5 years of implementation experience in Azure Data engineering projects
• Proficiency in Python/SQL/SparkSQL/PySpark
• Expert level understanding on Azure Data Factory, Azure Synapse Analytics, Azure SQL, Azure Data Lake, Datra bricks, perview and Azure App Service is required.
• Proven delivery of end-to-end data platforms (data lake -> curated/serving -> BI/ML consumption).
• Experience building high-volume, low-latency pipelines and Lakehouse implementations with Delta Lake.
• Demonstrated cost control in Azure (cluster policies, job orchestration, storage tiering, optimization).
• Understanding of data governance and security best practices
• Experience in Streaming and batch architecture (e.g., Kafka, Kafka streams, Spark, Flink)
• Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage.
• Development of data pipelines using API ingestion and Streaming ingestionmethods.
• Experience in working in a fast-paced agile environment.

Knowledge Requirements

• Excellent understanding of data technologies landscape/ecosystem (Both On-prem and Cloud)
• Azure Databricks (PySpark/Spark SQL), Synapse Analytics (SQL Pools & Spark), ADF/Synapse Pipelines.
• ADLS Gen2, Azure SQL/MI, Delta Lake, Parquet/ORC, partitioning/bucketing.
• Streaming: Event Hubs/Kafka, Structured Streaming, Checkpointing/Exactly-once semantics.
• Scheduling/Orchestration: Triggers, tumbling windows, dependency handling, idempotent re-runs.
• Lakehouse and Dimensional Modeling (Star/Snowflake, SCD Types, CDC via ADF/Databricks/SQL).
• Medallion Architecture (Bronze/Silver/Gold), data vault (nice to have).
• Performance & Cost: file sizes, small files problem, AQE, broadcast/hash joins, Z-Order, OPTIMIZE/VACUUM.
• RBAC/AAD, Managed Identities, Key Vault, Private Link, Network Security Groups.
• Git, Branching strategies, PR reviews, unit/integration tests for data.
• Detailed knowledge of Software development essential.
• Proven ability to build, manage and foster a team-oriented environment
  - Proven ability to work creatively and analytically in a problem-solving environment
  - Excellent communication (written and oral) and interpersonal skills
  - Excellent organizational, multi-tasking, and time-management skills

Required Qualifications/Certifications

• Bachelor’s or master’s degree in computer science, information systems, or related field, and / or equivalent work experience is essential.
• Azure Certifications (Related to Design and Development)
• Professional IT accreditation or qualification is desirable.

This job description defines the role as it exists now. It is not meant to represent an exclusive description of the job holder’s responsibilities as these may vary from time to time in line with the needs of the business. The role may change and evolve over time and any changes will be communicated as necessary

JD Template last updated: 12/9/18