Principal Data Engineer

Lloyds Bank plc; Hyderabad; On-site; INR 5,500,000 - 9,000,000; Full time

Job summary

Lloyds Technology Centre in Hyderabad is seeking an Engineering Leader – Data to own data products and platform delivery across squads. You will drive roadmaps, establish scalable patterns, and partner with the Team Product Owner to align outcomes and performance.

15+ years of experience and a strong cloud data background are expected for this pivotal role. You will shape semantic models, KPI definitions, and feature strategies for ML/GenAI readiness while ensuring security, governance, and cost

Qualifications

• Experience delivering end-to-end data platforms with measurable outcomes.
• Ability to define semantic models, KPI logic and BI consumption at scale.
• Hands-on with AI-ready data design including knowledge graphs and feature strategies.
• Strong modeling skills: star/snowflake, Data Vault 2.0 and versioning.
• Proven cloud data platform expertise across BigQuery, Snowflake, Redshift or Synapse.
• Experience with streaming pipelines and event schemas, idempotency and reliability.
• Software engineering mindset: CI/CD, code reviews, testing and documentation.
• Experience with IaC and runtime orchestration (Terraform/CloudFormation, Docker/Kubernetes).
• Focus on data quality, governance, data contracts and lineage tooling.
• Knowledge of FinOps, cost telemetry and performance optimization.

Responsibilities

• Delivery ownership: define roadmaps, OKRs, release plans and manage risk.
• Lead and coach multiple squads; establish DoR/DoD and working agreements.
• Scale engineering patterns with reusable frameworks and golden paths.
• Define enterprise semantic models and conformed dimensions for BI.
• Shape data for ML/GenAI with ontologies and knowledge graphs.
• Oversee data modelling, performance, and cloud warehouse design.
• Manage streaming pipelines with Kafka/Pub/Sub/Kinesis and Spark/Flink.
• Institute data quality contracts and metadata lineage across pipelines.
• Implement observability, FinOps guardrails and cost/performance controls.
• Govern security & compliance, IAM, encryption and privacy-by-design.

Skills

Leadership & ownership

Semantic & BI expertise

AI-ready design

Modelling depth

Cloud data platforms

Streaming systems

Software-engineering mindset

IaC & runtime

Data quality & governance

FinOps & observability

Tools

BigQuery

Snowflake

Redshift

Synapse/Databricks SQL

Kafka

Pub/Sub

Kinesis

Spark

Flink

Great Expectations/dbt

Job description

Job Description Summary

End Date Tuesday 29 September 2026 We Support Flexible Working – Click here for more information on flexible working options Flexible Working Options Hybrid Working The Data Engineer will work alongside the Team Product Owner in a Feature Team managing delivery by leading others. They will operate as co-leader with the Team PO with involvement in decision making and planning of Product roadmap. In some cases, this role will be an Individual Contributor operating at Lab rather than feature team level.

Job Title

Engineering Leader – Data (Lloyds Technology Centre)

Location

Hyderabad, India (Hybrid: at least 2 days/week in office)

Experience

15+ years

About Lloyds Technology Centre

Lloyds Technology Centre is the strategic technology hub for Lloyds Banking Group, enabling digital transformation and innovation across the banking ecosystem. Our mission is to build secure, scalable, and data‑driven solutions that empower millions of customers and ensure compliance with financial regulations.

Role Overview

Own the delivery and operation of data products and platforms across multiple squads, with end‑to‑end accountability for outcomes, quality, and reliability. Establish reusable, metadata‑driven engineering patterns; elevate semantic models, KPI/metrics, and BI consumption; and build an AI‑ready foundation (knowledge layers, knowledge graphs, semantic models) that accelerates analytics and machine learning use‑cases across the organisation.

Key Responsibilities

• Delivery ownership: Define roadmaps, OKRs, and release plans; oversee scope, estimation, risk, and stakeholder communication; ensure on‑time, on‑budget, quality delivery across squads.
• Team ownership & leadership: Build and lead high‑performing teams (hiring, coaching, performance management); set coding standards, DoR/DoD, working agreements, and succession plans.
• Engineering patterns at scale: Establish factory‑mode delivery via inner‑sourced, reusable frameworks (ingestion, transform, quality, lineage, observability) and golden paths with strong documentation
• Semantic layer & metrics: Define and govern enterprise semantic models, KPI/metric definitions, conformed dimensions, metric stores, and query‑ready views to enable consistent BI and self‑serve analytics.
• AI readiness & knowledge layers: Shape data for ML/GenAI—ontologies, knowledge graphs, feature/embedding strategies, and patterns that make the platform AI‑ready by design.
• Data modelling & performance: Guide dimensional (star/snowflake) and Data Vault 2.0 modelling; set standards for physical design on cloud warehouses (partitioning, clustering, caching, workload mgmt.)
• Streaming & real‑time: Oversee event pipelines (Kafka/Pub/Sub/Kinesis + Flink/Spark) with exactly‑once semantics, replay, SLAs/SLOs, and resiliency patterns.
• Quality, metadata & lineage: Make quality the default—data contracts, DQ rules/tests, reconciliation and automatically capture/propagate technical/business metadata and end‑to‑end lineage
• Observability & FinOps: Implement platform and pipeline telemetry (logs, metrics, tracing) and proactive cost/performance guardrails for cloud DW/compute; continuously optimise jobs/queries.
• Security & compliance: Champion IAM, least‑privilege patterns, encryption, secrets mgmt., and auditability; embed privacy‑by‑design and regulatory controls into pipelines and platforms.
• Vendor & partner management: Govern partner delivery (e.g., TCS/HCL), enforce standards, and ensure reusable IP is contributed back to inner‑source repos.

Required Skills

• Leadership & ownership: Proven record of owning complex data platform deliveries, leading multiple squads, and managing outcomes/SLAs in production.
• Semantic & BI expertise: Hands‑on experience defining semantic layers, KPI/metric logic, metric stores and consumption models that scale across BI tools.
• AI‑ready design: Practical understanding of AI/ML data needs—feature engineering, data products for ML, knowledge graphs/ontologies, vector/embedding patterns and how to operationalise them on cloud platforms.
• Modelling depth: Dimensional (star/snowflake), Data Vault 2.0, SCDs, schema evolution/ versioning; ability to set and enforce modelling standards.
• Cloud data platforms: Strong experience with one or more of BigQuery, Snowflake, Redshift, Synapse/Databricks SQL; clarity on cloud DW vs traditional MPP trade‑offs and performance levers.
• Streaming systems: Kafka/Pub/Sub/Kinesis and Spark/Flink; event schema management (Avro/Protobuf), idempotency, back‑pressure, state mgmt.
• Software‑engineering mindset: Git‑based workflows, code reviews, automated testing, CI/CD, artifact versioning; inner‑sourcing culture and documentation excellence.
• IaC & runtime: Terraform/CloudFormation, Docker/Kubernetes; sizing, autoscaling, job concurrency, and reliability engineering.
• Data quality & governance: Data contracts; testing frameworks (e.g., Great Expectations/dbt tests); catalogue/lineage tooling; policy enforcement via pipelines.
• FinOps & observability: Cost modelling for cloud DW/compute, workload tuning, budgets/alerts; platform and pipeline telemetry with actionable SLOs.

We're Lloyds Technology Centre*

We're a tech and data company located in Hyderabad, India. We're part of Lloyds Banking Group, a leading provider of financial services in the UK and the UK's largest digital bank, with more than 27 million customers. We're changing financial services, and we want you to join us. With market‑leading people practices and great opportunities for career and skills growth, we are committed to creating an exceptional colleague experience that is welcoming for all. Join us! *Lloyds Technology Centre does not offer financial services in India. Should you wish to contact us for any reason, please email us at: [e-mail] For more Flexible Working Options please use the free text search, e.g. job sharing, variable hours, to identify relevant matches.