Lead Data Engineer

Lloyds Technology Centre; Hyderabad; Hybrid; INR 4,000,000 - 6,000,000; Full time

Job summary

Lloyds Technology Centre in Hyderabad invites a Lead Data Engineer to shape and deliver data solutions on Google Cloud Platform. You will lead a multidisciplinary team, drive data product delivery, and design scalable architectures in a hybrid work setup.

You will mentor engineers, implement data security practices, advocate for DevOps and CI/CD, and continuously improve data quality and performance across the data platform.

Qualifications

• Experience designing data products on Google Cloud Platform (GCP).
• Ability to lead data engineering teams and manage end-to-end delivery.
• Strong Python and SQL skills with data modelling and orchestration experience.

Responsibilities

• Design, develop, and maintain complex Data Products on GCP following best practices.
• Lead implementation reviews and oversee data product delivery for quality and knowledge sharing.
• Guide engineers through the full SDLC to deliver robust, scalable data applications.

Skills

Data engineering

Python

SQL

Leadership

DevOps

Tools

GCP

BigQuery

Dataflow

Pub/Sub

Kafka

GKE

Dataplex

Spanner

AlloyDB

Cloud SQL

Terraform

Job description

Job Summary

Lead Data Engineer - Grade F

Location: Hyd

Mode: Hybrid

YOE: 17-22

Key Activities / Responsibilities

In this role, youll play a pivotal role in crafting and implementing data solutions on Google Cloud Platform (GCP) leading and collaborating with multi-functional teams to ensure seamless integration of data products into our new data architecture, driving innovation and optimising data utilisation.

Your role would include the following activities:

• Design, develop, and maintain complex Data Products. Implementing clean, maintainable, and efficient solution design following best practices.
• Lead implementation reviews and all aspects of data product delivery to preserve quality and share knowledge.
• Be responsible for leading a talented group of engineers, guiding and working alongside them on entire software development lifecycle and manage the delivery of robust, scalable data applications and features.
• Evaluate and recommend tools, technologies, and processes to ensure the highest quality product platform.
• Identify and implement best practices for data engineering.
• Excellent problem solving and analytical skills to resolve complex data issues, technical problems, and bugs.
• Provide guidance and mentorship to engineers.
• Strong understanding of data security principles and secure architectural practices
• Knowledge of DevOps practices and CI/CD pipelines
• Ensure timely delivery by managing tasks and priorities effectively utilising their in-depth expertise in Agile methodology.
• Communicate effectively with team and stakeholders.
• Accountable for custodianship governance activities on data assets that their platform produce and consume.

Recruitment Priority Skills

Were keen to speak to candidates with experience who have strong skills in :

• Data Engineering: Can develop data validation methodology and data hub process models, including sourcing, loading, transformation and extraction in alignment with the Group and business needs.
• Data Modelling & Design :Can aligns models to domain boundaries and real access patterns across services, streams, and warehouses. Designs for evolvability using additive changes, backward-compatible schemas, and safe deprecations. Can embed data quality checks, defines conformed dimensions and a semantic layer, and implements privacy and security controls such as row/column-level security and PII handling. Experience of coaching others and enforcing standards through reviews and reusable templates.
• Dev Ops: Leading team to identify issues and improve automation across the end-to-end application development lifecycle. Using technology stack and tooling to evolve applications at pace and ensure efficiency, quality and security is monitored as part of every build.
• Python: Has a holistic understanding of Python and can make intuitive decisions in familiar contexts. Capable of implementing multi-threading and asynchronous programming using tools like threading and asyncio.
• SQL: Can tune complex queries and workloads; designs schemas and constraints; manages concurrency/isolation; refactors for performance and readability; mentors others

• Leadership & People Development: Builds, inspires, and scales high-performing Data Engineering, Analytics, and Modelling teams. Creates a culture of ownership, innovation, and continuous improvement through effective coaching, mentoring, talent development, and servant leadership.

Other Key Skills

• AI Literacy
• Data Architecture
• Quality Engineering
• Agile Methodology & Tools
• Expertise in FinOps/Optimisation for Cloud Computing
• Google Analytical Database technologies (Big Query, Cloud SQL, Spanner, AlloyDB)
• Infrastructure as Code experience
• Streaming platforms knowledge and utilisation (Pub/Sub or Kafka for example, Dataflow, Flink for example)
• Build/Deploy container-based solutions (GKE)
• Building solutions to provide Data Quality (Dataplex, Atacama etc)
• Exposure and experience to modern programming practices (Functional programming, Event-based solutions)

Personal

• Data Literacy
• Data Storytelling

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.