Lead Data Engineer

LSEG Business Services RM

Bengaluru

On-site

INR 1,800,000 - 3,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

LSEG Business Services RM is seeking a strong, hands-on Lead Data Engineer in Bengaluru, India to design, build, and operate a cloud-native, event-driven Service Layer platform powering QTC and finance integrations. You will lead a team, drive architecture, and ensure scalable, secure solutions across enterprise applications.

You will design real-time services in Golang and Python, implement canonical data models, and guide data governance while partnering with PMs and data teams to execute

Qualifications

  • Proven experience leading and mentoring engineering teams, including task planning and delivery management.
  • Strong hands-on experience in building large-scale distributed systems and enterprise integration platforms.
  • Hands-on coding in Golang and Python for backend services and data processing.
  • Cloud-native development on AWS with serverless patterns and managed services.
  • Experience with event-driven architectures using Kafka/AWS MSK or RabbitMQ.
  • Proficient in designing RESTful APIs and scalable data integration services.
  • Experience with canonical data models, data contracts, and data governance.

Responsibilities

  • Own end-to-end technical delivery of key initiatives with quality, scalability, security, and operability.
  • Mentor a team of engineers and drive technical excellence and knowledge sharing.
  • Lead architecture decisions for event-driven integrations and orchestration frameworks.
  • Define engineering standards, secure-by-design principles, and cloud-native patterns.
  • Design and operate real-time event-driven services using Golang and Python.
  • Build the Service Layer platform for Quote-to-Cash workflows across apps.
  • Create canonical data models, transformation layers, and data contracts.
  • Design scalable Kafka-based event processing with retries and replay.
  • Implement ETL, migration, reconciliation, and data-quality solutions on AWS Glue/Step Functions/Snowflake.
  • Establish observability, monitoring, alerts, and dashboards for end-to-end visibility.
  • Collaborate with Product Managers and cross-functional teams on roadmaps.
  • Lead code/design reviews and governance, enforcing SDLC and CI/CD standards.
  • Drive platform evolution with resiliency and security in cloud-native patterns.

Tools

Golang
Python
AWS
Kafka
Snowflake
PostgreSQL
ClickHouse

Job description

Job Description

We are looking for a strong, hands-on, highly autonomous Lead Data Engineer to design, build, and operate the Service Layer platform that powers enterprise Quote-to-Cash (QTC), customer lifecycle, and finance integrations across strategic enterprise applications.

Alongside deep technical contribution, you will provide technical leadership to a team of engineers, driving solution design, engineering excellence, delivery execution, and operational support across multiple integration initiatives.

You will be instrumental in building and evolving a cloud-native, event-driven integration platform based on AWS, Kafka, Go and Python, leveraging canonical data models, and asynchronous messaging, while leading the adoption of best practices for architecture, engineering standards, observability, security, and platform reliability. The platform processes high-volume business-critical events while providing end-to-end visibility, reliability, security, and scalability.

This role requires deep expertise in distributed systems, event-driven architecture, microservices, data engineering, and cloud-native development. You will contribute to the design and implementation of Service Layer foundation capabilities including messaging, observability, orchestration, data migration, reconciliation, canonical data management, and operational tooling.

Key responsibilities:
  • Own end-to-end technical delivery of key initiatives, ensuring solutions are delivered with quality, scalability, security, and operational readiness.
  • Lead and mentor a team of engineers, fostering technical excellence, knowledge sharing, and continuous improvement across the team.
  • Drive architecture and design decisions for event-driven integrations, canonical data models, orchestration frameworks, and platform capabilities.
  • Define and enforce engineering standards, secure-by-design principles, cloud best practices, data governance and non-functional requirements for resilience, scalability, and supportability.
  • Design, develop, and operate real-time event-driven integration services using Golang and Python.
  • Build and enhance the Service Layer platform that orchestrates Quote-to-Cash workflows across enterprise applications.
  • Design and implement canonical data models, transformation frameworks, validation rules, and integration contracts that standardize communication across multiple business systems.
  • Design and implement scalable Kafka-based event processing solutions with support for retries, idempotency, sequencing, replay, and fault recovery.
  • Design and implement large-scale ETL, migration, reconciliation, and data-quality solutions using AWS Glue, Step Functions, Snowflake, PostgreSQL, and ClickHouse.
  • Design and implement observability, monitoring, alerting, and operational dashboards to enable end-to-end workflow visibility and supportability.
  • Partner with Product Managers, Architects, Enterprise Data teams, and other cross-functional stakeholders to define technical roadmaps and execution plans.
  • Lead code reviews, design reviews, technical governance activities, and engineering best-practice adoption across the team.
  • Drive engineering standards covering software development lifecycle, CI/CD, security, observability, resiliency, and cloud-native architecture patterns.
Must Have Skills:
  • Proven experience leading and mentoring engineering teams, including task planning, technical guidance, code reviews, and delivery management.
  • Strong experience driving architecture and design decisions for large-scale distributed systems and enterprise integration platforms.
  • Strong hands-on experience in Golang and Python for building scalable backend services, event-driven integrations, orchestration workflows, and data processing solutions.
  • Strong experience designing and building cloud-native applications on AWS, including AWS Lambda, API Gateway, S3, RDS/Aurora PostgreSQL, DynamoDB, SQS, SNS, EventBridge, IAM, CloudWatch, VPC, and related serverless architecture patterns.
  • Experience managing technical delivery across multiple concurrent initiatives while balancing business priorities, technical debt, and platform evolution.
  • Strong experience designing and operating event-driven and asynchronous systems using Kafka, AWS MSK, RabbitMQ, or equivalent messaging technologies.
  • Strong understanding of distributed systems architecture, including scalability, resiliency, fault tolerance, idempotency, retry patterns, dead-letter queues, message replay, and eventual consistency.
  • Strong experience with PostgreSQL, ClickHouse, relational databases, and NoSQL databases such as DynamoDB, including data modelling, query optimization, and performance tuning.
  • Hands-on experience designing and implementing RESTful APIs, integration services, and enterprise system interfaces using secure API design principles.
  • Experience building and enforcing canonical data models, data contracts, transformation layers, and valid
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior / Lead Data Engineer – Service Layer / QTC Integration Platform
Senior / Lead Data Engineer – Service Layer / QTC Integration Platform

Talpro India Private Limited • Bengaluru

On-site
INR 2,430,000 - 2,970,000
Senior / Lead Data Engineer - Service Layer / QTC Integration
Senior / Lead Data Engineer - Service Layer / QTC Integration

Skyline Dynamics • Bengaluru

On-site
INR 3,000,000 - 8,000,000
Lead Data Engineer (Lead Software Engineer)
Lead Data Engineer (Lead Software Engineer)

DigitalXNode • Ahmedabad District

On-site
INR 1,800,000 - 2,600,000
Data Engineer - Golang
Data Engineer - Golang

Compunnel Inc. • Bengaluru

On-site
INR 3,500,000 - 6,000,000
Lead Data Engineer
Lead Data Engineer

SourcingXPress • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Lead Data Architect
Lead Data Architect

Crossing Hurdles • India

On-site
INR 10,507,880 - 15,761,820
Lead Data Engineer
Lead Data Engineer

Proclink • Pune District

On-site
INR 4,500,000 - 7,000,000
Lead Data Architect
Lead Data Architect

Intelli Search • Mumbai

On-site
INR 4,500,000 - 7,500,000
Principal Engineer - Systems
Principal Engineer - Systems

Freshworks • Hyderabad

On-site
INR 4,200,000 - 6,400,000
Lead Data Engineer
Lead Data Engineer

Stryker India Private Limited • Gurugram District

Hybrid
INR 3,000,000 - 6,000,000