Data Engineer-II (Python / AWS)

LPL Financial LLC; Hyderabad; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

LPL Financial LLC in Hyderabad is seeking an Engineer II to join our Reference Data Master team within the Data & Analytics organization.

This role is ideal for a hands-on engineer with expertise in party reference data, cloud-native data platforms, and enterprise data engineering to design, build, and maintain scalable party data solutions that support onboarding, KYC/AML, regulatory reporting, and operations.

Qualifications

• 3+ years of experience in data engineering or software development with enterprise data platforms.
• Hands-on with party or entity reference data domains and AWS data services.
• Experience building data pipelines, APIs, and event-driven architectures (Python preferred).

Responsibilities

• Design, develop, and maintain party reference data services and pipelines for clients, counterparties, issuers, and legal entities.
• Build cloud-native data solutions using AWS Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
• Migrate legacy party data systems to scalable cloud-based architectures and integrate third-party data providers.
• Implement data mastering capabilities including deduplication, survivorship rules, identity resolution, and golden record creation.
• Develop APIs and data services to downstream systems like CRM, trading, compliance, and reporting platforms.
• Ensure data quality, lineage, and monitoring; collaborate with architecture, security, and governance teams.
• Participate in Agile processes; mentor junior engineers and contribute to coding standards.

Skills

Data engineering

Python

CI/CD

Terraform

AWS

Data pipelines

API development

Tools

AWS Glue

AWS Lambda

EventBridge

S3

RDS (Aurora/Postgres)

MSK/Kinesis

Snowflake

PostgreSQL

MSSQL

Terraform

Job description

Where Ambition Meets Innovation At LPL’s Global Capability Center, you'll find a collaborative culture where your voice matters, integrity guides every decision, and technology fuels progress. Your skills, talents, and ideas will redefine what’s possible. LPL's success reflects its exceptional employees, who together pursue one noble purpose: empowering financial advisors to deliver personalized advice for all who need it. We’re proud to be expanding and reaching new heights in Hyderabad. Join us as we create something extraordinary together.

Position Overview

LPL Financial is seeking an Engineer II to join our Reference Data Master team within the Data & Analytics organization. This role is ideal for a highly skilled, hands‑on engineer with strong expertise in party reference data, cloud‑native data platforms, and enterprise data engineering. You will play a critical role in designing, building, and maintaining scalable party data solutions that support key business initiatives including client onboarding, KYC/AML, regulatory reporting, and operational efficiency.

As a developer, you will work closely with technical leads, architects, and business stakeholders while mentoring junior engineers and contributing to engineering best practices.

Key Responsibilities

• Design, develop, and maintain party reference data services and pipelines supporting clients, counterparties, issuers, and legal entities.
• Build and enhance cloud‑native data solutions using AWS services such as Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
• Contribute to modernization efforts by migrating legacy party data systems from on‑premise platforms to scalable, cloud‑based architectures.
• Integrate and manage third‑party data providers (e.g., S&P Global Markit, Dun & Bradstreet, KYC/AML vendors) to ensure accurate ingestion, enrichment, and synchronization of party data.
• Implement data mastering capabilities including deduplication, survivorship rules, identity resolution, and golden record creation.
• Develop and maintain APIs and data services to deliver party data to downstream systems such as CRM, trading, compliance, and reporting platforms.
• Ensure data quality, reliability, and lineage through validation frameworks, monitoring, and metadata management.
• Build resilient, observable systems with appropriate logging, alerting, and fault‑tolerant design patterns.
• Collaborate with architecture, security, and governance teams to ensure compliance with data privacy, regulatory, and cybersecurity standards.
• Participate actively in Agile delivery processes including backlog refinement, sprint planning, code reviews, and production support.
• Mentor junior developers and contribute to coding standards, design reviews, and engineering best practices.

Requirements

• 3+ years of experience in data engineering or software development with a focus on enterprise data platforms, including hands‑on experience working with party or entity reference data domains.
• Proficiency with AWS services including Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
• Experience with data mastering concepts such as identity resolution, source system prioritization, and golden record management.
• Experience working with relational and cloud‑native data stores, including Snowflake, Aurora, Postgres, MSSQL, or similar technologies.
• Experience building data pipelines, APIs, and event‑driven architectures (Python preferred), along with familiarity with CI/CD pipelines, infrastructure‑as‑code (Terraform preferred), and modern DevOps practices.
• Problem‑solving skills, the ability to work independently on complex technical challenges, effective communication skills, and the ability to collaborate across technical and business teams; AWS certification(s) are a plus.

Core Competencies

Understanding of party data concepts and regulatory use cases, including KYC, AML, and FATCA.

Experience designing and implementing secure, resilient, and maintainable data solutions.

Experience developing scalable data platforms and services.

Preferred Qualifications

• Experience mentoring team members and supporting technical knowledge sharing.
• Interest in evaluating and adopting new technologies and approaches to improve systems.

LPL Global Business Services, LLP – PRIVACY POLICY