Sr Engineer, Data Warehousing & Automation Engineering

LPL Financial Global Capability Center; Hyderabad; Hybrid; INR 4,000,000 - 6,000,000; Full time

Job summary

LPL Financial Global Capability Center in Hyderabad seeks an experienced Sr Engineer to lead data warehousing and automation engineering. You will guide a team of data engineers and analysts to deliver scalable data warehousing solutions, ensuring governance, quality, and cost efficiency across the stack.

You will partner with cross-functional teams to align data strategies with business objectives and drive rapid prototyping and continuous improvement in our data platform.

Qualifications

• 10+ years of experience in on‑prem and cloud data warehousing and data marts, with 5+ years leading Snowflake warehousing teams.
• Bachelor’s degree in Data Science, Computer Science or related field; Master’s preferred.
• Hands-on experience with cloud data lake architectures (AWS S3, Glue, Lake Formation, Snowflake) and data governance/cataloging tools.

Responsibilities

• Lead the data warehousing strategy and drive data-driven decision-making across the org.
• Oversee integration of data products in Snowflake and dbt; ensure data quality and accessibility.
• Design, implement, and optimize data replication and transformation pipelines; manage HVr equivalents.
• Develop data quality checks, monitoring, and governance practices.
• Optimize Snowflake data warehouse, data marts and related applications for performance and cost.
• Implement security and governance standards; manage metadata and data catalogs.
• Collaborate with IT, marketing and customer service to align warehousing initiatives with business goals.
• Mentor a high‑performing team of data engineers and analysts; promote continuous learning.

Skills

Snowflake

Python

SQL

Data modeling

Data governance

Airflow

dbt

Terraform

Leadership

Big data

Education

Bachelor's degree in Data Science or Computer Science

Master's degree preferred

Tools

Snowflake

Airflow

dbt

Terraform

CloudFormation

GitHub Actions

Prometheus

Dynatrace

Collibra

Atlan

Job description

Where Ambition Meets Innovation At LPL's Global Capability Center, you'll find a collaborative culture where your voice matters, integrity guides every decision, and technology fuels progress. Your skills, talents, and ideas will redefine what's possible. LPL's success reflects its exceptional employees, who together pursue one noble purpose: empowering financial advisors to deliver personalized advice for all who need it. We’re proud to be expanding and reaching new heights in Hyderabad.

Join us as we create something extraordinary together.

Job Overview

As Sr Engineer in Data Warehousing & Automation Engineering, you will lead engineering excellence in a team of data professionals that delivers data warehousing initiatives across LPL Financial. This role is pivotal in leveraging data as a strategic asset to enhance decision-making, drive innovation, and ensure data quality and governance.

Responsibilities

• Partner with existing teams to further develop and implement the data warehousing strategy, ensuring alignment with business objectives and driving data-driven decision-making across the organization
• Oversee the integration of data products in Snowflake and dbt, ensuring seamless data flow, quality and accessibility
• Design and develop data replication and transformation pipelines leveraging solutions such as HVR. Configure and manage HVr instances for optimal performance and scalability
• Develop, automate and implement data quality checks and monitoring procedures
• Manage and optimize Snowflake data warehouse, data mart and application-based solutions to ensure high performance, scalability, and reliability
• Implement cost management strategies to optimize data warehousing expenses while maintaining high service levels
• Ensure data security, compliance, and governance are integrated into all data warehousing processes to meet regulatory and organizational standards
• Establish and maintain robust metadata management practices to ensure data quality and accessibility
• Work closely with cross-functional teams, including IT, marketing, and customer service, to ensure data warehousing initiatives support business goals
• Emphasize rapid prototyping and continuous process improvement to enhance data warehousing capabilities and drive innovation
• Mentor and develop a high-performing team of data engineers and analysts, fostering a culture of excellence and continuous learning
• Stay up to date on the latest advancements in industry and technology solutions, bringing insights to the team for continuous development of our stack, solutions and ways of working

What are we looking for?

We're looking for strong collaborators who deliver exceptional client experiences and thrive in fast-paced, team-oriented environments. Our ideal candidates pursue greatness, act with integrity, and are driven to help our clients succeed. We value those who embrace creativity, continuous improvement, and contribute to a culture where we win together and create and share joy in our work.

Requirements

• 10+ years of experience in both on-prem and cloud-based data warehousing and data marts, with at least 5 years focused on leadership of Snowflake warehousing team(s).
• Bachelor's degree in Data Science, Computer science or related field; Master's degree preferred.
• Demonstrable hands-on experience with:
• Cloud data lake architectures: AWS S3, Glue, Lake Formation, Snowflake, or similar
• Data lake design patterns: raw, curated, consumption zones; medallion architecture
• Data versioning and schema evolution: e.g., Delta Lake, Apache Iceberg
• Data governance and cataloging: including any of the following (preferred experience in multiple tools) Unity Catalog, Collibra, Atlan, AWS Glue Data Catalog
• Programming: Python and/or SQL (production code, reusable libraries, tests)
• Pipeline orchestration: Airflow, Step Functions, dbt, or similar
• DevOps for data: Terraform/CloudFormation, CI/CD, monitoring, and runbook creation
• Strong understanding of data modeling, data quality, and secure data onboarding/governance
• Experience with both batch and real-time data processing

Preferences

• AWS (S3, Glue, Lake Formation, IAM), Snowflake
• SQL, Python
• dbt, Airflow, Step Functions
• Terraform/CloudFormation, CI/CD (GitHub Actions, Jenkins)
• Observability (Dynatrace preferred, Datadog, Prometheus)
• Data governance & security (Unity Catalog, Collibra, Atlan)

Core Competencies

• Excellent communication and stakeholder management skills
• Experience with Spark, Snowflake or other big data frameworks
• AWS and/or Snowflake architect or developer certifications
• Demonstrated use of AI/ML tools to augment engineering productivity (prompting for code generation, LLMs for docs/tests, query optimization)
• Experience with knowledge graphs and semantic data modeling
• LLM/AI augmentation tooling

LPL Global Business Services, LLP - PRIVACY POLICY