Lead Data Engineer (Python,Power BI,AWS,Data Pipeline)

Principal Financial Group; Hyderabad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Principal Financial Group is seeking a Lead Data Engineer to drive data engineering initiatives within the Enterprise Architecture team in Hyderabad. You will own data pipelines, develop in Python or TypeScript, and deliver BI dashboards using Power BI on AWS and Snowflake.

The role requires 7–9 years of experience, strong SQL skills, and leadership capabilities to mentor a small team in an Agile setup. You will collaborate with Enterprise Architects and support LeanIX configurations as needed.

Qualifications

• Experience in building data pipelines, Python or TypeScript, PowerBI and AWS is mandatory.
• Practical experience with AWS services or Snowflake.
• Skilled in Snowflake, SQL, and handling database changes.
• Advanced SQL query development skills.
• Experience building and supporting Power BI reports and dashboards.
• Proficiency in programming with Python and/or TypeScript.
• Experience with automated testing, CI/CD tools, and Agile methodologies.
• Demonstrated ability to lead, mentor, and develop a team.
• Excellent collaboration and communication skills.

Responsibilities

• Lead data engineering efforts for enterprise scale data pipelines and solutions.
• Architect and implement pipelines using AWS and Snowflake.
• Develop and maintain Snowflake data products and SQL transformations.
• Create and optimize Power BI reports, dashboards, and visualizations.
• Mentor junior team members and guide architectural decisions.
• Apply CI/CD practices and automated testing to data pipelines.
• Collaborate with Enterprise Architects and cross-functional teams.
• Drive Agile delivery and ensure timely project outcomes.

Skills

Data pipelines

Python

TypeScript

Power BI

AWS

Leadership

Mentoring

CI/CD

SQL

Agile

Education

Bachelor’s degree in CS/Engineering

Master’s degree in related field

Tools

AWS

Snowflake

Power BI

SQL

Python

TypeScript

Job description

Additional Information

Why Principal?

At Principal, we believe in encouraging a collaborative and welcoming environment where everyone's input is appreciated. We are committed to your professional development and assist our team members in reaching their personal and career ambitions. Join us and become part of a world-class team that is making an impact!

Responsibilities

Lead Data Engineer Position

Are you ready to lead a dynamic team and drive impactful data engineering solutions? At Principal, we offer an outstanding opportunity for an ambitious Lead Data Engineer to join our Enterprise Architecture engineering team. Here, you will work on groundbreaking projects, using automation, CI/CD, and Agile delivery approaches to deliver detailed results.

Key Responsibilities

As a Lead Data Engineer (data pipelines, Python or Typescript, PowerBI and AWS), your responsibilities will include:

• Support data management, LeanIX platform configurations and integrations, and application development.
• Build, develop, and maintain data pipelines through AWS cloud offerings alongside Snowflake.
• Maintain data using Snowflake data products.
• Coordinate and refine database updates using SQL, Snowflake technologies, and version control techniques.
• Apply AWS services including Lambda, S3, SNS, SQS, IAM, EventBridge, DynamoDB, KMS, and CloudWatch.
• Quickly grasp and adjust to new AWS services and developing cloud technologies.
• Create complex SQL queries and lead Power BI reports, dashboards, and visualizations.
• Develop programming solutions using Python and/or TypeScript.
• Perform automated testing, pipeline automation, and apply CI/CD tools.
• Work within Agile methodologies to ensure efficient project delivery.
• Exhibit leadership capabilities, leading the work for a small team.
• Mentor team members, providing technical guidance and support.
• Evaluate build options, making sound technical decisions and trade-offs.
• Collaborate effectively with collaborators and Enterprise Architects.
• Potentially handle LeanIX platform administration, maintenance, and integrations.

Required Skills and Experience

To be successful in this role, you should have:

• Experience in building data pipelines, Python or Typescript, PowerBI and AWS is mandatory
• Practical experience working with AWS services or Snowflake.
• Skilled in Snowflake, SQL, and handling database changes.
• Advanced SQL query development skills.
• Experience building and supporting Power BI reports and dashboards.
• Proficiency in programming with Python and/or TypeScript.
• Experience with automated testing, continuous integration and delivery tools, and Agile methodologies.
• Demonstrated ability to lead, mentor, and develop a team.
• Excellent collaboration and communication skills.

Qualifications

• 7-9 years of relevant experience.
• Bachelor’s degree or Master’s degree or equivalent experience in Computer Science, Technology, Engineering, Mathematics, or a related field (B.E. / B.Tech / M.S. / M.Tech / MCA).