Lead Data Engineer (AWS, Data Pipelines)

Principal Global Services

Hyderabad

On-site

INR 450,000 - 750,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Principal Global Services seeks a Lead Data Engineer to guide a dynamic team within the Enterprise Architecture engineering group in Hyderabad and Pune. You will design and implement data pipelines on AWS, integrate Snowflake, and drive automation, CI/CD, and Agile delivery to produce scalable data solutions.

You will mentor colleagues, collaborate with stakeholders, develop Python and TypeScript components, and create Power BI reports and dashboards.

Qualifications

  • 7–9 years of relevant experience with Tech Lead experience mandatory.
  • Bachelor’s or Master’s degree in CS, engineering or related field.
  • Strong AWS and data engineering experience.
  • Proficiency in Python and/or TypeScript, SQL.
  • Experience with CI/CD and Agile delivery.
  • Leadership and mentoring capabilities.

Responsibilities

  • Lead a small team and mentor engineers.
  • Build and maintain data pipelines on AWS and Snowflake.
  • Develop Python and/or TypeScript components.
  • Create Power BI reports and dashboards.
  • Collaborate with Enterprise Architects and stakeholders.

Skills

AWS & Data Eng
Python
TypeScript
SQL
CI/CD
Automated Testing
Agile
Leadership
Power BI

Education

Bachelor’s/Master’s in CS/Eng/Math

Tools

Snowflake

Job description

What You'll Do
Lead Data Engineer Position

Are you ready to lead a dynamic team and drive impactful data engineering solutions? At Principal, we offer an outstanding opportunity for an ambitious Lead Data Engineer to join our Enterprise Architecture engineering team. Here, you will work on groundbreaking projects, using automation, CI/CD, and Agile delivery approaches to deliver detailed results.

Key Responsibilities

As a Lead Data Engineer (AWS, Data pipelines, Python or Typescript), your responsibilities will include:

  • Support data management, LeanIX platform configurations and integrations, and application development.
  • Build, develop, and maintain data pipelines through AWS cloud offerings alongside Snowflake.
  • Maintain data using Snowflake data products.
  • Coordinate and refine database updates using SQL, Snowflake technologies, and version control techniques.
  • Apply AWS services including Lambda, S3, SNS, SQS, IAM, EventBridge, DynamoDB, KMS, and CloudWatch.
  • Quickly grasp and adjust to new AWS services and developing cloud technologies.
  • Create complex SQL queries and lead Power BI reports, dashboards, and visualizations.
  • Develop programming solutions using Python and/or TypeScript.
  • Perform automated testing, pipeline automation, and apply CI/CD tools.
  • Work within Agile methodologies to ensure efficient project delivery.
  • Exhibit leadership capabilities, leading the work for a small team.
  • Mentor team members, providing technical guidance and support.
  • Evaluate build options, making sound technical decisions and trade-offs.
  • Collaborate effectively with collaborators and Enterprise Architects.
  • Potentially handle LeanIX platform administration, maintenance, and integrations.
Required Skills and Experience

To be successful in this role, you should have:

Must Have / Primary Skills

AWS & Data Engineering

  • Strong hands-on experience in building and supporting data pipelines.
  • Strong practical experience with AWS services, particularly services used for data engineering.
  • Experience with data integration and database changes.

Programming & SQL

  • Strong programming skills in Python and/or TypeScript.
  • Strong SQL skills, including advanced query development.

Testing, CI/CD & Agile

  • Experience with automated testing.
  • Experience with Continuous Integration and Continuous Delivery (CI/CD) tools and practices.
  • Experience working in an Agile environment.

Leadership & Collaboration

  • Ability to lead, mentor, and develop team members.
  • Strong communication and collaboration skills.
  • Ability to work effectively with technical and business stakeholders.

Good to Have

Snowflake

  • Working knowledge or practical experience with Snowflake.
  • Experience working with Snowflake databases and database/schema changes would be an advantage.

Power BI

  • Experience with Power BI.
  • Experience building and supporting reports and dashboards would be an advantage.

Key Primary Skills: AWS, Data Engineering/Data Pipelines, Python and/or TypeScript, SQL, CI/CD, Automated Testing, and Agile.

Qualifications
  • 7-9 years of relevant experience (with Tech Lead experience mandatory)
  • Bachelor’s degree or Master’s degree or equivalent experience in Computer Science, Technology, Engineering, Mathematics, or a related field (B.E. / B.Tech / M.S. / M.Tech / MCA).

Location: Hyderabad & Pune

Additional Information
Why Principal?

At Principal, we believe in encouraging a collaborative and welcoming environment where everyone’s input is appreciated. We are committed to your professional development and assist our team members in reaching their personal and career ambitions. Join us and become part of a world-class team that is making an impact!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer
Principal Data Engineer

Amgen Technology • Hyderabad

On-site
INR 1,200,000 - 2,400,000
Senior Software Engineer
Senior Software Engineer

Principal Global Services • Pune

On-site
INR 1,800,000 - 2,800,000
Lead Data Engineer
Lead Data Engineer

Gardahaus • Karnataka

Hybrid
INR 2,800,000 - 3,800,000
Senior Principal Data Engineer//Chennai//Pune
Senior Principal Data Engineer//Chennai//Pune

Hiresquad Resources • Chennai

On-site
INR 3,500,000 - 5,500,000
Lead Data Engineer (Lead Software Engineer)
Lead Data Engineer (Lead Software Engineer)

DigitalXNode • Ahmedabad District

On-site
INR 1,800,000 - 2,600,000
Principal Data Engineer- Hyderabad (Hybrid)
Principal Data Engineer- Hyderabad (Hybrid)

Syneos Health, Inc. • Hyderabad

On-site
INR 1,500,000 - 2,500,000
Lead Data Architect
Lead Data Architect

Crossing Hurdles • India

On-site
INR 10,507,880 - 15,761,820
Lead Data Engineer
Lead Data Engineer

Indxx • Gurugram District

On-site
INR 3,600,000 - 5,200,000
Lead Data Engineer- AWS
Lead Data Engineer- AWS

ExlService Holdings, Inc. • Gurugram District

On-site
INR 3,800,000 - 7,000,000
Lead Data Engineer
Lead Data Engineer

Persistent Systems • Pune District

Hybrid
INR 3,000,000 - 5,000,000
Health insurance
Education sponsorship
Flexible hours
+2