Data Engineer

Principal Financial Group; Pune District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Principal Financial Group is seeking a dynamic Data Engineer to design and maintain scalable data pipelines in AWS and Snowflake, focusing on data quality and security.

You will collaborate across teams, implement BI/DW concepts, and explore AI-assisted development to accelerate delivery while adhering to governance standards. This role offers growth in a dynamic, learning-driven environment.

Qualifications

• 2-4 years of experience in data engineering with a proven track record.
• Proficiency in Python, SQL, and working with relational databases.
• Experience in building and optimizing data pipelines.
• Experience working with CI/CD pipelines in GitHub and Jenkins.
• Excellent communication and collaboration skills.

Responsibilities

• Build and sustain reliable data pipelines and architectures using AWS services and Snowflake features.
• Write readable, maintainable code following guidelines and data protection standards.
• Implement and manage BI/DW, ETL, big data, cloud, data security, SQL, and data visualization concepts.
• Develop code with established controls, policies, and recommended strategies to ensure compliance and high-quality deliverables.
• Engage in requirement analysis, testing, debugging, documentation, and quality review for data management processes.
• Leverage AI-powered engineering tools to improve efficiency and code quality while ensuring security guidelines.
• Demonstrate AI adoption and continuous learning; find opportunities to speed up delivery.
• Communicate assumptions and seek clarification to minimize rework; participate in meetings.
• Follow project processes and coding standards for high-quality outcomes.
• Involve in training and knowledge sharing for cloud initiatives.
• Solve problems with root cause analysis and analytical thinking.
• Adapt between independent work and teamwork to achieve goals.

Skills

Python

SQL

Data pipelines

CI/CD pipelines

GitHub

Jenkins

Communication

Education

Bachelor's degree

Tools

Snowflake

AWS (S3, Lambda, SNS, EC2, IAM, KMS)

Snowpipe

Stored procedures

Data sharing

Power BI

Informatica PowerCenter

Job description

Responsibilities

About the role

We are looking for a dynamic Data Engineer who is dedicated, takes ownership of their work, and is committed to developing high-quality, scalable data solutions. If you are ready for continuous learning and improvement with hands-on involvement in data engineering tasks, in a dynamic environment, we'd love to hear from you!

What You'll Do

• Build and sustain reliable data pipelines and architectures using AWS services like S3, Lambda, SNS, EC2, IAM, and KMS, along with Snowflake capabilities such as snowpipe, streams, tasks, and stored procedures.
• Ensure the flawless completion of data engineering tasks by writing readable, maintainable code that follows coding guidelines and data protection standards.
• Implement and manage BI/DW, ETL, big data, cloud, data security, SQL, and data visualization concepts to build world-class data solutions.
• Develop code with established controls, policies, and recommended strategies to ensure compliance and high-quality deliverables.
• Engage in requirement analysis, testing, debugging, documentation, and quality review to understand and build basic data management processes, models, and architectures.
• Leverage AI-powered engineering tools, including GitHub Copilot and other approved GenAI solutions, to improve efficiency, code quality, documentation, test case generation, and troubleshooting while ensuring compliance with organizational security, privacy, and responsible AI guidelines.
• Demonstrate an outlook of AI adoption and continuous learning. Proactively find opportunities to use AI-assisted development techniques to speed up delivery, automate repetitive tasks, improve data engineering workflows, and increase operational efficiency.
• Communicate assumptions, seek clarification on tasks to minimize the need for rework, and actively participate in team meetings and discussions.
• Follow established project execution processes, coding standards, and industry guidelines to ensure high-quality outcomes.
• Get actively involved in training, self-development, and knowledge sharing, contributing to organization-level cloud initiatives.
• Solve problems with analytical thinking, applying root cause analysis to determine effective solutions.
• Adapt seamlessly between working independently and collaborating with a team to achieve ambitious goals.

Qualifications

Who You Are

Education: Graduate - Bachelor's degree (any stream)

Ability:

• 2-4 years of experience in data engineering with a proven track record.
• Proficiency in Python, SQL, and working with relational databases.
• Experience in building and optimizing data pipelines.
• Experience working with CI/CD pipelines in GitHub and Jenkins.
• Excellent communication and collaboration skills.

Must-have Skills:

• Broad background in AWS offerings including S3, Lambda, SNS, EC2, IAM, and KMS.
• Skilled in CI/CD pipelines within GitHub and Snowflake functionalities such as streams, tasks, stored procedures, snowpipe, and data sharing.

Good to have Skills:

• Hands-on experience or familiarity with one or more of the following technologies: Database, Data Visualization (Power BI), Scripting, ETL (Informatica PowerCenter). Nice to have AWS Cloud certification.