Senior Data Engineer

Empower; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Empower in Bengaluru is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure on AWS. You will translate data requirements into reliable solutions, collaborate across teams, and mentor junior engineers to elevate data engineering practices.

You should have 4–6 years of data engineering experience, Python and PySpark expertise, and hands-on AWS with big data tools like Hadoop and Spark.

Qualifications

• Bachelor's degree in Computer Science or related field.
• 4–6 years of data engineering experience.
• Proficiency in Python and PySpark for ETL development.
• Experience with big data technologies such as Hadoop and Spark.
• Strong SQL skills and experience with RDBMS like PostgreSQL, Redshift, or MySQL.
• Hands-on AWS experience (DynamoDB, EMR Serverless, Lambda).
• Deep understanding of data modeling, ETL, and data warehousing concepts.
• Experience with Agile methodologies and Scrum processes.
• Excellent communication and ability to explain technical concepts to non-technical stakeholders.
• Strong problem-solving and leadership capabilities.

Responsibilities

• Design, develop, and maintain scalable data ingestion and processing frameworks.
• Collaborate with cross-functional teams to translate data requirements into technical solutions.
• Optimize data ingestion for performance, scalability, and reliability.
• Implement data governance and security best practices.
• Troubleshoot data integrity, performance, and application issues.
• Participate in code reviews and uphold coding standards.
• Mentor junior engineers and provide technical guidance on complex projects.
• Contribute to architecture and design discussions for data platforms.
• Assist in strategic initiatives to improve data reliability and automation.
• Evaluate emerging data engineering technologies and apply best-fit solutions.

Skills

Python

PySpark

ETL

AWS

SQL

Big data

Data modeling

Data warehousing

Agile

Leadership

Education

Bachelor's degree in Computer Science, Information Systems, Mathematics, Software Engineering, or related field

Tools

AWS

Hadoop

Spark

Redshift

PostgreSQL

MySQL

DynamoDB

EMR Serverless

Lambda

QuickSight

Job description

Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteering for causes that matter most to them.

Chart your own path and grow your career while helping more customers achieve financial freedom. Empower Yourself.

Senior Data Engineer

The Senior Data Engineer designs, develops, and maintains scalable data infrastructure and data ingestion frameworks that support data-driven reporting across Empower and for external partners. This role collaborates with cross-functional teams, business stakeholders, architects, analysts, and testers to translate data requirements into reliable technical solutions on Amazon Web Services (AWS). The role requires strong experience with Python, SQL, ETL development, AWS cloud technologies, and big data solutions, along with the ability to provide technical guidance to junior engineers.

What You Will Do

• Design, develop, and maintain scalable data and file ingestion frameworks.
• Collaborate with cross-functional value stream teams, analysts, architects, testers, and business stakeholders to understand and refine data requirements and translate them into technical solutions.
• Optimize data ingestion frameworks for performance, scalability, and reliability.
• Implement data governance and data security best practices.
• Troubleshoot data integrity, application, and performance issues.
• Participate in code reviews and promote adherence to coding standards and engineering best practices.
• Mentor junior engineers and provide technical guidance on complex projects.
• Contribute to architecture decisions and technical design discussions.
• Advise on strategic initiatives that mitigate core data application issues and identify opportunities for process automation.
• Evaluate emerging data engineering technologies and apply appropriate solutions to improve data frameworks and engineering practices.
• Collaborate with engineering colleagues to develop and maintain data engineering best practices.
• Complete other duties as assigned.

What You Will Bring

• Bachelor's degree in Computer Science, Information Systems, Mathematics, Software Engineering, or a related field, or an equivalent combination of training and experience.
• 4-6 years of data engineering experience, including experience designing and implementing scalable data ingestion frameworks.
• Proficiency in ETL development and design using Python and PySpark.
• Experience with big data technologies, including Apache Hadoop and Apache Spark.
• Strong SQL skills and experience with relational database management systems (RDBMS), such as PostgreSQL, Amazon Redshift, or MySQL.
• Hands‑on experience with Amazon Web Services (AWS), including technologies such as Amazon DynamoDB, Amazon EMR Serverless, and AWS Lambda.
• Deep understanding of data modeling, ETL processes, data ingestion, and data warehousing concepts.
• Experience working with Agile methodologies and Scrum processes.
• Strong written and verbal communication skills, including the ability to explain complex technical concepts to non-technical stakeholders.
• Strong problem-solving and troubleshooting skills, with the ability to work independently and provide technical leadership to junior engineers.
• Ability to communicate professionally with customers and colleagues and effectively explain highly technical functionality to users.

What Will Set You Apart

• 3+ years of experience in financial services or another highly regulated industry.
• Experience using Jira in an Agile software development environment.
• Knowledge of DevOps practices and continuous integration/continuous delivery (CI/CD).
• Experience with Amazon QuickSight.
• Demonstrated customer focus, including listening skills, empathy, proactive problem-solving, perseverance, and the ability to balance customer needs with organizational priorities.

We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age, race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.