Senior Associate, Data Engineer

MassMutual India; Hyderabad; On-site; INR 900,000 - 1,800,000; Full time

Job summary

MassMutual India is seeking a data engineer to design, build, and optimize ELT pipelines across disparate data sources, ensuring high integrity and scalable data assets. You will collaborate with tech leads and engineers to deliver enterprise data solutions, including data strategy and onboarding new data sources.

The role requires 3–5 years in data warehousing/BI, strong SQL, Python, Airflow, and AWS knowledge.

Qualifications

• 3-5 years of experience in Data Warehousing and Business Intelligence roles.
• Proficiency in Airflow Orchestration Pipelines, relational database design, data modelling, and data warehousing principles.
• Excellent programming skills in SQL, Python.
• Proficient in Shell scripting and building spark jobs.
• Knowledge on AWS services like S3, Lambda, EMR, CloudWatch, Step Functions.
• Knowledge of cloud services, relational database design principles, data warehousing, performance tuning, and optimization techniques.
• Experience in performance analysis and tuning to ensure optimal database performance
• Ability to analyze the business requirements
• Excellent communication skills with the ability to collaborate effectively with technical teams and business stakeholders to gather and refine requirements.
• Delivery-focused with a can-do attitude in challenging environments.

Responsibilities

• Design, build, and measure ELT jobs to process disparate data sources and form a high integrity, high quality data asset.
• Work with tech lead and senior engineers to implement enterprise data solutions including data strategy and BAU support.
• Collaborate with business analysts to translate requirements into technical stories and tasks.
• Create and maintain data pipelines, integrations, and transformations for scalable data processing and storage.
• Perform data profiling, validation, and cleansing to maintain data integrity.
• Review code with team members to ensure performance and reliability.
• Automate manual processes and optimize pipelines for efficiency and scalability.
• Analyze requirements and follow best practices to streamline operations.

Skills

SQL

Python

Shell scripting

Spark

Airflow

Data modelling

Data warehousing

BI concepts

Tools

Airflow

Spark

AWS

S3

Lambda

EMR

CloudWatch

Step Functions

Job description

• Design, build, and measure ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
• Work closely with tech lead and senior engineers to implement and deliver enterprise data solutions including data strategy, feasibility and longevity of solutions, hands-on solution implementation and BAU support.
• Involve in stakeholders conversations to define multi-market data requirements and implement data and BI solutions
• Create and maintain data pipelines, integrations, and transformations to ensure efficient data processing, storage, and retrieval. Ensure data infrastructure is scalable, efficient, and aligned with best practices in data management
• Extract, organize, and manage data to ensure accessibility for authorized users across the organization
• Perform data profiling, validation, and cleansing to maintain data integrity and accuracy.
• Perform unit test and conduct reviews with other team members to ensure code is rigorously designed, elegantly coded, and effectively tuned for performance.
• Implement internal process improvements with coordination, automate manual processes, debug inefficient pipelines for optimal performance and scalability.
• Understand and follow the best practices and proactively seek opportunities to automate and construct tools that streamline operations and enhance overall reliability.
• Collaborate with business analysts to understand requirements and use cases, translating them into technical stories and tasks.
• 3-5 years of experience in Data Warehousing and Business Intelligence roles..
• Proficiency in Airflow Orchestration Pipelines, relational database design, data modelling, and data warehousing principles.
• Excellent programming skills in SQL, Python etc.
• Proficient in Shell scripting and building spark jobs.
• Knowledge on AWS services like S3, lambda, EMR, Cloud watch, Step functions.
• Knowledge of cloud services, relational database design principles, data warehousing, performance tuning, and optimization techniques.
• Experience in performance analysis and tuning to ensure optimal database performance
• Ability to analyze the business requirements
• Excellent communication skills with the ability to collaborate effectively with technical teams and business stakeholders to gather and refine requirements.
• Delivery-focused with a can-do attitude in challenging environments.