Senior Data Engineer

Vertical Relevance; Pune District; Hybrid; INR 900,000 - 1,200,000; Full time

Job summary

Vertical Relevance is seeking an experienced Data Engineer to design, develop, and maintain scalable ETL pipelines and data visualizations. The role focuses on AWS Glue, Python, and Power BI, with hands-on work on AWS S3 data lake operations.

The ideal candidate will build robust data pipelines, implement quality checks, and collaborate with cross‑functional teams to meet business data requirements. Strong ETL expertise and a proactive mindset are essential.

Qualifications

• Strong hands‑on experience in AWS Glue ETL development.
• Proficiency in Python programming for data transformation and automation.
• Experience in creating interactive dashboards using Power BI.
• Solid understanding of data pipeline architecture.
• Experience working with AWS S3 data lake operations.
• Strong knowledge of ETL processes and best practices.

Responsibilities

• Design and implement scalable ETL pipelines using AWS Glue.
• Develop and maintain data transformation processes using Python.
• Create, optimize, and maintain dashboards and reports in Power BI.
• Build and manage scalable data pipelines and workflows.
• Implement data quality checks, validation processes, and monitoring frameworks.
• Collaborate with cross‑functional teams to understand business data requirements.

Skills

AWS Glue ETL development

Python programming

Power BI

Data pipeline architecture

AWS S3 data lake operations

ETL processes and best practices

Tools

SQL database

Big Data processing

Data modeling

ETL tools

Job description

Job Summary

We are looking for an experienced Data Engineer with strong expertise in AWS Glue, Python, and Power BI to design, develop, and maintain scalable ETL pipelines and data visualization solutions. The ideal candidate should have hands‑on experience in building robust data pipelines and working with AWS S3‑based data lakes.

Required Skills & Experience

• Strong hands‑on experience in AWS Glue ETL development
• Proficiency in Python programmingfor data transformation and automation
• Experience in creating interactive dashboards using Power BI
• Solid understanding of data pipeline architecture
• Experience working with AWS S3 data lake operations
• Strong knowledge of ETL processes and best practices

Nice to Have

• SQL database experience
• Big Data processing knowledge
• Data modeling experience
• Exposure to other ETL tools

Key Responsibilities

• Design and implement scalable ETL pipelines using AWS Glue
• Develop and maintain data transformation processes using Python
• Create, optimize, and maintain dashboards and reports in Power BI
• Build and manage scalable data pipelines and workflows
• Implement data quality checks, validation processes, and monitoring frameworks
• Collaborate with cross‑functional teams to understand business data requirements

Technical Environment

• AWS Glue
• Python
• Power BI
• AWS S3
• ETL Tools