Senior Data Engineer

Straive; Mumbai; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Straive in Mumbai seeks a senior Data Engineer to design and maintain data pipelines, data marts, and data models for the inhouse data warehouse. You will work with stakeholders to deliver BI and advanced analytics datasets and ensure data quality.

The role requires 7+ years in data engineering, strong Java/Python skills, and certification in AWS and Snowflake. Expect a hands-on position with cloud-based data platforms and data governance practices in a fast-paced environment.

Qualifications

• Bachelor’s or master’s degree in Computer Science, Information Technology, Engineering or related quantitative discipline from a top tier university.
• Certified in AWS Data Engineer Specialty or AWS Solution Architect Associate.
• Snowflake SnowPro Core Certification.
• 7+ years of experience in data engineering or relevant working experience in a similar role, preferably in the financial industry.
• Strong understanding or practical experience of at least one common Enterprise Agile Framework e.g., Kanban, SAFe, SCRUM, etc.
• Strong understanding of ETL, data warehouse and BI(Qlik) and Advanced Data Analytics concepts.
• Deep knowledge of cloud-enabled technologies – AWS RDS and AWS Fargate, etc.
• Experience with databases and data warehouses - Snowflake, PostgreSQL, MS SQL.
• Strong programming skills with advanced knowledge of Java and/or Python.
• Practical experience with ETL tools such as AWS Glue, etc.
• Strong critical-thinking, analytical and problem-solving skills
• Excellent communicator with team-oriented approach.

Responsibilities

• Analyse relevant internally and externally sourced data to generate BI and Advanced Analytics datasets.
• Design data pipelines to curate sourced data into the inhouse data warehouse.
• Create data marts to facilitate dataset consumption by business and IT stakeholders.
• Design data model changes that align with inhouse data warehouse standards.
• Migrate data from existing databases to the inhouse data warehouse and perform regular housekeeping.
• Build and maintain data pipelines and data platforms.
• Develop analytical tooling to support BI and Advanced Data Analytics activities.
• Promote and champion data engineering standards and best practices.

Skills

Data engineering

SQL

Python

ETL

Data warehousing

Big data tooling

Education

Bachelors/Masters in CS/IT/Engineering

Tools

AWS Data Engineer Specialty

AWS Solution Architect Associate

Snowflake SnowPro Core

Snowflake

PostgreSQL

MS SQL

AWS Glue

Qlik

Job description

• Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced
• Analytics datasets based on your stakeholders’ requirements
• Design data pipelines to curate sourced data into the inhouse data warehouse
• Design data marts to facilitate dataset consumption out of the inhouse data warehouse by business and IT internal stakeholders
• Design data model changes that align with the inhouse data warehouse standards
• Define migration execution activities to move data from existing database solutions to the inhouse data warehouse Engineer
• Regular housekeeping of raw data and data stored in the inhouse data warehouse
• Build and maintenance of data pipelines and data platforms
• Build data solution prototypes
• Explore ways to enhance data quality and reliability
• Identify and realize opportunities to acquire better data (raw data)
• Develop analytical tooling to better support BI and Advanced Data Analytics activities
• Execute data migration from existing databases to the inhouse data warehouse
• Promote and champion data engineering standards and best-in-class methodology

Required Skills:

• Bachelor’s or master’s degree in Computer Science, Information Technology, Engineering or related quantitative discipline from a top tier university.
• Certified in AWS Data Engineer Specialty or AWS Solution Architect Associate
• Snowflake SnowPro Core Certification
• 7+ years of experience in data engineering or relevant working experience in a similar role, preferably in the financial industry
• Strong understanding or practical experience of at least one common Enterprise Agile Framework e.g., Kanban, SAFe, SCRUM, etc.
• Strong understanding of ETL, data warehouse and BI(Qlik) and Advanced Data Analytics concepts
• Deep knowledge of cloud-enabled technologies – AWS RDS and AWS Fargate, etc.
• Experience with databases and data warehouses - Snowflake, PostgreSQL, MS SQL
• Strong programming skills with advanced knowledge of Java and/or Python
• Practical experience with ETL tools such as AWS Glue, etc.
• Strong critical-thinking, analytical and problem-solving skills
• Excellent communicator with team-oriented approach.