Data Engineer

Auxilo Finserve; Mumbai; On-site; INR 8,00,000 - 12,00,000; Full time

Job summary

A financial services company in Mumbai is seeking a skilled Data Engineer to design and maintain data warehouse infrastructure. The ideal candidate should have a Bachelor's degree in Computer Science and 3-7+ years of relevant experience. Proficiency in SQL, Python, and data visualization tools is essential. The role involves developing ETL processes and ensuring data quality. This position offers growth opportunities in a dynamic environment.

Qualifications

• 3-7+ years of experience in data engineering or a related role.
• Proven experience with data warehousing concepts and ETL processes.
• Familiarity with data visualization tools like Power BI, Tableau.

Responsibilities

• Architect, build, and maintain scalable data warehouse solutions.
• Develop and manage ETL processes for data extraction and transformation.
• Integrate data from multiple sources, ensuring consistency and accuracy.
• Create and maintain reporting solutions using visualization tools.
• Implement data quality checks to ensure high data integrity.
• Optimize data warehouse performance through indexing and partitioning.

Skills

SQL

Data warehousing concepts

ETL processes

Python

Data visualization tools

Big data technologies (Spark/Pyspark)

AWS services

Education

Bachelor's degree in Computer Science

Tools

Power BI

Tableau

MySQL

PostgreSQL

SQL Server

Job description

Overview

We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining our data warehouse infrastructure, as well as creating robust reporting and dashboard solutions. This role requires a strong background in data engineering, ETL processes, and data visualization tools.

Responsibilities

• Design and Develop Data Warehouse: Architect, build, and maintain scalable data warehouse solutions to support business intelligence and analytics needs.
• ETL Processes: Develop and manage ETL processes to extract, transform, and load data from various sources into the data warehouse.
• Data Integration: Integrate data from multiple sources, ensuring data consistency, accuracy, and reliability.
• Reporting and Dashboards: Create and maintain reporting and dashboard solutions using tools like Power BI, Tableau, or similar.
• Data Quality: Implement data quality checks and validation processes to ensure high data integrity.
• Performance Optimization: Optimize data warehouse performance through indexing, partitioning, and query optimization.
• Collaboration: Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions.
• Documentation: Document data models, ETL processes, and data warehouse architecture.
• Security and Compliance: Ensure data security and compliance with relevant data governance policies.

Qualifications

• Education: Bachelors degree in Computer Science, Information Technology, or a related field.
• Experience:
• 3-7+ years of experience in data engineering or a related role.
• Proven experience with data warehousing concepts and ETL processes.
• Experience with SQL and database management systems (e.g., MySQL, PostgreSQL, SQL Server).
• Familiarity with data visualization tools (e.g., Power BI, Tableau).
• Skills:
• Strong programming skills in languages such as Python.
• Proficiency in SQL and database design.
• Experience with big data technologies like Spark/Pyspark
• Knowledge of AWS cloud platform and their services (Eg. Glue, Appflow, EMR)
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.

Preferred Qualifications

• Experience on Redshift or equivalent DWH tools
• Experience with Financial services domain (Bank/NBFC/Fintech)
• Knowledge of data governance and data security best practices.
• Certification in data engineering or related fields