Senior Data Engineer

EduRun Group; Indore; On-site; INR 900,000 - 1,500,000; Full time

Job summary

EduRun Group in Indore is seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and architectures that support our data analytics and business intelligence initiatives.

You will work closely with data scientists, analysts, and stakeholders to ensure data is accessible, reliable, and actionable, while building robust ETL/ELT processes and collaborating on cloud platforms (Azure/AWS/GCP).

Qualifications

• Proficiency in Python and PySpark for data processing.
• Strong SQL skills for querying and data manipulation.
• Experience with data warehousing concepts and data modeling in BI.

Responsibilities

• Design and implement robust data pipelines using Databricks, Snowflake, and Azure Data Factory.
• Develop ETL/ELT processes to extract, transform, and load data into data warehouses.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
• Optimize data models and queries for performance and scalability.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Stay updated with the latest trends and technologies in data engineering and analytics.

Skills

Python

PySpark

SQL

Power BI

DAX

Cloud platforms

Data warehousing

Data pipelines

Tools

Databricks

Snowflake

Azure Data Factory

Job description

We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and a passion for building scalable data solutions. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and architectures that support our data analytics and business intelligence initiatives. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and actionable.

Key Responsibilities

• Design and implement robust data pipelines using tools such as Databricks, Snowflake, and Azure Data Factory.
• Develop ETL/ELT processes to extract, transform, and load data from various sources into data warehouses.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
• Optimize data models and queries for performance and scalability.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Stay updated with the latest trends and technologies in data engineering and analytics.

Required Skills

• Proficiency in Python and PySpark for data processing and analysis.
• Strong SQL skills for querying and manipulating data.
• Experience with data visualization tools such as Power BI and DAX.
• Familiarity with cloud platforms like Azure, AWS, or GCP.
• Knowledge of data warehousing concepts and best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills to collaborate effectively with team members and stakeholders.