Sr. Data Engineer

Skillventory; Mumbai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Skillventory seeks a data engineer to design and maintain end-to-end data pipelines using Azure Databricks and Azure Data services. You will build scalable ETL/ELT workflows with Python, PySpark, and SQL, integrating data from multiple sources and ensuring data quality for analytics and reporting.

You will develop data models, create dashboards in Power BI, and collaborate with stakeholders and cross-functional teams to deliver actionable insights that drive business decisions.

Qualifications

• Strong experience with Azure Databricks and distributed data processing.
• Proficiency in Python for data engineering tasks.
• Hands-on experience with Azure Data Services (ADF, ADLS, Synapse, etc.).
• Expertise in SQL and database concepts.
• Solid experience in Power BI development, data modeling, and dashboard creation , Databricks dashboard creation.
• Good understanding of data warehousing concepts (Star schema, Snowflake schema)
• Experience in handling large-scale data processing and performance tuning
• Familiarity with version control tools (e.g., Git) and CI/CD pipelines
• Strong analytical and problem-solving skills

Responsibilities

• Design, develop, and maintain end-to-end data pipelines using Azure Databricks and Azure Data services
• Build scalable and efficient ETL/ELT workflows using Python, PySpark, and SQL
• Integrate data from multiple sources (structured and unstructured) into data platforms
• Optimize data processing performance and ensure data quality, reliability, and consistency
• Develop and maintain data models to support analytics and reporting requirements
• Create and manage interactive dashboards and reports using Power BI, Azure Databricks
• Collaborate with business stakeholders to understand data requirements and deliver actionable insights
• Work closely with cross-functional teams (Data Ops, Architects, DevOps)

Skills

Azure Databricks

Python

SQL

Data Modeling

Dashboard Development

Data Warehousing Concepts

Performance Tuning

Analytical Thinking

Problem Solving

Collaboration

Tools

Azure Data Services

Power BI

Git

CI/CD

ADF

ADLS

Synapse

Job description

Key Responsibilities:

• Design, develop, and maintain end-to-end data pipelines using Azure Databricks and Azure Data services
• Build scalable and efficient ETL/ELT workflows using Python, PySpark, and SQL
• Integrate data from multiple sources (structured and unstructured) into data platforms
• Optimize data processing performance and ensure data quality, reliability, and consistency
• Develop and maintain data models to support analytics and reporting requirements
• Create and manage interactive dashboards and reports using Power BI, Azure Databricks
• Collaborate with business stakeholders to understand data requirements and deliver actionable insights
• Work closely with cross-functional teams (Data Ops, Architects, DevOps)

Key Skills:

• Strong experience with Azure Databricks and distributed data processing
• Proficiency in Python for data engineering tasks
• Hands‑on experience with Azure Data Services (ADF, ADLS, Synapse, etc.)
• Expertise in SQL and database concepts.
• Solid experience in Power BI development, data modeling, and dashboard creation , Databricks dashboard creation.
• Good understanding of data warehousing concepts (Star schema, Snowflake schema)
• Experience in handling large-scale data processing and performance tuning
• Familiarity with version control tools (e.g., Git) and CI/CD pipelines
• Strong analytical and problem-solving skills