Data Engineer

Avigna.AI; Pune District; On-site; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Health insurance coverage

Dynamic and collaborative work environment

Job summary

Avigna.AI in Pune is seeking a Data Engineer to design and develop data pipelines for large-scale data ingestion and analytics. Candidates should have a strong background in Python and PySpark, alongside Azure services experience.

The role involves implementing scalable architectures and collaborating with cross-functional teams to ensure efficient data solutions. Benefits include health insurance and a dynamic work environment.

Qualifications

• 6+ years of data engineering experience.
• Proficiency in cloud-native data tools.
• Experience with interactive dashboard creation.

Responsibilities

• Design and develop robust data pipelines for ingestion and analytics.
• Implement scalable Lakehouse architectures.
• Collaborate with teams to integrate data-driven components.

Skills

Python

PySpark

Microsoft Azure services

Power BI

CI/CD practices

Machine learning integration

Education

Bachelor’s or Master’s in Computer Science, Engineering, Mathematics

Tools

Microsoft Fabric

Power Platform

Azure Cosmos DB

Job description

We are excited to share an opportunity at Avigna.AI for the position of Data Engineer. We're looking for professionals with strong data engineering experience who can contribute to building scalable, intelligent data solutions and have a passion for solving complex problems.

Location: Pune, Baner (Work from Office)

Experience: 6+ years

Working Days: Monday to Friday (9:30 AM – 6:30 PM)

Education: Bachelor’s or Master’s in Computer Science, Engineering, Mathematics, or related field

Company Website: www.avigna.ai

Key Responsibilities

• Design and develop robust data pipelines for large‑scale data ingestion, transformation, and analytics.
• Implement scalable Lakehouse architectures using tools like Microsoft Fabric for structured and semi‑structured data.
• Develop custom KQL/SQL for both Structured and Unstructured queries and manage data using Power BI, Azure Cosmos DB, or similar tools.
• Work with Python, PySpark, and Azure services to support data modelling, automation, and predictive insights.
• Collaborate with cross‑functional teams to integrate data‑driven components with application backends and frontends.
• Ensure secure, efficient, and reliable CI/CD pipelines for automated deployments and data updates.

Requirements

• Strong proficiency in Python, PySpark, and cloud‑native data tools
• Experience with Microsoft Azure services (e.g., App Services, Functions, Cosmos DB, Active Directory)
• Hands‑on experience with Microsoft Fabric (preferred or good to have)
• Working knowledge of Power BI and building interactive dashboards for business insights
• Familiarity with CI/CD practices for automated deployments
• Exposure to machine learning integration into data workflows (nice to have)
• Strong analytical and problem‑solving skills with attention to detail

Good to Have

• ML tools and models
• Power Platform
• AI Coding tools
• Experience with KQL (Kusto Query Language)
• Background in simulation models or mathematical modeling
• Knowledge of Power Platform integration (Power Pages, Power Apps)
• Health insurance coverage.
• Dynamic and collaborative work environment.