Principal Data Engineer

InfoVision Inc.; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

InfoVision Inc. is seeking a Principal Data Engineer with 10-15 years of hands-on experience to design, build, and optimize large-scale data pipelines and enterprise data platforms.

The role is based in Pune and requires deep Azure expertise to architect end-to-end solutions supporting analytics workloads. You will lead cross-functional teams, drive data engineering best practices, and mentor engineers in Agile delivery.

Qualifications

• 10–15 years of hands-on data engineering experience.
• Expertise in Azure data services and end-to-end data platform design.
• Strong SQL and ETL development skills.
• Experience integrating data from REST APIs and ensuring data quality.
• Experience with Power BI and semantic modeling is advantageous.
• Proven leadership in Agile delivery and mentoring teams.

Responsibilities

• Lead the data engineering team and set architectural direction.
• Design and optimize large-scale data pipelines and platforms.
• Review designs, run design reviews, and establish data engineering best practices.
• Mentor junior and mid-level engineers and drive sprint planning with stakeholders.
• Collaborate with analytics and BI teams to support business intelligence needs.

Skills

Leadership

Agile delivery

SQL

ETL development

REST APIs data ingestion

Data quality

Cross-functional leadership

Mentoring

Data pipeline design

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Data Lake Storage

Power BI

Claude AI

MySQL

Oracle

MSSQL

PostgreSQL

Job description

• We are seeking a Principal Data Engineer with 10-15 years of hands-on experience in designing, building, and optimizing large-scale data pipelines and enterprise data platforms, preferably within a fast-paced technology environment based in Pune.
• The ideal candidate will have deep expertise in Azure cloud services including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage, with the ability to architect end-to-end data solutions that support business-critical analytics workloads.
• Strong proficiency in SQL and ETL development is essential, including designing complex transformation logic, optimizing query performance, and managing data quality across structured and semi-structured datasets.
• Experience integrating data from diverse sources using REST APIs is required, including building robust ingestion frameworks that handle authentication, pagination, rate limiting, and error recovery at scale.
• Hands-on experience with Power BI for building enterprise-grade dashboards and semantic models, combined with familiarity leveraging Claude AI capabilities for intelligent data processing or conversational analytics use cases, is highly desirable.
• Proficiency in RDBMS technologies including MySQL, Oracle, MSSQL, and PostgreSQL is expected, with the ability to design normalized schemas, manage stored procedures, and tune database performance for high-volume transactional and analytical workloads.
• The role demands strong leadership capabilities to guide cross-functional engineering teams, conduct design reviews, establish data engineering best practices, and mentor junior and mid-level engineers across the data platform team.
• Candidates must demonstrate experience working in Agile delivery environments, contributing to sprint planning, technical roadmaps, and stakeholder discussions to align data infrastructure with evolving product and business intelligence needs.