Senior Data Engineer

Iris Software Inc.; Dadri; On-site; INR 400,000 - 750,000; Full time

Benefits offered by this job

World-class benefits

Job summary

Iris Software is seeking an experienced AI Data Engineer in India to design and optimize data pipelines powering AI/ML solutions. You will collect, process, and curate data from diverse sources, working with data scientists and ML engineers to ensure data readiness and governance.

The role focuses on scalable, compliant data for analytics and automation, with exposure to real-time streaming and advanced feature engineering. Join Iris to shape impactful AI initiatives.

Qualifications

• Proficient in Python and advanced SQL.
• Experience with Spark and distributed processing.
• Familiar with AWS cloud platforms.
• Proficient in Airflow for orchestration.
• Experience in data pipeline automation and governance.
• Knowledge of data quality and privacy standards.

Responsibilities

• Design and implement scalable data pipelines for AI/ML model work.
• Clean, transform and curate structured and unstructured data.
• Collaborate with data scientists, ML engineers, and business teams on AI objectives.
• Maintain metadata, data lineage, and data quality frameworks.
• Enable real-time data streaming for AI applications.
• Ensure data compliance and privacy across all workflows.
• Support enterprise data initiatives including glossary and taxonomy.

Skills

Python

Advanced SQL

Spark

AWS

Airflow

Data pipeline automation

Data governance

Data quality

Tools

Kafka

Kinesis

Feature stores

LLM-ready data pipelines

MLOps exposure

Job description

Job Description:

Why Join Iris? Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions? Join Iris Software - one of fastest-growing IT services companies - where you own and shape your success story.

About Us

At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us

At Iris, every role is more than a job - it's a launchpad for growth.

Our Employee Value Proposition, Build Your Future. Own Your Journey. reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best - both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description

POSITION SUMMARY : We are seeking an experienced AI Data Engineer to build and optimizedata pipelines that power AI/ML solutions across ETS. This role contributes to data collection efforts through the design and deployment of data instruments, oversees aggregation and cleaning processes, and collaborates with data scientists and ML engineers to interpret and implement findings. The position is critical to preparing high-quality, scalable, and compliant data for advanced analytics, automation, and machine learning use cases while supporting data visualization and trend analysis efforts.

PRIMARY RESPONSIBILITIES

• Design and implement robust, scalable data pipelines to support AI/ML model development and deployment
• Clean, transform, and curate structured and unstructured data from diverse sources to ensure model-ready quality
• Collaborate with data scientists, ML engineers, and business teams to ensure data readiness, usability, and alignment with AI objectives
• Develop andmaintainmetadata management, data lineage, and data quality frameworks to support AI governance and compliance
• Enable advanced feature engineering capabilities and implement real-time data streaming solutions for AI applications
• Design and deploy data collection instruments and oversee data aggregation processes
• Ensure data compliance, privacy, and ethical use standards across all AI workflows
• Support enterprise-wide data initiatives including business glossary development, taxonomy creation, and the DARE programs automation goals

Must Have -

• Python & advanced SQL
• Spark / distributed processing
• Cloud platforms (AWS)
• Airflow / orchestration tools
• Data pipeline automation
• Data governance & quality

Nice to have -

• Kafka/Kinesis streaming
• Feature stores
• LLM-ready data pipelines
• MLOps exposure

Mandatory Competencies

Perks and Benefits for Irisians

Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.

Requirements: