Lead Data Engineer

Iris Software Inc.; Dadri; On-site; INR 1,500,000 - 2,100,000; Full time

Benefits offered by this job

Benefits program

Job summary

Iris Software is seeking a Senior Data Engineer to build scalable data pipelines using PySpark and Spark-based frameworks, with a focus on real-time streaming and analytics. You will shape ingestion, transformation, and processing architectures to meet business objectives.

Join Iris Software to work on modern data platforms across enterprise-scale applications, leveraging AWS services, Databricks, and data governance practices to drive impactful insights.

Qualifications

• Proven experience building data pipelines with PySpark and Spark-based frameworks.
• Strong SQL skills and data modeling for analytics and BI.
• Experience with AWS data services and real-time streaming platforms.

Responsibilities

• Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
• Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.

Skills

Python

Apache Spark

Data Quality & Validation

PySpark

SQL

Amazon Kinesis

Apache Kafka

Databricks Workflows

Delta Lake on Databricks

Tools

AWS S3

Amazon Aurora

DynamoDB

AWS Glue

AWS Redshift

Data Governance

GitHub

Job description

Job Description:

Why Join Iris?

Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?
Join Iris Software — one of the fastest-growing IT services companies— where you own and shape your success story.

About Us

At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us

At Iris, every role is more than a job — it’s a launchpad for growth.

Our Employee Value Proposition, “Build Your Future. Own Your Journey.” reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description

Mandatory Skills:

Python, Apache Spark, Data Quality & Validation, PySpark, SQL, Amazon Kinesis, Apache Kafka, Databricks Workflows, Delta Lake on Databricks

Additional Skills:

AWS S3 + Amazon Aurora + DynamoDB, AWS Glue, AWS Redshift, Data Governance Frameworks, GitHub

Key Responsibilities

• Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
• Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.

Behavioral Competencies

• Demonstrates strong ownership while driving data engineering excellence.
• Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.

Perks and Benefits for Irisians

Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.