Data - Senior Engineer

Iris Software Inc.

Noida

On-site

INR 1,200,000 - 1,800,000

Full time

8 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Iris Software in Noida, India is seeking a Senior Data Engineer to design and optimize data pipelines using PySpark, Databricks, and Kafka. You will build scalable Lakehouse solutions and collaborate with analytics teams to deliver reliable data platforms.

The role emphasizes data quality, governance, and performance, with opportunities to mentor peers and work on cutting-edge cloud data technologies across on-prem and cloud environments.

Qualifications

  • Proficient in Python and PySpark for large-scale data processing.
  • Experience with Delta Lake on Databricks and Apache Kafka.
  • Ability to design and optimize data ingestion and processing architectures.
  • Familiarity with Snowflake, Airflow, and cloud data platforms is a plus.

Responsibilities

  • Design scalable data engineering solutions using PySpark and distributed processing.
  • Define ingestion, transformation, and processing architectures aligned with analytics needs.
  • Build and optimize Snowflake or Delta Lake on Databricks data platforms.
  • Lead high-performance batch and streaming pipelines.
  • Establish data streaming standards and integration frameworks.
  • Architect workflow orchestration with Airflow or Databricks Workflows.
  • Ensure data quality, validation, and governance across pipelines.
  • Mentor team members on best practices and collaboration.

Skills

Python
PySpark
Databricks Workflows
Delta Lake on Databricks
Apache Kafka

Education

Bachelor's degree in Computer Science / IT

Tools

Airflow
Kinesis
Snowflake

Job description

Why Join Iris?

Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?
Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story.

About Us

At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us

At Iris, every role is more than a job — it’s a launchpad for growth.

Our Employee Value Proposition, “Build Your Future. Own Your Journey.” reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description
Mandatory Skills:

Python, PySpark, Databricks Workflows, Delta Lake on Databricks, Apache Kafka

Additional Skills:

Azure Databricks, Database Design & Data Modelling

Key Responsibilities
  • Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
  • Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
  • Design and optimize Snowflake or Delta Lake on Databricks solutions to support enterprise-scale data platforms.
  • Lead implementation of high-performance batch and streaming data pipelines.
  • Design and optimize event-driven data architectures using Apache Kafka or Amazon Kinesis.
  • Define data streaming standards, integration frameworks, and scalable processing patterns.
  • Architect workflow orchestration solutions using Apache Airflow or Databricks Workflows.
  • Establish monitoring, scheduling, and operational controls for reliable pipeline execution.
  • Drive data quality, validation, reconciliation, and governance practices across data engineering solutions.
  • Design data engineering solutions following modern Lakehouse architecture principles, data observability practices, and platform engineering standards to improve scalability, reliability, and operational visibility.
  • Drive development of business-focused data products by improving data quality, discoverability, usability, documentation, and trusted data consumption across analytical platforms.
  • Promote responsible use of AI-assisted engineering capabilities to improve development productivity, testing, documentation, and engineering quality.
  • Review data pipeline designs and implementations to ensure adherence to engineering, scalability, and performance standards.
  • Troubleshoot complex data processing, workflow, and streaming platform issues through detailed root cause analysis.
  • Mentor team members on PySpark, Snowflake, Delta Lake, Kafka, Kinesis, Airflow, and data engineering best practices.
  • Collaborate with various teams and stakeholders to support end-to-end data platform delivery.
Behavioral Competencies
  • Demonstrates strong ownership while driving data engineering excellence.
  • Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
  • Promotes quality-focused engineering through proactive validation, optimization, and continuous improvement.
  • Apply strong analytical thinking to evaluate complex data engineering and platform challenges.
  • Demonstrate adaptability while managing evolving technologies, data ecosystems, and business requirements.
Perks And Benefits For Irisians

Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databrick - Senior Data Engineer
Databrick - Senior Data Engineer

Iris Software, Inc. • Dadri

On-site
INR 1,200,000 - 2,400,000
AWS Data - Lead
AWS Data - Lead

Iris Software, Inc. • Dadri

On-site
INR 1,200,000 - 1,600,000
Benefits package
Senior Data Engineer
Senior Data Engineer

Iris Software, Inc. • Noida

On-site
INR 1,500,000 - 2,500,000
Data - Senior Engineer
Data - Senior Engineer

Iris Software, Inc. • Noida

On-site
INR 1,200,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Iris Software Inc. • Noida

On-site
INR 1,800,000 - 2,400,000
World-class benefits
Lead Data Engineer
Lead Data Engineer

Iris Software • Dadri

On-site
INR 800,000 - 1,600,000
Data Databricks - Senior Engineer
Data Databricks - Senior Engineer

Iris Software, Inc. • Noida

On-site
INR 1,500,000 - 2,100,000
Python FS - Senior Engineer
Python FS - Senior Engineer

Iris Software, Inc. • Dadri

On-site
INR 1,500,000 - 2,800,000
Java + Python - Lead
Java + Python - Lead

Iris Software Inc. • Dadri

On-site
INR 3,000,000 - 6,000,000
Java - Senior Engineer
Java - Senior Engineer

Iris Software Inc. • Noida

On-site
INR 1,200,000 - 2,400,000