Data - Senior Engineer

Iris Software, Inc.

Noida

On-site

INR 1,200,000 - 2,400,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Iris Software is seeking a seasoned Data Engineer to design and deliver scalable PySpark-based data pipelines. You will shape data platforms across ingestion, transformation, and processing, leveraging Delta Lake on Databricks and Kafka to support enterprise analytics.

The role emphasizes collaboration, mentorship, and driving data quality across complex environments. Join Iris Software to contribute to cutting-edge data initiatives, work on modern Lakehouse architectures, and grow in a

Qualifications

  • Strong experience in building scalable data pipelines with PySpark and modern distributed data processing.
  • Experience with Snowflake or Delta Lake on Databricks for enterprise-scale data platforms.
  • Experience leading data engineering projects and mentoring junior engineers.

Responsibilities

  • Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
  • Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
  • Design and optimize Snowflake or Delta Lake on Databricks solutions to support enterprise-scale data platforms.
  • Lead implementation of high-performance batch and streaming data pipelines.
  • Define data streaming standards, integration frameworks, and scalable processing patterns.
  • Architect workflow orchestration solutions using Apache Airflow or Databricks Workflows.
  • Establish monitoring, scheduling, and operational controls for reliable pipeline execution.
  • Drive data quality, validation, reconciliation, and governance practices across data engineering solutions.
  • Design data engineering solutions following modern Lakehouse architecture principles, data observability practices, and platform engineering standards to improve scalability, reliability, and operational visibility.
  • Drive development of business-focused data products by improving data quality, discoverability, usability, documentation, and trusted data consumption across analytical platforms.
  • Promote responsible use of AI-assisted engineering capabilities to improve development productivity, testing, documentation, and engineering quality.
  • Review data pipeline designs and implementations to ensure adherence to engineering, scalability, and performance standards.
  • Troubleshoot complex data processing, workflow, and streaming platform issues through detailed root cause analysis.
  • Mentor team members on PySpark, Snowflake, Delta Lake, Kafka, Kinesis, Airflow, and data engineering best practices.
  • Collaborate with various teams and stakeholders to support end-to-end data platform delivery.
  • Demonstrates strong ownership while driving data engineering excellence.
  • Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
  • Promotes quality-focused engineering through proactive validation, optimization, and continuous improvement.
  • Apply strong analytical thinking to evaluate complex data engineering and platform challenges.
  • Demonstrate adaptability while managing evolving technologies, data ecosystems, and business requirements.

Skills

Python
PySpark
Databricks Workflows
Delta Lake on Databricks
Apache Kafka

Job description

Select how often (in days) to receive an alert: Create Alert

Why Join Iris?Are you ready to do the best work of your career at one ofIndia’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one offastest-growing IT services companies— whereyou own and shape your success story.

About UsAt Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with UsAt Iris, every role is more than a job — it’s a launchpad for growth.

Our Employee Value Proposition, “Build Your Future. Own Your Journey.” reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here .

Job Description

Mandatory Skills: Python, PySpark, Databricks Workflows, Delta Lake on Databricks, Apache Kafka

Key Responsibilities

  • Design scalable data engineering solutions using PySpark and modern distributed data processing frameworks.
  • Define data ingestion, transformation, and processing architectures aligned with business and analytical objectives.
  • Design and optimize Snowflake or Delta Lake on Databricks solutions to support enterprise-scale data platforms.
  • Lead implementation of high-performance batch and streaming data pipelines.
  • Design and optimize event-driven data architectures using Apache Kafka or Amazon Kinesis
  • Define data streaming standards, integration frameworks, and scalable processing patterns.
  • Architect workflow orchestration solutions using Apache Airflow or Databricks Workflows.
  • Establish monitoring, scheduling, and operational controls for reliable pipeline execution.
  • Drive data quality, validation, reconciliation, and governance practices across data engineering solutions.
  • Design data engineering solutions following modern Lakehouse architecture principles, data observability practices, and platform engineering standards to improve scalability, reliability, and operational visibility.
  • Drive development of business-focused data products by improving data quality, discoverability, usability, documentation, and trusted data consumption across analytical platforms.
  • Promote responsible use of AI-assisted engineering capabilities to improve development productivity, testing, documentation, and engineering quality.
  • Review data pipeline designs and implementations to ensure adherence to engineering, scalability, and performance standards.
  • Troubleshoot complex data processing, workflow, and streaming platform issues through detailed root cause analysis.
  • Mentor team members on PySpark, Snowflake, Delta Lake, Kafka, Kinesis, Airflow, and data engineering best practices.
  • Collaborate with various teams and stakeholders to support end-to-end data platform delivery.
  • Demonstrates strong ownership while driving data engineering excellence.
  • Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
  • Promotes quality-focused engineering through proactive validation, optimization, and continuous improvement.
  • Apply strong analytical thinking to evaluate complex data engineering and platform challenges.
  • Demonstrate adaptability while managing evolving technologies, data ecosystems, and business requirements.

Perks and Benefits for Irisians Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Iris Software, Inc. • Noida

On-site
INR 1,500,000 - 2,500,000
Data - Senior Engineer
Data - Senior Engineer

Iris Software Inc. • Noida

On-site
INR 1,200,000 - 1,800,000
AWS Data - Lead
AWS Data - Lead

Iris Software, Inc. • Dadri

On-site
INR 1,200,000 - 1,600,000
Benefits package
Data Databricks - Senior Engineer
Data Databricks - Senior Engineer

Iris Software, Inc. • Noida

On-site
INR 1,500,000 - 2,100,000
Databrick - Senior Data Engineer
Databrick - Senior Data Engineer

Iris Software, Inc. • Dadri

On-site
INR 1,200,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Iris Software Inc. • Noida

On-site
INR 1,800,000 - 2,400,000
World-class benefits
Lead Data Engineer
Lead Data Engineer

Iris Software • Dadri

On-site
INR 800,000 - 1,600,000
Java AWS - Lead
Java AWS - Lead

Iris Software, Inc. • Dadri

Remote
INR 2,400,000 - 4,200,000
Java AWS - Lead
Java AWS - Lead

Iris Software • Noida

On-site
INR 2,400,000 - 4,000,000
Java - Senior Engineer
Java - Senior Engineer

Iris Software, Inc. • Noida

On-site
INR 900,000 - 1,500,000