AWS Data Engineer

Iris Software Inc.; Dadri; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Iris Software Inc. in Noida is seeking an senior data engineer to lead enterprise data initiatives, build scalable data platforms, and drive analytics readiness. The role demands deep experience with PySpark, Snowflake, and real-time architectures.

You will collaborate with business stakeholders to translate goals into data capabilities, implement governance, and advance AI-ready data foundations across distributed teams.

Qualifications

• 8-10 years of data engineering experience.
• Experience with PySpark and modern data platforms.
• Strong governance, data quality and analytics capabilities.

Responsibilities

• Define and drive enterprise data engineering strategy aligned with objectives.
• Establish data engineering standards, governance frameworks, and best practices.
• Lead design of enterprise-scale data processing using PySpark and modern data platforms.
• Define enterprise standards for Snowflake and Delta Lake-based data platforms.
• Drive real-time and event-driven data architecture using Kafka or Kinesis.
• Establish governance standards for ingestion, transformation, streaming, and processing.
• Define workflow orchestration using Airflow or Databricks Workflows.
• Establish data quality, monitoring and operational excellence frameworks.
• Define enterprise standards for data products, metadata management and discoverability.
• Establish architecture standards for Lakehouse platforms and cloud-native ecosystems.

Skills

Python

PySpark

SQL

Apache Kafka

Snowflake

Databricks Workflows

Tools

Databricks

Apache Airflow

Snowflake

Apache Kafka

Job description

Job Description

Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions? Join Iris Software — one of the fastest-growing IT services companies— where you own and shape your success story.

About Us

At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us

At Iris, every role is more than a job — it’s a launchpad for growth.

Our Employee Value Proposition, “Build Your Future. Own Your Journey.” reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description

Experience: 8-10 Years

Location: Noida

Mandatory Skills:

Python, PySpark, SQL, Apache Kafka, Snowflake, Databricks Workflows

Key Responsibilities

• Define and drive enterprise data engineering strategy aligned with organizational objectives and data modernization initiatives.
• Establish data engineering standards, governance frameworks, and best practices across teams.
• Lead the design of enterprise-scale data processing architectures using PySpark and modern data platform technologies.
• Define enterprise standards for Snowflake and Delta Lake-based data platforms supporting analytical and operational workloads.
• Drive real-time and event-driven data architecture initiatives using Apache Kafka or Amazon Kinesis.
• Establish governance standards for data ingestion, transformation, streaming, and processing frameworks.
• Define workflow orchestration, scheduling, and operational governance standards using Apache Airflow or Databricks Workflows.
• Establish data quality, validation, monitoring, and operational excellence frameworks across data engineering ecosystems.
• Define enterprise standards for data products, data quality ownership, metadata management, discoverability, and trusted business data consumption across the organization.
• Establish architecture standards for modern Lakehouse platforms, data observability, platform engineering, and scalable cloud-native data ecosystems supporting enterprise analytics and AI initiatives.
• Define AI-ready data foundation strategies supporting structured and unstructured data processing, vector-enabled architectures, retrieval patterns, and future GenAI and Agentic AI initiatives.
• Partner with business stakeholders to translate business objectives into scalable data platform capabilities, data products, and enterprise data architecture decisions.
• Drive adoption of AI-assisted engineering practices across data engineering teams to improve developer productivity, code quality, documentation, testing, and delivery effectiveness while maintaining governance standards.
• Lead architecture reviews and ensure data solutions meet scalability, reliability, maintainability, and performance objectives.
• Guide teams on distributed data processing, streaming architectures, modern data platforms, and engineering best practices.
• Identify platform risks, scalability bottlenecks, operational gaps, and architectural challenges while defining mitigation strategies.
• Collaborate with various teams and leadership stakeholders to align data initiatives with organizational objectives.
• Drive continuous improvement initiatives focused on platform maturity, engineering excellence, scalability, reliability, and delivery effectiveness.

Behavioral Competencies

• Demonstrates leadership and accountability in driving data engineering excellence across programs and initiatives.
• Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
• Promotes a culture of innovation, quality, continuous improvement, and data engineering excellence.
• Apply strategic thinking to address platform challenges, scalability risks, and business priorities.
• Demonstrates strong decision-making while balancing performance, scalability, reliability, and delivery objectives.
• Communicates effectively regarding platform strategy, risks, dependencies, and operational outcomes.
• Maintains a proactive approach toward engineering governance, platform standards, and solution excellence.
• Encourages innovation and continuous learning within data engineering, streaming platforms, and modern data architecture.

Perks and Benefits for Irisians

Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.