Databricks - Engineer

Iris Software, Inc.; Dadri; Presencial; INR 900.000 - 1.500.000; Jornada completa

Descripción de la vacante

Iris Software, Inc. is seeking a data engineering professional to design and maintain scalable data pipelines using PySpark, Kafka, and Databricks.

You will build and optimize data ingestion, transformation, and processing workflows for analytics and operations while leveraging Snowflake or Delta Lake on Databricks for enterprise platforms. You'll implement batch and real-time data processing patterns, enable event-driven integrations with Kafka or Kinesis, and manage orchestration with Airflow

Formación

• Proficiency in PySpark, Apache Kafka, Databricks Workflows, Delta Lake on Databricks, and Snowflake.
• Experience building scalable data pipelines and data processing solutions.
• Knowledge of data quality, governance, and orchestration tools like Airflow.

Responsabilidades

• Develop and maintain scalable data pipelines and data processing solutions using PySpark.
• Design and implement data ingestion, transformation, and processing workflows for analytics and operations.
• Build data solutions with Snowflake or Delta Lake on Databricks for enterprise platforms.
• Develop batch and near real-time data processing pipelines with modern data engineering practices.
• Implement event-driven data integration using Apache Kafka or Amazon Kinesis.
• Configure and maintain workflow orchestration using Airflow or Databricks Workflows.
• Monitor and support scheduled data processing jobs for reliability.

Conocimientos

PySpark

Apache Kafka

Databricks Workflows

Delta Lake on Databricks

Snowflake

Herramientas

Apache Airflow

Amazon Kinesis

Descripción del empleo

Select how often (in days) to receive an alert: Create Alert

Why Join Iris?
Are you ready to do the best work of your career at one ofIndia’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?
Join Iris Software - one offastest-growing IT services companies - whereyou own and shape your success story.

About Us
At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.

With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us
At Iris, every role is more than a job - it’s a launchpad for growth.

Our Employee Value Proposition, "Build Your Future. Own Your Journey."reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.

We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best - both personally and professionally.

Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here .

Job Description

Mandatory Skills: PySpark, Apache Kafka, Databricks Workflows, Delta Lake on Databricks, Snowflake

Key Responsibilities

• Develop and maintain scalable data pipelines and data processing solutions using PySpark.
• Design and implement data ingestion, transformation, and processing workflows to support analytical and operational data requirements.
• Build and maintain data solutions using Snowflake or Delta Lake on Databricks to support enterprise data platforms.
• Develop batch and near real-time data processing pipelines leveraging modern data engineering practices.
• Implement event-driven data integration solutions using Apache Kafka or Amazon Kinesis.
• Develop data streaming workflows to support reliable and scalable data movement across systems.
• Configure and maintain workflow orchestration solutions using Apache Airflow or Databricks Workflows.
• Monitor and support scheduled data processing jobs to ensure successful execution and operational stability.
• Perform data validation, reconciliation, and quality checks to ensure data accuracy and consistency.
• Utilize AI-assisted engineering tools, code generation capabilities, and developer productivity solutions to improve data engineering efficiency while adhering to organizational engineering standards.
• Support development of reliable data products by contributing to data quality, metadata, documentation, and business-ready datasets that enable trusted data consumption.
• Troubleshoot data pipeline failures, workflow issues, and processing bottlenecks through root cause analysis.
• Support testing, deployment, and production support activities for data engineering solutions.
• Maintain technical documentation, workflow definitions, and operational procedures.
• Collaborate with various teams and stakeholders to support successful data platforms and analytics initiatives.
• Demonstrates ownership and accountability while delivering high-quality data engineering solutions.
• Collaborate effectively with various teams and business stakeholders to ensure smooth delivery.
• Maintains a quality-first mindset while developing scalable and reliable data processing solutions.
• Apply strong analytical and problem-solving skills to resolve data engineering and platform challenges.
• Shows adaptability and willingness to learn evolving data engineering technologies and practices.
• Communicates clearly by sharing progress, risks, and dependencies proactively.

Perks and Benefits for Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.