Data Engineer II Databricks And Pyspark

NCR Voyix; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

NCR Voyix in India is seeking a seasoned data engineer to design and maintain scalable data pipelines and lakehouse solutions on Databricks, delivering clean, reliable data to analytics and ML teams.

You will build ELT pipelines with PySpark, optimize Delta Lake storage for performance and cost, orchestrate workflows with Azure Data Factory, and collaborate with analysts to model trustworthy datasets.

Qualifications

• 4+ years in data engineering roles.
• Strong PySpark expertise and Spark SQL knowledge.
• Advanced SQL and data modeling skills.

Responsibilities

• Design and implement ELT pipelines using PySpark and Databricks Workflows.
• Implement data lakehouse architecture and optimize storage and access.
• Write efficient, reusable Python code for data processing and automation.
• Orchestrate workflows with Azure Data Factory and integrate with Azure services.
• Collaborate with analysts and data scientists to deliver trusted datasets.
• Monitor pipelines, ensure high availability and reliability.
• Knowledge of CI/CD practices and version control with Git.

Skills

Data engineering experience

PySpark

SQL

Tools

Databricks

Delta Lake

Unity Catalog

Azure Data Factory

Git

Job description

Job Description:

About NCR VOYIX

NCR Voyix Corporation (NYSE: VYX) is a global platform-powered leader in unified commerce for shopping and dining. Combining a flexible, intelligent platform with end-to-end payments capabilities and services developed through its deep industry experience, NCR Voyix empowers retailers and restaurants to accelerate new possibilities for their operations, experiences and business outcomes. NCR Voyix is headquartered in Atlanta, Georgia, and serves customers in more than 35 countries worldwide.

Role Summary

Build and maintain scalable data pipelines and lakehouse solutions onDatabricks, delivering clean, reliable data to analytics and ML teams.

Key Responsibilities

• Design and implement ELT pipelines usingPySparkandDatabricks Workflows.
• Implement data lakehouse architecture and optimize data storage and retrieval for performance and cost efficiency.
• Write efficient, reusable, and scalable Python code for data processing and automation tasks.
• Orchestrate complex workflows using Azure Data Factory and integrate with other Azure services.
• Collaborate with analysts and data scientists to model and deliver trusted datasets.
• Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
• Knowledge of CI/CD pipelines, DevOps practices, and version control (Git).

Required Skills

• 4+ years in data engineering; 3+ years withDatabricks.
• StrongPySpark— DataFrames, Spark SQL, window functions, UDFs.
• AdvancedSQL— complex joins, CTEs, aggregations, query optimization.
• Experience withDelta Lake— ACID transactions, time travel, schema evolution.
• Familiarity withUnity Catalog, data lineage, and access control.
• Cloud experience:Azure(ADLS Gen2, ADF) or AWS/GCP equivalent.
• Comfortable withGit, notebooks-as-code, and automated testing.

Offers of employment are conditional upon passage of screening criteria applicable to the job

EEO Statement

Integrated into our shared values is NCR Voyix’s commitment to equal employment opportunity. All qualified applicants will receive consideration for employment without regard to sex, age, race, color, creed, religion, national origin, disability, sexual orientation, gender identity, veteran status, military service, genetic information, or any other characteristic or conduct protected by law. NCR Voyix is committed to being a globally inclusive company where all people are treated fair, recognized for their individuality, promoted based on performance and encouraged to strive to reach their full potential. We believe in understanding and respecting differences among all people. Every individual at NCR Voyix has an ongoing responsibility to respect and support a globally diverse environment.