Big Data Developer

NCR Voyix; Chennai District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

NCR Voyix is seeking a cloud data engineer to design, develop, and maintain data pipelines and ETL workflows in Databricks, Spark, and Azure Data Factory.

The role focuses on building a data lakehouse, optimizing storage and retrieval, and delivering reliable Power BI dashboards and reports for stakeholders, while ensuring data quality and governance across solutions.

Qualifications

• Design, develop, and maintain data pipelines and ETL workflows.
• Implement data lakehouse architecture and optimize storage and retrieval.
• Write efficient, reusable Python code for data processing and automation.
• Orchestrate workflows using Azure Data Factory and integrate with Azure services.
• Develop and maintain Power BI dashboards and reports for stakeholders.
• Ensure data quality, security, and governance across data solutions.

Responsibilities

• Collaborate with data scientists, analysts, and business stakeholders.
• Monitor and troubleshoot data pipelines for high availability and reliability.
• Stay updated on emerging cloud data engineering technologies and best practices.

Skills

Data engineering

Cross-functional collaboration

Problem solving

Cloud analytics

Education

Bachelor's degree in CS/EE/CE

Tools

Databricks

Spark

Azure Data Factory

Power BI

Delta Lake

Git

CI/CD

Job description

Job Description:

• Design, develop, and maintain data pipelines and ETL workflows using Databricks, Spark, and ADF.
• Implement data lakehouse architecture and optimize data storage and retrieval for performance and cost efficiency.
• Write efficient, reusable, and scalable Python code for data processing and automation tasks.
• Orchestrate complex workflows using Azure Data Factory and integrate with other Azure services.
• Develop and maintain Power BI dashboards and reports, ensuring accurate and timely insights for stakeholders.
• Ensure data quality, security, and governance across all data solutions.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data products.
• Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
  Stay updated on emerging technologies and best practices in cloud data engineering.
• Experience with data lakehouse architecture, Delta Lake, and data modeling.
  Knowledge of CI/CD pipelines, DevOps practices, and version control (Git).