Data Platform Engineer

Purview Services; Hyderabad, Pune District; On-site; INR 2,500,000 - 5,200,000; Full time

Job summary

Purview Services in Hyderabad is seeking a Platform Data Engineer Specialist Engineering with 6+ years of experience to design, build, and maintain scalable data platforms, pipelines, and analytics workloads using Databricks, Azure Data Factory, Apache NiFi, Apache Kafka and Azure services.

The role emphasizes Linux system administration (RHEL/Ubuntu), scripting (Python/SQL), data governance, security, reliability, and collaboration with data scientists and analysts to deliver data-driven

Qualifications

• 6+ years of experience in data engineering / platform engineering roles.
• Strong expertise in: Databricks, Azure Data Factory, Apache NiFi, Apache Kafka.
• Experience with Azure platform services (e.g., Functions, storage, compute).
• Solid knowledge of Linux system administration (RHEL/Ubuntu).
• Proficiency in scripting/programming (Python, SQL, or similar).
• Experience in building scalable and fault-tolerant data pipelines.

Responsibilities

• Design, develop, and optimize data pipelines for ingestion, transformation, and processing of large-scale datasets.
• Build and maintain data platforms using Databricks, Azure Data Factory, Apache NiFi, and Kafka.
• Manage and support cloud-based infrastructure, primarily on Azure.
• Collaborate with data scientists, analysts, and business teams to enable data-driven solutions.
• Ensure high availability, reliability, and performance of data systems.
• Implement monitoring, logging, and troubleshooting mechanisms across data platforms.
• Work with Linux systems (RHEL/Ubuntu) for deployment, configuration, and maintenance.
• Maintain data security, governance, and compliance standards.

Skills

Platform data engineering

Databricks

Azure Data Factory

Apache NiFi

Apache Kafka

Linux system administration

Python/SQL scripting

Tools

Databricks

Azure Data Factory

Apache NiFi

Apache Kafka

Azure cloud services

Job description

Job Title: Platform Data Engineer Specialist Engineering

Experience: 6+ Years

Role Overview

We are seeking a highly skilled Platform Data Engineer to design, build, and maintain scalable data platforms and pipelines. The ideal candidate will have strong experience in modern data engineering tools, cloud infrastructure (preferably Azure), and analytics platforms, along with a solid foundation in Linux system administration.

Key Responsibilities

• Design, develop, and optimize data pipelines for ingestion, transformation, and processing of large-scale datasets.
• Build and maintain data platforms using tools like Databricks, Azure Data Factory, Apache NiFi, and Kafka.
• Manage and support cloud-based infrastructure, primarily on the Azure platform.
• Collaborate with data scientists, analysts, and business teams to enable data-driven solutions.
• Ensure high availability, reliability, and performance of data systems.
• Implement monitoring, logging, and troubleshooting mechanisms across data platforms.
• Work with Linux systems (RHEL/Ubuntu) for deployment, configuration, and maintenance.
• Maintain data security, governance, and compliance standards.

Required Skills & Qualifications

• 6+ years of experience in data engineering / platform engineering roles.
• Strong expertise in:
• Databricks
• Azure Data Factory
• Apache NiFi
• Apache Kafka
• Experience with Azure platform services (e.g., Azure Functions, storage, compute).
• Solid knowledge of Linux system administration (RHEL/Ubuntu).
• Proficiency in scripting/programming (Python, SQL, or similar).
• Experience in building scalable and fault-tolerant data pipelines.

Preferred Qualifications

• Experience with cloud-based SIEM and SOAR technologies.
• Relevant Azure and Databricks certifications.
• Exposure to DevOps practices and CI/CD pipelines.
• Strong problem-solving and analytical skills.

Soft Skills

• Excellent communication and collaboration skills
• Ability to work in a fast-paced, agile environment
• Strong ownership and accountability

Nice to Have

• Experience with real-time streaming architectures
• Knowledge of data governance and security frameworks