Developer – Big Data PySpark

HypTechie; India; On-site; INR 1,000,000 - 1,100,000; Full time

Job summary

HypTechie is looking for a Developer – Big Data PySpark in India. This permanent position focuses on designing and implementing large-scale data engineering solutions. The successful candidate will have hands-on experience with Azure Cloud and will lead infrastructure projects using code.

Key responsibilities include automating Azure deployments, supporting operational teams, and ensuring the reliability of data platforms. Ideal candidates should possess 5–7 years of experience in Big Data and excellent documentation skills.

Qualifications

• 5–7 years of experience in Big Data, PySpark, and Python.
• Hands-on experience with Azure Data Factory and Azure Cloud services.
• Strong knowledge of Hadoop ecosystems and data engineering frameworks.

Responsibilities

• Lead the implementation of infrastructure via code.
• Integrate and automate standardized Azure deployments.
• Act as an escalation point for Azure-related issues.

Skills

Big Data

PySpark

Python

Azure Cloud

Infrastructure as Code

DevOps

Hadoop ecosystems

Azure Data Factory

Tools

Terraform

ARM templates

Azure DevOps

Job description

Our Client is Looking for a Developer – Big Data PySpark

Job Type: Permanent

Duration: Permanent

Work Mode: Office Only

Experience Required: 5 – 7 Years

Salary Range: ₹10,00,000 – ₹11,00,000

Role Overview

We are seeking an experienced Big Data Developer with expertise in PySpark, Python, Azure Cloud, and Big Data/Hadoop ecosystems. The role involves designing and implementing large-scale data engineering solutions, building robust pipelines, and automating cloud deployments. The ideal candidate will have strong cloud experience, especially with Microsoft Azure, and proven skills in infrastructure as code (IaC), DevOps, and data engineering.

Key Responsibilities

• Lead the implementation of infrastructure via code and provide strategic recommendations for Microsoft Azure technologies.
• Integrate and automate standardized Azure deployments using Azure DevOps, Terraform, and ARM templates.
• Act as an escalation point for Azure-related issues, providing technical support, troubleshooting, and mentoring to operational teams.
• Translate business requirements into scalable data engineering solutions.
• Develop and maintain detailed design, build, and deployment documentation with proper source control.
• Work closely with support teams to ensure reliability and performance of cloud and data platforms.
• Provide leadership in security hardening and testing of Azure-based systems.
• Stay updated on cloud industry trends and contribute to continuous improvement initiatives.

Key Competencies & Skills

• 5–7 years of experience in Big Data, PySpark, and Python.
• Hands-on experience with Azure Data Factory and Azure Cloud services.
• Strong knowledge of Hadoop ecosystems and data engineering frameworks.
• Proven expertise in Infrastructure as Code (Terraform, ARM templates).
• Solid DevOps experience with Azure DevOps or similar orchestration tools.
• Demonstrated knowledge of security hardening and testing in cloud environments.
• Strong documentation skills and adherence to best practice.
• Excellent communication and collaboration abilities.
• Flexibility to work outside standard hours, including weekends, when required.