Developer – Big Data PySpark

HypTechie; India; On-site; INR 1,000,000 - 1,100,000; Full time

Job summary

HypTechie is seeking an experienced Big Data Developer (PySpark) for an office-based role in India. You will design and implement large-scale data pipelines on Azure, leveraging PySpark and Python, with a focus on automation, security, and reliability.

Ideal candidates have 5–7 years in Big Data, strong Azure Cloud experience, and hands-on Terraform/ARM templates. This permanent, full-time role emphasizes collaboration with cross-functional teams and weekend support when required.

Qualifications

• 5–7 years of experience in Big Data and PySpark.
• Hands-on with Azure Data Factory and Azure services.
• Experience with Infrastructure as Code: Terraform and ARM templates.

Responsibilities

• Lead the implementation of cloud-based data pipelines on Azure.
• Design and build scalable data engineering solutions in PySpark.
• Automate deployments and IaC using Terraform and ARM templates.

Skills

PySpark

Python

Azure Cloud

Big Data

Tools

Terraform

ARM templates

Azure DevOps

Job description

Our Client is Looking for a Developer – Big Data PySpark

Job Type: Permanent

Duration: Permanent

Work Mode: Office Only

Experience Required: 5 – 7 Years

Salary Range: ₹10,00,000 – ₹11,00,000

Role Overview

We are seeking an experienced Big Data Developer with expertise in PySpark, Python, Azure Cloud, and Big Data/Hadoop ecosystems. The role involves designing and implementing large-scale data engineering solutions, building robust pipelines, and automating cloud deployments. The ideal candidate will have strong cloud experience, especially with Microsoft Azure, and proven skills in infrastructure as code (IaC), DevOps, and data engineering.

Key Responsibilities

• Lead the implementation of infrastructure via code and provide strategic recommendations for Microsoft Azure technologies.
• Integrate and automate standardized Azure deployments using Azure DevOps, Terraform, and ARM templates.
• Act as an escalation point for Azure-related issues, providing technical support, troubleshooting, and mentoring to operational teams.
• Translate business requirements into scalable data engineering solutions.
• Develop and maintain detailed design, build, and deployment documentation with proper source control.
• Work closely with support teams to ensure reliability and performance of cloud and data platforms.
• Provide leadership in security hardening and testing of Azure-based systems.
• Stay updated on cloud industry trends and contribute to continuous improvement initiatives.

Key Competencies & Skills

• 5–7 years of experience in Big Data, PySpark, and Python.
• Hands-on experience with Azure Data Factory and Azure Cloud services.
• Strong knowledge of Hadoop ecosystems and data engineering frameworks.
• Proven expertise in Infrastructure as Code (Terraform, ARM templates).
• Solid DevOps experience with Azure DevOps or similar orchestration tools.
• Demonstrated knowledge of security hardening and testing in cloud environments.
• Strong documentation skills and adherence to best practices.
• Excellent communication and collaboration abilities.
• Flexibility to work outside standard hours, including weekends, when required.