Lead PySpark Developer — Azure Data Pipelines & AKS

Wipro Technologies

Minneapolis (MN)

Hybrid

USD 80,000 - 158,000

Full time

13 days ago

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Medical and dental insurance

Paid time off

Disability coverage

Job summary

Wipro Limited invites applications for a PySpark Developer role in Irving, TX, hybrid with three days onsite weekly. You will design and implement scalable PySpark data pipelines, leveraging Azure cloud services, Docker, and AKS to deliver secure, high‑performing solutions.

The ideal candidate has 7+ years in data engineering, strong PySpark skills, and experience with Azure and containerized deployments. This position offers competitive compensation and a comprehensive benefits package.

Qualifications

7+ years of data engineering or big data development experience.
Proficient in PySpark and distributed data processing.
Strong knowledge of Azure cloud services and containerized deployments.

Responsibilities

Design, develop, and maintain PySpark data pipelines for large-scale processing.
Deploy and manage containerized workloads with Docker and AKS.
Collaborate with data architects, analysts, and stakeholders to translate requirements into robust solutions.
Improve performance, scalability, and cost efficiency of data pipelines.
Implement best practices for data ingestion, transformation, and validation across cloud environments.
Identify and fix security vulnerabilities across applications and deployments.
Participate in code reviews, deployments, and technical discussions.
Support production issue resolution and performance tuning.