PySpark Developer

Wipro Technologies; Minneapolis (MN); Hybrid; USD 80,000 - 158,000; Full time

Benefits offered by this job

Medical and dental insurance

Paid time off

Disability coverage

Job summary

Wipro Limited invites applications for a PySpark Developer role in Irving, TX, hybrid with three days onsite weekly. You will design and implement scalable PySpark data pipelines, leveraging Azure cloud services, Docker, and AKS to deliver secure, high‑performing solutions.

The ideal candidate has 7+ years in data engineering, strong PySpark skills, and experience with Azure and containerized deployments. This position offers competitive compensation and a comprehensive benefits package.

Qualifications

• 7+ years of data engineering or big data development experience.
• Proficient in PySpark and distributed data processing.
• Strong knowledge of Azure cloud services and containerized deployments.

Responsibilities

• Design, develop, and maintain PySpark data pipelines for large-scale processing.
• Deploy and manage containerized workloads with Docker and AKS.
• Collaborate with data architects, analysts, and stakeholders to translate requirements into robust solutions.
• Improve performance, scalability, and cost efficiency of data pipelines.
• Implement best practices for data ingestion, transformation, and validation across cloud environments.
• Identify and fix security vulnerabilities across applications and deployments.
• Participate in code reviews, deployments, and technical discussions.
• Support production issue resolution and performance tuning.

Skills

PySpark

AKS

Docker

Azure cloud

ETL/ELT

Troubleshooting

Tools

SSIS

Informatica

Job description

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com.

Job Description:

Long Description

Wipro Technologies-USA invites applications for the position of Solution Architect L1, specializing as a PySpark Developer within our esteemed Technology Services sector. This pivotal role is part of the TS - DATA ANALYTICS & AI group, focusing on Data Transformation initiatives that drive our clients' digital evolution.

As a PySpark Developer, you will leverage your extensive expertise in Spark Open Source technology to design, architect, and implement scalable big data solutions that meet complex business objectives. You will collaborate closely with cross-functional teams, including data engineers, analysts, and business stakeholders, to translate data requirements into robust architectures, ensuring high performance and reliability.

Key competencies essential for success include being respectful in all interactions, maintaining clear and consistent communication, demonstrating stewardship over data assets and solutions, responding promptly to evolving project needs, and building trust within the team and with client partners. Your role will involve leading technical discussions, crafting best practice guidelines, and ensuring compliance with industry standards.

Candidates considered for this role should possess between 8 to 10 years of professional experience in data analytics, specifically working with Spark Open Source technologies. A strong understanding of distributed computing, data processing frameworks, and cloud platforms will be advantageous. The position demands a strategic thinker with a hands‑on approach, able to balance architectural oversight with practical coding when required.

Compensation for this role is competitive and ranges from $80,000 to $158,000 annually. Final salary will reflect several factors, including your geographic location, applicable minimum wage regulations, specific skills, and relevant professional experience. In addition, this position is eligible for Wipro’s comprehensive benefits package, encompassing medical and dental insurance options, disability coverage, paid time off including sick leave, and other statutory leave provisions.

Wipro is committed to fostering an inclusive workplace where all employees and applicants receive equal opportunity. We prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability, genetics, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by law. We actively encourage applications from veterans and persons with disabilities.

Your journey at Wipro will be one of continuous reinvention—of your knowledge, career, and skills. You will join a future-focused organization dedicated to pioneering digital transformation with bold ambitions. In this dynamic environment, you are empowered to innovate and design your own path forward. Become part of a company that embraces change, champions purpose, and supports your professional evolution every step of the way.

Role: PySpark Developer
Location: Irving, TX (3 Days onsite/week)

Job Description:
We are looking for an experienced PySpark Developer with over 7 years of hands‑on experience in designing, developing, and optimizing large‑scale data processing applications. The ideal candidate should have strong expertise in PySpark, Azure cloud services, Docker, and Azure Kubernetes Service (AKS), with the ability to build scalable, secure, and high‑performing data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark for large-volume data processing.
• Work with Azure cloud services to build reliable and efficient data engineering solutions.
• Deploy, manage, and monitor containerized applications using Docker and Azure Kubernetes Service (AKS).
• Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver high‑quality data solutions.
• Optimize PySpark jobs for performance, scalability, reliability, and cost efficiency.
• Implement best practices for data ingestion, transformation, validation, and processing across cloud environments.
• Identify and fix application, container, and platform vulnerabilities to ensure secure deployments.
• Support troubleshooting, production issue resolution, and performance tuning of data pipelines and cloud‑based applications.
• Participate in code reviews, technical discussions, deployment planning, and documentation activities.

Required Skills

• Strong hands‑on experience in PySpark development for distributed data processing.
• Experience with Azure Kubernetes Service (AKS) for deploying and managing containerized workloads.
• Proficiency in Docker for containerization, image management, and deployment workflows.
• Solid working knowledge of Azure cloud services and cloud‑native application development.
• Strong understanding of data engineering concepts, ETL/ELT processes, and performance optimization.
• Ability to troubleshoot complex technical issues and deliver timely resolutions.

Good‑to‑Have Skills

• Working knowledge of Python for scripting, automation, and data processing support.
• Experience with SSIS for ETL workflow development and migration activities.
• Exposure to Informatica for data integration and enterprise data management.
• Experience in identifying, analyzing, and fixing security vulnerabilities across applications, containers, and cloud deployments.

Experience and Qualifications

• 7 years of overall experience in data engineering, big data development, or related technology roles.
• Strong practical experience in building and supporting production‑grade PySpark‑based data pipelines.
• Experience working in cloud‑based environments, preferably Microsoft Azure.
• Good understanding of CI/CD practices, DevOps workflows, and container‑based deployments.
• Strong analytical, problem‑solving, and communication skills.
• Ability to work independently as well as collaboratively in a fast‑paced delivery environment.

Preferred Candidate Profile

The ideal candidate will be a technically strong PySpark Developer who can take ownership of data engineering solutions, work effectively with Azure-based platforms, manage containerized deployments using Docker and AKS, and ensure secure, optimized, and reliable delivery of data processing applications.

Mandatory Skills: Spark Open Source.Experience: 8-10 Years.

The expected compensation for this role ranges from $80,000 to $158,000. Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options. Applicants are advised that employment in some roles may be conditioned on successful completion of a post‑offer drug screening, subject to applicable state law. Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.

Reinvent your world. We are building a modern Wipro. We are an end‑to‑end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.