Data Engineer - PySpark

Wipro; Tampa (FL); On-site; USD 60,000 - 135,000; Full time

Job summary

Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust data pipelines in a Big Data environment, leveraging Hadoop ecosystem tools, Hive, HDFS, Spark, and Scala.

The role emphasizes strong SQL, data modeling, and ability to work independently on complex data challenges. Candidates should have 5–8 years of experience, excellent communication, and hands-on experience with PySpark, streaming platforms, and

Qualifications

• 5–8 years of experience in data engineering.
• Proficient in PySpark and SQL for large datasets.
• Experience with Hadoop ecosystem components and data warehousing concepts.

Responsibilities

• Design and implement data pipelines in a BigData environment.
• Work with Hive, HDFS, Spark, and Scala.
• Write complex SQL queries and optimize queries for performance.
• Collaborate with cross-functional teams to model and design data structures.
• Ensure data quality and reliability in production pipelines.

Skills

PySpark

SQL queries

Data modeling

Distributed systems

Shell scripting

Autosys

Hive

HDFS

Sqoop

Spark

Impala

Scala

Communication skills

Tools

Hadoop ecosystem

Hive

HDFS

Sqoop

Spark

Impala

Scala

Job description

Job Description

Role: Data Engineer - PySpark

Location: Irving, TX (3 Days onsite/week)

Key Responsibilities

• Strong programming skills in PySpark in a BigData environment with exceptional hands-on capabilities
• Familiarity with big data processing tools and techniques.
• Experience with the Hadoop ecosystem including Hive, HDFS, Sqoop, Spark, Impala, Scala, etc.,
• Well versed with shell scripting and Autosys scheduler.
• Good understanding of distributed systems.
• Should be familiar with data warehouse concepts.
• Experience with streaming data platforms.
• Excellent analytical and problem-solving skills.
• Experience with writing complex SQL queries.
• Knowledge on data modeling and data design is essential.
• Should be independent and resourceful dealing with risks/issues and resolving them in a timely manner.
• Excellent communication and articulation skills.

Mandatory Skills

Data Integration Pyspark .

Experience

Experience: 5-8 Years

Compensation

The expected compensation for this role ranges from $60,000 to $135,000 .

Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.

Eligibility & Conditions

Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.

Equal Employment Opportunity

Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.

Company Culture

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.