PySpark Data Engineer — Big Data & Streaming Expert

Wipro; Tampa (FL); On-site; USD 60,000 - 135,000; Full time

Job summary

Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust data pipelines in a Big Data environment, leveraging Hadoop ecosystem tools, Hive, HDFS, Spark, and Scala.

The role emphasizes strong SQL, data modeling, and ability to work independently on complex data challenges. Candidates should have 5–8 years of experience, excellent communication, and hands-on experience with PySpark, streaming platforms, and

Qualifications

• 5–8 years of experience in data engineering.
• Proficient in PySpark and SQL for large datasets.
• Experience with Hadoop ecosystem components and data warehousing concepts.

Responsibilities

• Design and implement data pipelines in a BigData environment.
• Work with Hive, HDFS, Spark, and Scala.
• Write complex SQL queries and optimize queries for performance.
• Collaborate with cross-functional teams to model and design data structures.
• Ensure data quality and reliability in production pipelines.

Skills

PySpark

SQL queries

Data modeling

Distributed systems

Shell scripting

Autosys

Hive

HDFS

Sqoop

Spark

Impala

Scala

Communication skills

Tools

Hadoop ecosystem

Hive

HDFS

Sqoop

Spark

Impala

Scala

Job description

Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust data pipelines in a Big Data environment, leveraging Hadoop ecosystem tools, Hive, HDFS, Spark, and Scala.

The role emphasizes strong SQL, data modeling, and ability to work independently on complex data challenges. Candidates should have 5–8 years of experience, excellent communication, and hands-on experience with PySpark, streaming platforms, and