Senior PySpark Data Engineer – Big Data & Streaming

Wipro Ltd.; Irving (TX); Híbrido; USD 60.000 - 135.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical benefits

Dental benefits

Disability insurance

Paid time off

Descripción de la vacante

Wipro Limited in Irving, TX is seeking a Data Engineer - PySpark to design and optimize PySpark pipelines in a Big Data environment. The role involves hands-on work with Hive, HDFS, Sqoop, Spark, Impala, and Scala, along with strong SQL and data modeling skills.

The position requires 5-8 years of experience and offers a compensation range of $60,000 to $135,000 with benefits. The role is located in Irving, TX with 3 days onsite per week, offering a hybrid model and a comprehensive set of medical

Formación

• 5-8 years of experience in data engineering with PySpark
• Experience building data pipelines in Hadoop ecosystem
• Strong SQL writing and data modeling skills
• Familiarity with distributed systems and data warehouse concepts
• Experience with streaming data platforms and batch processing
• Proficient in shell scripting and job scheduling (Autosys)
• Experience with Hive, HDFS, Sqoop, Spark and Impala is preferred

Responsabilidades

• Develop and maintain PySpark data pipelines in a Big Data environment
• Work with Hadoop ecosystem tools (Hive, HDFS, Sqoop, Spark, Impala, Scala)
• Write complex SQL queries and optimize data models
• Ensure data quality, reliability, and performance of data processing jobs
• Collaborate with data engineers, analysts, and stakeholders to deliver insights
• Monitor and resolve data processing issues and bottlenecks
• Communicate effectively with team members and stakeholders

Conocimientos

PySpark

Shell scripting

Autosys

SQL

Data modeling

Big data

Distributed systems

Streaming data platforms

Hive

HDFS

Sqoop

Spark

Impala

Scala

Herramientas

Hadoop

Hive

HDFS

Sqoop

Spark

Impala

Scala

Descripción del empleo

Wipro Limited in Irving, TX is seeking a Data Engineer - PySpark to design and optimize PySpark pipelines in a Big Data environment. The role involves hands-on work with Hive, HDFS, Sqoop, Spark, Impala, and Scala, along with strong SQL and data modeling skills.

The position requires 5-8 years of experience and offers a compensation range of $60,000 to $135,000 with benefits. The role is located in Irving, TX with 3 days onsite per week, offering a hybrid model and a comprehensive set of medical