Senior Data Pipeline Engineer — Python & PySpark

NTT DATA North America; Irving (TX); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading technology services provider in Irving, Texas is seeking a Developer/Engineer with 7+ years of experience in building data pipelines using Python, PySpark, and Django. The ideal candidate will have hands-on knowledge of MLOps and the Hadoop ecosystem. Responsibilities include collaborating with technology teams, coding and documenting applications, and developing prototypes. Exposure to cloud platforms like AWS or Azure is a plus. Join an inclusive organization that values innovation and growth.

Qualifications

• Minimum 7+ years of work experience in building data pipelines.
• Hands-on experience with MLOps.
• Proficient with Python and related packages (NumPy, pandas).
• Experience with Hadoop eco-system tools (HDFS, AWS Glue, etc.).
• Working experience on relational/non-relational databases.
• Experience working in a Scrum team and related ceremonies.
• Knowledge of Unix/Linux.

Responsibilities

• Collaborate with client technology and business staff.
• Code, test, debug, implement, and document applications.
• Negotiate features and associated priorities.
• Identify problem causality and business impact.
• Develop prototypes for solutions.

Skills

Python

PySpark

Django

Data pipelines

MLOps

Hadoop ecosystem

Relational databases

Unix/Linux

Tools

AWS

Azure

GCP

Job description

A leading technology services provider in Irving, Texas is seeking a Developer/Engineer with 7+ years of experience in building data pipelines using Python, PySpark, and Django. The ideal candidate will have hands-on knowledge of MLOps and the Hadoop ecosystem. Responsibilities include collaborating with technology teams, coding and documenting applications, and developing prototypes. Exposure to cloud platforms like AWS or Azure is a plus. Join an inclusive organization that values innovation and growth.