Senior Python Data Pipeline Lead

Tata Consultancy Services; Irving (TX); On-site; USD 120,000 - 135,000; Full time

Job summary

Tata Consultancy Services in Irving, TX seeks an experienced Python data engineer to design and maintain complex data processing workflows. You will build scalable ingestion and transformation systems, optimize performance, and collaborate with cross-functional teams to deliver data-driven solutions.

The role emphasizes mentoring junior developers, applying best practices in testing and documentation, and leveraging AI-assisted tools for code quality and efficiency.

Qualifications

• Bachelor's degree in Computer Science or related field.
• 10+ years of advanced Python development experience.
• Strong analytical and debugging skills with complex data scenarios.
• Proficiency with data processing libraries and frameworks such as Polars, Pandas, NumPy, PySpark, Dask.

Responsibilities

• Design, develop, and maintain Python-based data processing workflows and pipelines.
• Build scalable data ingestion and transformation systems.
• Troubleshoot and optimize data processing performance.
• Collaborate with cross-functional teams to deliver data solutions.
• Implement best practices for code quality, testing, and documentation.
• Mentor junior developers and participate in code reviews.

Education

Bachelor of Computer Science

Tools

Python

Polars

Pandas

NumPy

Apache Spark (PySpark)

Dask

GitHub Copilot

ChatGPT

Kafka

Oracle & SQL

Kubernetes

Git

Job description

Tata Consultancy Services in Irving, TX seeks an experienced Python data engineer to design and maintain complex data processing workflows. You will build scalable ingestion and transformation systems, optimize performance, and collaborate with cross-functional teams to deliver data-driven solutions.

The role emphasizes mentoring junior developers, applying best practices in testing and documentation, and leveraging AI-assisted tools for code quality and efficiency.