Senior Lead Data & AI Platform Engineer

Virtusa; Irving (TX); On-site; USD 140,000 - 200,000; Full time

Job summary

Virtusa is seeking a senior data/Apps development professional to lead and design complex data processing solutions using Python and PySpark. The role emphasizes building scalable data pipelines, Hadoop ecosystem expertise, and modern ETL approaches to migrate to cloud-native environments.

You will guide junior developers, enforce best practices, and collaborate with stakeholders to deliver robust analytics platforms while maintaining data integrity and security.

Qualifications

• 10+ years in Apps Development or systems analysis with Python and big data expertise.
• Expert in Python/PySpark for data processing and analytics.
• 8+ years architecting on Hadoop ecosystem with Cloudera distributions.
• Proficient in HDFS, Hive, Pig, Sqoop; NoSQL experience with MongoDB.
• Experience building scalable data pipelines and ETL to relational warehouses.
• Data warehouse design principles: integrity, security, performance.
• Ability to use Devin AI for code refactoring and optimization.
• CI/CD, Git, Docker, Kubernetes; development lead and mentoring.
• Proven project management and SME in at least one area.

Skills

Python

PySpark

Big Data

Data Modeling

Data Warehousing

ETL

CI/CD

Git

Docker

Kubernetes

Leadership

Project Management

Communication

Systems Analysis

SME

Education

Tools

Hadoop (Cloudera)

Hive

Pig

Sqoop

MongoDB

Devin AI

Job description

Virtusa is seeking a senior data/Apps development professional to lead and design complex data processing solutions using Python and PySpark. The role emphasizes building scalable data pipelines, Hadoop ecosystem expertise, and modern ETL approaches to migrate to cloud-native environments.

You will guide junior developers, enforce best practices, and collaborate with stakeholders to deliver robust analytics platforms while maintaining data integrity and security.