Data Engineer

Persistent Systems; Hyderabad; On-site; INR 1,800,000 - 4,000,000; Full time

Benefits offered by this job

Group term life insurance

Personal accident insurance

Medicliam hospitalization

Flexible work hours

Long Service awards

Diversity and inclusion focus

Job summary

Persistent Systems is seeking a Senior Data Engineer to design and build enterprise-scale data integration and analytics solutions using Ab Initio, Teradata, Unix Shell Scripting, and GCP. Collaborate with architects, product owners, and cross-functional teams to deliver scalable data pipelines and modernize cloud platforms.

You will design ETL frameworks, perform data quality checks, migrate legacy systems to GCP, optimize SQL and ETL performance, and mentor juniors.

Qualifications

• BE/MBA/BCA/MCA or equivalent.
• Data warehousing concepts and architecture.
• Cloud migration and modernization experience.
• Agile and DevOps methodologies.
• Git, CI/CD pipelines, and version control expertise.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management.
• Banking/Financial services domain experience preferred.
• BI architecture and ETL concepts understanding.

Responsibilities

• Design, develop, enhance, and maintain complex ETL and data integration solutions using Ab Initio.
• Develop and optimize data pipelines and transformations on Teradata and cloud platforms.
• Support large-scale data modernization and migration initiatives from legacy platforms to GCP.
• Design and implement scalable data processing solutions using cloud-native services.
• Create and maintain reusable ETL frameworks, metadata-driven processes, and automation utilities.
• Analyze source systems, perform data mapping, ensure data quality and integrity across the data lifecycle.
• Develop Unix shell scripts for automation, scheduling, monitoring, and operational support.
• Perform performance tuning and optimization of ETL workflows, SQL queries, and database objects.
• Collaborate with architecture and platform teams to establish engineering standards and best practices.
• Participate in code reviews, design reviews, testing, deployment, and production support activities.
• Drive troubleshooting, root cause analysis, and resolution of production incidents.
• Mentor junior engineers and contribute to technical upskilling across the team

Skills

ETL development

Data warehousing

Unix shell scripting

Ab Initio

Teradata

Cloud migrations

Cloud platforms (GCP)

Education

BE/MBA/BCA/MCA or equivalent

Tools

Git

CI/CD pipelines

Job description

We are seeking a highly skilled Senior Data Engineer to design, develop, modernize, and support enterprise-scale data integration and analytics solutions. The ideal candidate will have strong expertise in Ab Initio, Teradata, Unix Shell Scripting, and Google Cloud Platform (GCP) with a proven track record of delivering high-performance data pipelines, large-scale data migrations, and cloud modernization initiatives .The role requires collaboration with architects, product owners, business analysts, and cross-functional engineering teams to build scalable, resilient, and efficient data solutions that support critical business functions and strategic modernization programs.

• Experience: 5+Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, enhance, and maintain complex ETL and data integration solutions using Ab Initio.
• Develop and optimize data pipelines and transformations on Teradata and cloud platforms.
• Support large-scale data modernization and migration initiatives from legacy platforms to GCP.
• Design and implement scalable data processing solutions using cloud-native services.
• Create and maintain reusable ETL frameworks, metadata-driven processes, and automation utilities.
• Analyze source systems, perform data mapping, and ensure data quality and integrity across the data lifecycle.
• Develop and maintain Unix shell scripts for automation, scheduling, monitoring, and operational support.
• Perform performance tuning and optimization of ETL workflows, SQL queries, and database objects.
• Collaborate with architecture and platform teams to establish engineering standards and best practices.
• Participate in code reviews, design reviews, testing, deployment, and production support activities.
• Drive troubleshooting, root cause analysis, and resolution of production incidents.
• Mentor junior engineers and contribute to technical upskilling across the team

Expertise You'll Bring:

• BE/MBA/BCA/MCA or equivalent
• Strong understanding of Data Warehousing concepts and architecture.
• Experience with cloud migration and modernization programs.
• Knowledge of Agile and DevOps methodologies.
• Experience with Git, CI/CD pipelines, and version control tools.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management capabilities.
• Banking and Financial Services domain experience is preferred.
• Understanding of BI architecture, ETL processes, and data warehousing concepts.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.