Senior Data Engineer

Persistent Systems; Bengaluru; Hybrid; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Insurance coverage

Flexible work hours

Long Service awards

Group term life

Mediclaim hospitalization

Job summary

Persistent Systems in Bengaluru is seeking an experienced Senior Data Engineer with Ab Initio, Python, and GCP expertise to design, develop, and maintain scalable data pipelines supporting enterprise analytics. The role focuses on ETL/ELT, data warehousing, and cloud/on-premise data integration across complex environments.

You will collaborate with Data Architects, Analysts, and Cloud Engineers, participate in Agile ceremonies, and ensure high availability, data quality, and governance.

Qualifications

• 5–8 years of experience in Data Engineering or Data Integration.
• Hands-on Ab Initio development experience.
• Proficiency in Python scripting for data engineering.
• Experience with Google Cloud Platform services.
• Experience with Spark and Hadoop ecosystems.
• Strong SQL and data warehousing knowledge.
• Experience working in Agile environments.

Responsibilities

• Design, develop, and maintain scalable data engineering and data integration solutions.
• Build and optimize ETL/ELT pipelines using Ab Initio and modern data engineering frameworks.
• Translate business requirements into efficient data processing solutions.
• Create highly available data pipelines for enterprise-scale data platforms.
• Collaborate with stakeholders across data architects, analysts, and cloud engineers.
• Design data warehouse structures, models, and analytics environments.
• Develop Python scripts to support data integration and processing activities.
• Integrate data from multiple structured and unstructured sources across cloud/on-premise.
• Perform data validation, quality checks, and performance optimization.
• Troubleshoot data engineering and integration issues.
• Conduct code reviews ensuring quality and testability.
• Support deployment, monitoring, and maintenance of production data environments.
• Ensure compliance with data governance, security, and management standards.

Skills

Python

SQL

ETL Development

Agile

Tools

Ab Initio

Google Cloud Platform (GCP)

Apache Spark

Hadoop

Docker

Job description

We are looking for an experienced Senior Data Engineer with expertise in Ab Initio, Python, and Google Cloud Platform (GCP) to design, develop, and maintain scalable data engineering solutions. The ideal candidate will be responsible for building optimized and highly available data pipelines that support enterprise data integration, reporting, analytics, and business intelligence initiatives. This role requires strong technical expertise in ETL development, data warehousing, cloud platforms, and big data technologies.

• Experience: 5 to 8 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable data engineering and data integration solutions.
• Build and optimize ETL/ELT pipelines using Ab Initio and modern data engineering frameworks.
• Analyze business requirements and translate them into efficient data processing solutions.
• Develop and maintain highly available and reliable data pipelines for enterprise-scale data platforms.
• Work closely with business and technical stakeholders to understand data requirements and deliver effective solutions.
• Design and maintain data warehouse structures, data models, and analytics environments.
• Develop scripts and automation solutions using Python to support data integration and processing activities.
• Integrate data from multiple structured and unstructured sources across cloud and on-premise environments.
• Perform data validation, data quality checks, and performance optimization activities.
• Troubleshoot and resolve complex data engineering and integration issues.
• Conduct code reviews and ensure adherence to coding standards, testability, and code quality practices.
• Collaborate with cross-functional teams including Data Architects, Data Analysts, Business Teams, and Cloud Engineers.
• Support deployment, monitoring, and maintenance of production data environments.
• Ensure compliance with enterprise data governance, security, and data management standards.
• Participate in Agile ceremonies including sprint planning, estimations, reviews, and retrospectives.

Expertise You'll Bring:

• 5 to 8 years of experience in Data Engineering, ETL Development, or Data Integration.
• Strong hands‑on experience with Ab Initio development and data integration solutions.
• Solid experience in Python programming and scripting for data engineering use cases.
• Experience working with Google Cloud Platform (GCP) services and cloud-native data solutions.
• Strong understanding of ETL/ELT concepts, data processing frameworks, and data engineering best practices.
• Experience working with Apache Spark and distributed data processing technologies.
• Strong knowledge of SQL and relational database systems.
• Experience with Data Warehousing concepts, dimensional modeling, and analytics platforms.
• Familiarity with Hadoop ecosystem and big data technologies.
• Experience with Docker and containerization technologies.
• Ability to design scalable and high‑performance data pipelines.
• Experience performing code reviews with a focus on quality, maintainability, and testing standards.
• Strong analytical, troubleshooting, and problem‑solving abilities.
• Experience working in Agile development environments.
• Excellent communication and stakeholder management skills.
• Ability to work collaboratively across multiple teams and business functions.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company‑sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values‑Driven, People‑Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility‑friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."