Data Engineer

Persistent Systems; Pune District; On-site; INR 2,500,000 - 4,200,000; Full time

Benefits offered by this job

Hybrid work

Education sponsorship

Flexible hours

Long service awards

Insurance coverage

Job summary

Persistent Systems is hiring a Data Engineer to design, develop, and support enterprise-scale data platforms using Snowflake, Databricks, Informatica, and cloud-native tech. You will build scalable ETL/ELT pipelines, data models, and backend services in Python, enabling BI and AI use cases while ensuring quality, governance, and cost efficiency.

You will collaborate with product owners, data scientists, and platform teams, lead end-to-end delivery, and contribute to CI/CD and MLOps initiatives

Qualifications

• Bachelor’s or Master’s degree in computer science, Information Technology, Data Engineering, AI, or related field.
• 8–18 years of experience in Data Engineering, Data Warehousing, Cloud Platforms, or Analytics Engineering.
• Strong hands-on experience with Snowflake, Databricks, Informatica, ETL/ELT processes, and enterprise data integration.
• Advanced SQL expertise, including complex queries, performance tuning, and data optimization.
• Strong Python programming experience with backend engineering and API development.

Responsibilities

• Design, develop, and support enterprise-scale data engineering solutions using Snowflake, Databricks, Informatica, and cloud-native technologies.
• Build scalable ETL/ELT pipelines to ingest, transform, validate, and process structured and unstructured data.
• Develop backend services, APIs, and data applications using Python.
• Design and implement data warehouse, lakehouse, and analytical data models to support BI and AI use cases.
• Create reusable data frameworks, ingestion components, and transformation pipelines.
• Collaborate with product owners, architects, data scientists, and platform teams to define technical solutions.
• Lead end-to-end solution delivery including architecture, development, deployment, monitoring, and optimization.
• Implement and maintain CI/CD pipelines for data engineering and AI workloads.
• Develop and support MLOps/LLMOps frameworks for ML and Generative AI solutions.
• Integrate monitoring, observability, logging, and alerting across data and AI platforms.
• Optimize Snowflake, Databricks, and SQL workloads for performance, scalability, and cost efficiency.
• Ensure data quality, security, governance, and compliance requirements are met.
• Participate in Agile ceremonies and support production incidents and platform improvements.

Skills

Python programming

SQL

Data modeling

Cloud platforms

AI/ML workflows

MLOps

Agile/Scrum

Stakeholder management

Communication

Troubleshooting

Education

Bachelor’s or Master’s degree in Computer Science / IT / Data Engineering / AI

Tools

Snowflake

Databricks

Informatica

Azure DevOps

GitHub

Jenkins

Job description

We are hiring a Data Engineer with strong expertise in Snowflake, Informatica, and Python to design, develop, and support enterprise-scale data engineering solutions. The ideal candidate will be responsible for building scalable data pipelines, modern data platforms, and cloud-based analytics solutions while ensuring data quality, governance, and operational excellence across the organization.

• Location: All Persistent Location
• Experience: 8 to 18 years
• Job Type: Full-Time Employment

What You'll Do:

• Design, develop, and support enterprise-scale data engineering solutions using Snowflake, Databricks, Informatica, and cloud-native technologies.
• Build scalable ETL/ELT pipelines to ingest, transform, validate, and process structured and unstructured data.
• Develop backend services, APIs, and data applications using Python.
• Design and implement data warehouse, lakehouse, and analytical data models to support business intelligence and AI use cases.
• Create reusable data frameworks, ingestion components, and transformation pipelines.
• Collaborate with product owners, architects, data scientists, and platform teams to define technical solutions.
• Lead end-to-end solution delivery including architecture, development, deployment, monitoring, and optimization.
• Implement and maintain CI/CD pipelines for data engineering and AI workloads.
• Develop and support MLOps/LLMOps frameworks for machine learning and Generative AI solutions.
• Integrate monitoring, observability, logging, and alerting capabilities across data and AI platforms.
• Optimize Snowflake, Databricks, and SQL workloads for performance, scalability, and cost efficiency.
• Ensure data quality, security, governance, and compliance requirements are met.
• Participate in Agile ceremonies including sprint planning, estimation, backlog refinement, and design reviews.
• Support production incidents, troubleshooting, root cause analysis, and continuous platform improvement initiatives.
• Create technical documentation, architecture diagrams, operational runbooks, and best-practice guidelines.

Expertise You'll Bring:

• Bachelor’s or master’s degree in computer science, Information Technology, Data Engineering, Artificial Intelligence, or a related discipline.
• 8-18 years of experience in Data Engineering, Data Warehousing, Cloud Platforms, or Analytics Engineering.
• Strong hands-on experience with Snowflake, Databricks, Informatica, ETL/ELT processes, and enterprise data integration.
• Advanced SQL expertise includes complex queries, performance tuning, and data optimization.
• Strong Python programming experience with backend engineering and API development.
• Experience designing scalable data models, data warehouses, lake houses, and enterprise analytics platforms.
• Hands-on experience with Azure cloud services and cloud-native architecture patterns.
• Expertise in building and managing CI/CD pipelines using Azure DevOps, GitHub, Jenkins, or similar tools.
• Experience implementing MLOps and LLMOps practices including model deployment, monitoring, governance, and lifecycle management.
• Knowledge of AI/ML workflows, Generative AI platforms, vector databases, and modern AI architectures.
• Strong understanding of data governance, data quality, security, and compliance frameworks.
• Experience working in Agile/Scrum delivery models and cross-functional teams.
• Ability to own solutions end-to-end from architecture design through deployment and operational support.
• Excellent analytical, troubleshooting, and problem-solving capabilities.
• Strong communication and stakeholder management skills.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.