Data Engineer II

Zafin; Thiruvananthapuram; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Competitive salaries

Annual bonus potential

Generous paid time off

Paid volunteering days

Wellness benefits

Job summary

Zafin in Thiruvananthapuram seeks a skilled Data Engineer II to design, build, and scale robust data platforms. The ideal candidate will develop data pipelines, optimize infrastructure, and ensure data quality. Key responsibilities include integrating diverse data sources, managing data platforms like Spark and Snowflake, and enforcing data governance standards. Zafin offers competitive salaries, wellness benefits, and robust opportunities for career advancement. Join a diverse culture focused on teamwork and high-quality work.

Qualifications

• 5–8 years of experience in data engineering or related field.
• Strong programming skills in Python, Scala, or Java.
• Advanced proficiency in SQL and data modeling concepts.
• Experience building batch and real-time data pipelines.

Responsibilities

• Design and maintain scalable data pipelines for batch and real-time systems.
• Integrate data from diverse sources ensuring reliability and efficiency.
• Manage and optimize data platforms like Spark, Snowflake, and Kafka.
• Implement data validation frameworks and monitoring systems.
• Enforce data governance standards and ensure compliance.

Skills

Data engineering

Python

SQL

Apache Spark

Snowflake

Kafka

Airflow

Kubernetes

Job description

The world’s top banks use Zafin’s integrated platform to drive transformative customer value. Powered by an innovative AI-powered architecture, Zafin’s platform seamlessly unifies data from across the enterprise to accelerate product and pricing innovation, automate deal management and billing, and create personalized customer offerings that drive expansion and loyalty.

Zafin empowers banks to drive sustainable growth, strengthen their market position, and define the future of banking centered around customer value.

Role Overview

We are seeking a highly skilled Data Engineer II to design, build, and scale robust data platforms that power analytics and product use cases. This role requires strong ownership in developing data pipelines, optimizing infrastructure, and ensuring high standards of data quality, governance, and performance. The ideal candidate brings deep hands‑on experience with modern data technologies and thrives in a fast‑paced, product‑driven environment.

Key Responsibilities

• Design, build, and maintain scalable data pipelines for ingesting, transforming, and loading data across batch and real‑time (streaming) systems.
• Integrate data from diverse sources while ensuring reliability, scalability, and efficiency.

Data Modeling

• Design and implement optimized data models, warehouse schemas, and tables for analytics and reporting.
• Apply best practices in data architecture to support scalable data consumption.

Platform & Infrastructure Management

• Manage and optimize data platforms and infrastructure including Spark, Snowflake, Kafka, Airflow, and Kubernetes.
• Ensure high availability, scalability, and fault tolerance of data systems.

Data Quality & Observability

• Implement data validation frameworks, automated testing, and monitoring systems.
• Establish alerting mechanisms to ensure data freshness, accuracy, and completeness.

Governance & Security

• Enforce data governance standards including access controls, data lineage, and compliance.
• Ensure secure handling of sensitive data (PII) aligned with regulatory requirements.

Performance & Cost Optimization

• Optimize queries, partitioning strategies, file formats, and compute resources.
• Continuously improve system performance while managing infrastructure costs.

Tooling & Automation

• Develop and maintain CI/CD pipelines for data workflows.
• Build internal tools, reusable frameworks, and automation solutions to improve engineering productivity.

Required Skills & Qualifications

• 5–8 years of experience in data engineering or a related field.
• Strong programming skills in Python, Scala, or Java.
• Advanced proficiency in SQL and data modeling concepts.
• Hands‑on experience with:
  • Apache Spark (distributed data processing)
  • Snowflake or similar cloud data warehouses
  • Kafka or other streaming platforms
  • Airflow or similar orchestration tools
  • Kubernetes (container orchestration)
• Proven experience building both batch and real‑time data pipelines.
• Strong understanding of data quality, observability, and governance frameworks.

What’s in it for you

Joining our team means being part of a culture that values diversity, teamwork, and high‑quality work. We offer competitive salaries, annual bonus potential, generous paid time off, paid volunteering days, wellness benefits, and robust opportunities for professional growth and career advancement. Want to learn more about what you can look forward to during your career with us? Visit our careers site and our openings: zafin.com/careers

Zafin welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.

Zafin is committed to protecting the privacy and security of the personal information collected from all applicants throughout the recruitment process. The methods by which Zafin contains uses, stores, handles, retains, or discloses applicant information can be accessed by reviewing Zafin’s privacy policy at https://zafin.com/privacy-notice/. By submitting a job application, you confirm that you agree to the processing of your personal data by Zafin described in the candidate privacy notice.