AWS Data Engineer - Data Platform

AVP; Pune District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Zinnia, a leading life and annuities tech platform, is seeking a Data Engineer to build the data foundation that powers analytics and ML use cases. You will design scalable pipelines, ensure data quality, and rely on SQL, Python, and AWS to deliver reliable, well-tested data products.

You will work with Terraform, Snowflake, Airflow, dbt, Airbyte, and containerized services (Docker/Kubernetes), implementing telemetry, governance, and cost-optimization practices.

Qualifications

• Strong experience building data platforms and pipelines.
• Proficient in SQL and Python with cloud-based data services.
• Hands-on with AWS core services and infrastructure as code.
• Experience with Snowflake, Airflow, dbt, and ELT/ETL tooling.
• Familiarity with containerization (Docker, Kubernetes) and CI/CD for data pipelines.
• Knowledge of data governance, telemetry, and observability.
• Experience with streaming data (Kafka/Kinesis) is a plus.

Responsibilities

• Build and maintain scalable data platforms and pipelines for analytics.
• Develop and operate AWS infrastructure, IAM, S3, Lambda, RDS/Aurora.
• Implement telemetry, monitoring, and data quality checks.
• Manage Terraform-based infrastructure and Snowflake warehousing.
• Develop ELT/ETL workflows using Airflow, dbt, and Airbyte.
• Containerize services and manage Kubernetes/EKS deployments.
• Support data governance and cost optimization in AWS/Snowflake.
• Troubleshoot pipeline and infrastructure issues with senior engineers.
• Write clear documentation and follow established technical standards.
• Develop and maintain ELT/ETL workflows for self-serve data access.

Skills

SQL

Python

AWS

Data pipelines

ETL/ELT

Airflow

dbt

Airbyte

Kubernetes

Docker

Terraform

Snowflake

Kafka/Kinesis

CI/CD

GitHub Actions

Data governance

Observability

Tools

Docker

Kubernetes

Terraform

Snowflake

Airflow

dbt

Airbyte

GitHub Actions

Kafka/Kinesis

Job description

WHO WE ARE:

Zinnia is the leading technology platform for accelerating life and annuities growth. With innovative enterprise solutions and data insights, Zinnia simplifies the experience of buying, selling, and administering insurance products. All of which enables more people to protect their financial futures. Our success is driven by a commitment to three core values: be bold, team up, deliver value – and that we do. Zinnia has over $180 billion in assets under administration, serves 100+ carrier clients, 2500 distributors and partners, and over 2 million policyholders.

WHO YOU ARE:

You are a Data Engineer who wants to go deep on platform and infrastructure work — building the pipelines, storage, and platform foundations that the rest of the business builds on. You think in terms of well-modeled data, reliable orchestration, and infrastructure that holds up under real production load.

You are good with SQL and Python, know your way around AWS core services, and can take a clear set of requirements and turn them into solid, well-tested outcomes. You are curious about how data platforms can be setup, scaled, integrated in the wider application ecosystem and resulting data feeds downstream analytics and machine learning use cases.

WHAT YOU’LL DO:

• Build and maintain scalable, reliable data platforms and pipelines that power analytics and data-driven products across Zinnia.
• Work within the data platform's AWS infrastructure - storage, IAM, compute and orchestration services - implementing and tuning components under the guidance of senior engineers.
• Implement and integrate with telemetry and observability solutions for Infrastructure and Platform reliability.
• Provision and modify data infrastructure components (S3 buckets, IAM roles, Lambda, RDS/Aurora, compute resources) using Terraform, including Snowflake infrastructure-as-code (warehouses, roles, databases), working from existing modules and patterns.
• Familiarity with streaming or event-driven data (Kafka, Kinesis, or similar)
• Package, deploy, and manage pipeline components as containerized services (ex: Docker, Kubernetes/EKS, ECS), including EKS cluster upgrades and configuration changes
• Implement data quality checks, monitoring, and basic lineage so downstream teams can trust the data they're consuming.
• Contribute to data governance, access control, and cost-optimization practices within AWS and Snowflake.
• Troubleshoot pipeline and infrastructure issues, escalating and collaborating with senior engineers on complex or systemic problems.
• Write clear documentation and follow established technical standards for the data platform.
• Develop and maintain ELT/ETL workflows using Airflow, dbt, and Airbyte (or similar ingestion tools) for self-serve data access
• Familiarity with AI-assisted engineering tools and platforms (e.g., Claude, Cortex Code), LLM-based workflows, and agentic automation to support infrastructure and platform changes
• Clear written and verbal communication skills.

Nice to have:

• Exposure to MLOps concepts - training data pipelines, feature generation, or model monitoring data.
• Experience with Airbyte or similar ELT ingestion tools.
• Familiarity with CI/CD practices for data pipelines, including building and maintaining GitHub repositories and GitHub Actions pipelines.
• Experience in a regulated industry such as insurance or financial services.

WHAT’S IN IT FOR YOU?

At Zinnia, you collaborate with smart, creative professionals who are dedicated to delivering cutting-edge technologies, deeper data insights, and enhanced services to transform how insurance is done. Visit our website at www.zinnia.com for more information. We are an Equal Opportunity employer committed to a diverse workforce. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability.

#LI-RS1

#LI-S