AWS Data Engineer - Data Platform

AVP; Hyderabad; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Zinnia is seeking a Data Engineer to build scalable data platforms and pipelines, focusing on infrastructure and production-ready data flows that power analytics and ML use cases.

You will work with AWS core services, Terraform, and containerized services (Docker, Kubernetes), implement data quality checks, and contribute to governance and cost optimization.

Qualifications

• Proficient in SQL and Python.

Responsibilities

• Build and maintain scalable, reliable data platforms and pipelines that power analytics and data-driven products.
• Work within the data platform's AWS infrastructure - storage, IAM, compute and orchestration services - implementing and tuning components.
• Implement and integrate with telemetry and observability solutions for Infrastructure and Platform reliability.
• Provision and modify data infrastructure components (S3 buckets, IAM roles, Lambda, RDS/Aurora, compute resources) using Terraform, including Snowflake infrastructure-as-code (warehouses, roles, databases).
• Familiarity with streaming or event-driven data (Kafka, Kinesis, or similar).
• Package, deploy, and manage pipeline components as containerized services (Docker, Kubernetes/EKS, ECS).
• Implement data quality checks, monitoring, and basic lineage so downstream teams can trust the data they're consuming.
• Contribute to data governance, access control, and cost-optimization practices within AWS and Snowflake.
• Troubleshoot pipeline and infrastructure issues, escalating and collaborating with senior engineers on complex or systemic problems.
• Write clear documentation and follow established technical standards for the data platform.
• Develop and maintain ELT/ETL workflows using Airflow, dbt, and Airbyte (or similar ingestion tools).
• Familiarity with AI-assisted engineering tools and platforms (e.g., Claude, Cortex Code), LLM-based workflows, and agentic automation to support infrastructure and platform changes
• Clear written and verbal communication skills.

Skills

SQL

Python

Tools

AWS core services

Terraform

Snowflake

Kafka

Kinesis

Docker

Kubernetes

EKS

ECS

Airflow

dbt

Airbyte

Job description

WHO WE ARE:

Zinnia is the leading technology platform for accelerating life and annuities growth. With innovative enterprise solutions and data insights, Zinnia simplifies the experience of buying, selling, and administering insurance products. All of which enables more people to protect their financial futures. Our success is driven by a commitment to three core values: be bold, team up, deliver value – and that we do. Zinnia has over $180 billion in assets under administration, serves 100+ carrier clients, 2500 distributors and partners, and over 2 million policyholders.

WHO YOU ARE:

You are a Data Engineer who wants to go deep on platform and infrastructure work — building the pipelines, storage, and platform foundations that the rest of the business builds on. You think in terms of well-modeled data, reliable orchestration, and infrastructure that holds up under real production load.

You are good with SQL and Python, know your way around AWS core services, and can take a clear set of requirements and turn them into solid, well-tested outcomes. You are curious about how data platforms can be setup, scaled, integrated in the wider application ecosystem and resulting data feeds downstream analytics and machine learning use cases.

WHAT YOU’LL DO:

• Build and maintain scalable, reliable data platforms and pipelines that power analytics and data-driven products across Zinnia.
• Work within the data platform's AWS infrastructure - storage, IAM, compute and orchestration services - implementing and tuning components under the guidance of senior engineers.
• Implement and integrate with telemetry and observability solutions for Infrastructure and Platform reliability.
• Provision and modify data infrastructure components (S3 buckets, IAM roles, Lambda, RDS/Aurora, compute resources) using Terraform, including Snowflake infrastructure-as-code (warehouses, roles, databases), working from existing modules and patterns.
• Familiarity with streaming or event-driven data (Kafka, Kinesis, or similar)
• Package, deploy, and manage pipeline components as containerized services (ex: Docker, Kubernetes/EKS, ECS), including EKS cluster upgrades and configuration changes
• Implement data quality checks, monitoring, and basic lineage so downstream teams can trust the data they're consuming.
• Contribute to data governance, access control, and cost-optimization practices within AWS and Snowflake.
• Troubleshoot pipeline and infrastructure issues, escalating and collaborating with senior engineers on complex or systemic problems.
• Write clear documentation and follow established technical standards for the data platform.
• Develop and maintain ELT/ETL workflows using Airflow, dbt, and Airbyte (or similar ingestion tools) for self-serve data access
• Familiarity with AI-assisted engineering tools and platforms (e.g., Claude, Cortex Code), LLM-based workflows, and agentic automation to support infrastructure and platform changes
• Clear written and verbal communication skills.

Nice to have:

• Exposure to MLOps concepts - training data pipelines, feature generation, or model monitoring data.
• Experience with Airbyte or similar ELT ingestion tools.
• Familiarity with CI/CD practices for data pipelines, including building and maintaining GitHub repositories and GitHub Actions pipelines.
• Experience in a regulated industry such as insurance or financial services.

WHAT’S IN IT FOR YOU?

At Zinnia, you collaborate with smart, creative professionals who are dedicated to delivering cutting-edge technologies, deeper data insights, and enhanced services to transform how insurance is done. Visit our website at www.zinnia.com for more information. We are an Equal Opportunity employer committed to a diverse workforce. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability.

#LI-RS1

#LI-S