Principal Data Engineer

Kmart Group; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Kmart Group is looking for a Principal Data Engineer based in Bengaluru, India. The ideal candidate will possess 10 to 15 years of experience in data engineering, proficient in multiple programming languages and cloud platforms.

The role involves working on innovative tech projects that support retail brands and enables a rewarding work environment. Kmart Group celebrates diversity and offers a safe and inclusive workplace for all employees.

Qualifications

• 10 to 15 years of experience in data engineering.
• Strong grasp of compute, storage, networking, IAM, and FinOps principles.
• Experience with advanced SQL and data modeling patterns.

Responsibilities

• Collaborate globally around tech to support retail brands.
• Work on projects that provide challenging and rewarding tasks.
• Contribute to creating inclusive and safe environments.

Skills

Multi-cloud fluency across AWS, GCP, and Azure

Experience with cloud data warehouses

Proficient in Python/Java/Scala

Hands-on experience with Kafka and real-time processing

dbt for transformation and testing

Containerization with Docker and Kubernetes

ML lifecycle management with MLflow or Kubeflow

Job description

Search by keyword (Marketing, Technology etc.)

At Anko you’ll be joining a diverse team who come together to collaborate globally around tech. We are an innovation hub that powers and supports our retail brands. You’ll feel the impact of the work you’ll do for our millions of customers and team members every day. Our brands are focused on being customer‑led, digitally enabled retailers, providing you with challenging and rewarding work that you will be proud of. Join our team, choose your own path and work on projects that excite you.

Role: Principal Data Engineer

Experience: 10 to 15 years

Technical skills required:

• Cloud Platforms — Multi‑cloud fluency across AWS, GCP, and Azure; with strong grasp of compute, storage, networking, IAM, and FinOps principles
• Data Warehousing & SQL — Experience with cloud data warehouses (Snowflake, BigQuery, Databricks SQL); query engines (Trino, Spark SQL); advanced SQL and data modeling patterns (lakehouse, data vault, dimensional modeling)
• Programming Languages — Proficient in Python/Java/Scala for data engineering, ML pipelines, and distributed systems; SQL for advanced analytics and performance tuning
• Streaming & Messaging — Hands‑on experience with Kafka, Kafka Streams, KSQLDB, and Kafka Connect (Confluent preferred); real‑time processing using Apache Flink or Spark Structured Streaming; schema management with Avro or Protobuf
• Data Quality, Transformation & Governance — dbt for transformation and testing; data quality frameworks (Great Expectations, Soda); open table formats (Iceberg, Delta Lake); data cataloging and lineage (DataHub, OpenLineage); GDPR and CCPA compliance
• DevOps & Orchestration — Containerization with Docker and Kubernetes; CI/CD pipelines (Jenkins, GitHub Actions); workflow orchestration using Airflow, Prefect, or Dagster; infrastructure as code with Terraform or Pulumi
• Knowledge working with ML & AI Platform — ML lifecycle management with MLflow or Kubeflow; feature store; model serving (Ray Serve, Triton, BentoML); LLM/GenAI platforms including RAG pipelines, vector databases, and AI gateways

A place you can belong:

We celebrate the rich diversity of the communities in which we operate and are committed to creating inclusive and safe environments where all our team members can contribute and succeed. We believe that all team members should feel valued, respected, and safe irrespective of your gender, ethnicity, indigeneity, religious beliefs, education, age, disability, family responsibilities, sexual orientation and gender identity and we encourage applications from all candidates.