Sr Data Engineer

Nazztec group

Bengaluru

On-site

INR 2,500,000 - 4,000,000

Full time

20 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Nazztec group in Bengaluru is seeking a hands-on Senior Data Engineer to own the data engineering lifecycle from concept to deployment. You will design and optimize cloud-native data pipelines, real-time processing, and data platforms using Azure, Kubernetes, Docker, Dagster, Iceberg, Python, Java, SQL, and Go.

You will be responsible for building APIs and microservices, implementing IaC with Terraform, and ensuring robust observability with Grafana, Prometheus and ELK.

Qualifications

5+ years of professional data engineering experience.
Strong proficiency in Python, Java, and SQL.
Hands-on with Azure cloud, Kubernetes, Docker, and Terraform.
Experience building real-time and batch data pipelines and data platforms.
Familiarity with data governance, metadata, lineage and quality frameworks.

Responsibilities

Design, develop, and maintain scalable real-time and batch data pipelines.
Build data ingestion and processing workflows.
Develop APIs and asynchronous data services.
Optimize pipelines, storage, processing performance, scalability, and cloud costs.
Containerize applications and workloads using Docker.
Deploy and manage workloads using Kubernetes / AKS.
Create and manage Helm charts.
Implement Infrastructure-as-Code using Terraform.
Establish platform observability with logs, metrics, traces, and alerts.
Work with Grafana, Prometheus, ELK Stack and Filebeat for monitoring.

Skills

5+ years of professional data eng. exp

Python

Java

SQL

Docker

Terraform

Kubernetes

Azure

Golang

Data governance

Education

Bachelor's degree in Computer Science / IT / Data Engineering or related field

Tools

Dagster

AKS

ADLS Gen2

OpenTelemetry

Grafana

Prometheus

ELK Stack

Apache Iceberg

Next.js

React

TypeScript

Job description

Experience: 5+ Years

Employment Type: Full-Time

About the Role

We are looking for a Senior Data Engineer to join our team and work across the complete data engineering lifecycle—from concept and development through deployment and operations.

The role involves designing, building, and optimizing cloud-native data pipelines, real-time data processing solutions, APIs, microservices, and modern data platforms using Microsoft Azure, Kubernetes, Docker, Dagster, Apache Iceberg, Python, Java, SQL, and Golang.

This is a hands-on engineering role requiring strong expertise in data engineering, cloud platforms, containerization, DevOps, data architecture, and modern application development.

Key Responsibilities

Design, develop, and maintain scalable and resilient real-time and batch data pipelines.
Build data ingestion and processing workflows using:
ADLS Gen2
Develop APIs and asynchronous data services.
Optimize pipelines, storage, processing performance, scalability, and cloud costs.
Work with diverse data sources and implement reliable data integration solutions.
Containerize applications and workloads using Docker.
Deploy and manage workloads using Kubernetes / AKS.
Create and manage Helm charts.
Implement Infrastructure-as-Code using Terraform.
Implement platform observability through:
Logs
Metrics
Distributed traces
Alerts
Work with monitoring and observability tools such as Grafana, Prometheus, ELK Stack, and Filebeat.
Optimize platform scalability, failover, availability, and resource utilization.
Troubleshoot and resolve production/platform issues to maintain continuous availability.
Design and maintain canonical schemas and dimensional data models.
Manage schema evolution across data producers and consumers.
Implement data lineage, quality checks, SLAs, and data versioning.
Develop automated data validation and reconciliation frameworks.
Ensure data governance and quality across the data platform.
Work with metadata and governance tooling.

4. DevOps, CI/CD & Security

Design and manage CI/CD pipelines using:
GitHub Actions
Automate application deployment, testing, and operational workflows.
Implement Infrastructure-as-Code using Terraform.
Apply security-by-design principles.
Work with:
OAuth 2.0
Encryption at rest and in transit
RBAC / ABAC
Data masking
Secrets management
Ensure compliance with relevant data protection regulations such as GDPR and PDPA.

5. Full-Stack Application Development

Develop data-driven web applications, dashboards, and internal platform tools using:
Next.js
React
TypeScript
Build high-performance backend services and APIs using Golang (Go).
Develop RESTful and event-driven microservices.
Implement concurrency patterns and event-driven architectures.
Implement distributed tracing and telemetry using OpenTelemetry.

6. Collaboration & Technical Leadership

Collaborate with Data Engineering, Analytics, Cybersecurity, Product, and ML/AI teams.
Participate in architecture and design reviews.
Conduct code reviews and maintain engineering best practices.
Work as a bridge between Data Engineering and ML/AI initiatives.
Communicate effectively with both technical and business stakeholders.

Required Skills & Experience

5+ years of professional Data Engineering experience.
Strong proficiency in:
Python
Java
SQL
Strong experience in:
Data warehousing
Data processing
Data analysis
Data monitoring
Data governance
Hands-on experience with Microsoft Azure, particularly:
ADLS Gen2
Strong experience with:
Docker
Terraform
CI/CD
Knowledge of observability and monitoring tools:
Grafana
Elasticsearch
Kibana
Familiarity with Dagster orchestration.
Experience with Apache Iceberg is highly relevant.
Knowledge of data governance, metadata management, data lineage, and data quality frameworks.
Exposure to security practices including:
OAuth 2.0
RBAC / ABAC
Secrets management
Encryption
Data masking
Knowledge of GDPR / PDPA or similar data protection regulations.
Hands-on experience with Next.js / React / TypeScript.
Experience developing backend services and APIs using Golang (Go).
Experience with microservices, concurrency, REST APIs, and event-driven architectures.
Experience with OpenTelemetry / distributed tracing is preferred.
Strong communication and stakeholder-management skills.

Educational Qualifications

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline.
Cloud and/or Data Engineering certifications are preferred.

Domain Experience – Preferred

Experience in large-scale operational environments such as:

Aviation
Cargo Handling
Food Solutions
Logistics
Transportation
Supply Chain

Preferred Candidate Profile

We are looking for a hands-on Senior Data Engineer who can work across Data Engineering + Azure Cloud + Kubernetes + DevOps + Backend Engineering + modern data applications.

The ideal candidate should be comfortable working in an environment involving real-time data, cloud-native architectures, APIs, microservices, data platforms, observability, and ML/AI integration.

Personal Characteristics