MI Data -Apache Druid + Trino

Culminant; India; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Culminant is seeking a senior expert to own distributed data platform engineering. You will design and operate real-time and batch ingestion pipelines, optimize large-scale Druid/Trino deployments, and build automation tooling for deployment, monitoring, and reliability.

Ideal candidates have 5+ years in data engineering or platform engineering, strong Python skills, and hands-on experience with cloud, containers, and CI/CD pipelines.

Qualifications

• 5+ years of hands-on experience with real-time data processing and distributed data platforms.
• Strong expertise in Apache Druid, Trino, and large-scale ingestion/transform pipelines.
• Proficient in Python for automation and backend development.
• Experience with DevOps practices, CI/CD pipelines, and cloud deployments.
• Ability to optimize queries, memory usage, and performance in distributed systems.

Responsibilities

• Design, implement, and operate real-time and batch data ingestion and processing pipelines.
• Manage cluster setup, configuration, and production operations for large Druid/Trino deployments.
• Optimize query performance, memory management, and workload isolation.
• Develop tooling for deployment, monitoring, and operational workflows.
• Ensure security, observability, and incident response for data workloads.

Skills

Apache Druid

Trino

DevOps

Kubernetes

Python

REST APIs

Scripting

Data processing libraries

CI/CD

Cloud platforms (AWS/GCP/Azure)

Docker

Infrastructure as Code

Terraform

CloudFormation

GitHub Actions

GitLab CI

Jenkins

ArgoCD

Helm charts

Observability

Monitoring/Logging

Tools

Docker

Kubernetes

Helm charts

Kubernetes operators

Terraform

CloudFormation

GitHub Actions

GitLab CI

Jenkins

ArgoCD

Job description

Primary skills::Apache+Druid+Trino+Devops+Kubernets+Python Exp:: 5 to 10 years Job location-Bangalore/HYD/Pune/Mumbai/Chennai

Skill Sets Required: Core Technical Skills

• Apache Druid
• Cluster setup, configuration, and production operations
• Real-time and batch ingestion (Kafka, streaming tasks, indexing services)
• Segment management, compaction, retention, and query optimization
• Troubleshooting performance and availability issues
• Trino Cluster deployment and tuning for large-scale distributed queries
• Connector configuration (Hive, Iceberg, Delta Lake, JDBC, etc.)
• Query optimization, memory management, and workload isolation
• Security configuration (authentication, authorization, access control)
• Python
• Strong proficiency in Python for automation and backend services
• Writing clean, maintainable, production-grade code
• Building tooling for deployment, monitoring, and operational workflows
• Experience with REST APIs, scripting, and data processing libraries
• DevOps & Platform Engineering
• Containerization & Orchestration
• Docker image creation and optimization
• Kubernetes deployment, scaling, and troubleshooting
• Helm charts and Kubernetes operators (preferred)
• Infrastructure & CI/CD
• Infrastructure as Code using Terraform, CloudFormation, or similar
• CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, ArgoCD, etc.)
• Blue-green and rolling deployment strategies
• Cloud Platforms
• Hands-on experience with AWS, GCP, or Azure
• Networking, storage, and compute optimization for data workloads
• Cost monitoring and optimization
• Observability & Operations
• Monitoring and alerting using Prometheus, Grafana, ELK, OpenTelemetry, or similar
• Log aggregation, metrics, and distributed tracing
• Incident management, root cause analysis, and postmortems
• Capacity planning and performance benchmarking