Senior Data Platform Engineer

RBM Software Inc.; Pune District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

RBM Software Inc. is seeking a Senior Platform Engineer to join our data/platform engineering team. You will design, build, and scale the infrastructure powering our data platform, with a strong emphasis on reliability, performance, and cost efficiency in distributed, cloud-native environments.

The role supports two skill tracks (Spark + AWS or AWS + Go) and requires 5–9 years in distributed systems. You’ll own end-to-end pipelines, orchestrations with Airflow, and serverless components on AWS,

Qualifications

• 5–9 years of overall engineering experience with significant exposure to distributed systems.
• Proven experience in performance optimization—profiling, tuning, and scaling systems under load.
• Strong understanding of cloud infrastructure, orchestration, and event-driven architectures.
• Solid debugging and problem-solving skills in production environments.
• Good understanding of data pipeline design, fault tolerance, and system reliability practices.

Responsibilities

• Design, build, and maintain scalable, reliable, and high-performance data/platform infrastructure on AWS.
• Architect and optimize distributed data processing pipelines to handle large volumes of data efficiently.
• Own end-to-end orchestration workflows using Airflow, and manage serverless components via AWS Lambda and Glue.
• Work closely with data engineering and product teams to translate business requirements into robust technical solutions.
• Identify performance bottlenecks and drive optimization efforts across compute, storage, and orchestration layers.
• Ensure platform reliability, scalability, and cost-efficiency through sound architectural decisions.
• Contribute to code reviews, technical design discussions, and best practices for distributed systems.
• Troubleshoot and resolve production issues, ensuring high availability of platform services.
• Mentor junior engineers and contribute to raising the technical bar across the team.

Skills

Apache Spark

AWS

Airflow

AWS Glue

AWS Lambda

S3

Go

Distributed systems

Tools

Terraform

CloudFormation

Datadog

Prometheus

CloudWatch

Job description

Employment Type: Full-Time

About the Role

We are looking for a Senior Platform Engineer to join our data/platform engineering team. This role is ideal for someone who has worked extensively on distributed systems, cloud-native architectures on AWS, and has hands‑on experience building and optimizing large-scale data or platform pipelines. You will play a key role in designing, building, and scaling the infrastructure and tooling that powers our data platform.

We're open to candidates from either of the following skill backgrounds:

• Option A: Strong in Spark + AWS (Glue, Lambda, Airflow, S3)
• Option B: Strong in AWS (Glue, Lambda, Airflow, S3) + Go

Key Responsibilities

• Design, build, and maintain scalable, reliable, and high-performance data/platform infrastructure on AWS.
• Architect and optimize distributed data processing pipelines to handle large volumes of data efficiently.
• Own end-to-end orchestration workflows using Airflow, and manage serverless components via AWS Lambda and Glue.
• Work closely with data engineering and product teams to translate business requirements into robust technical solutions.
• Identify performance bottlenecks and drive optimization efforts across compute, storage, and orchestration layers.
• Ensure platform reliability, scalability, and cost-efficiency through sound architectural decisions.
• Contribute to code reviews, technical design discussions, and best practices for distributed systems.
• Troubleshoot and resolve production issues, ensuring high availability of platform services.
• Mentor junior engineers and contribute to raising the technical bar across the team.

Required Skills

Choose one of the two tracks below:

Option A

• Strong hands‑on experience with Apache Spark (batch/streaming data processing)
• Solid working knowledge of AWS, including Glue, Lambda, Airflow, and S3

Option B

• Strong working knowledge of AWS, including Glue, Lambda, Airflow, and S3
• Proficiency in Go for building performant backend/platform services

Common Requirements (Both Tracks)

• 5–9 years of overall engineering experience, with significant exposure to distributed systems
• Proven experience in performance optimization — profiling, tuning, and scaling systems under load
• Strong understanding of cloud infrastructure, orchestration, and event-driven architectures
• Solid debugging and problem‑solving skills in production environments
• Good understanding of data pipeline design, fault tolerance, and system reliability practices

Good to Have

• Experience with Infrastructure-as-Code tools (Terraform, CloudFormation)
• Exposure to monitoring/observability tools (CloudWatch, Datadog, Prometheus, etc.)
• Familiarity with CI/CD pipelines for data/platform deployments
• Prior experience in a high‑growth or fast‑paced product environment

What We're Looking For

Someone who thinks like a systems engineer — comfortable diving deep into performance issues, making sound architectural trade-offs, and building infrastructure that scales reliably. You should be equally comfortable writing code and reasoning about system design.