Senior Data Engineer

Helo.ai by VivaConnect; Mumbai; On-site; INR 2,500,000 - 5,000,000; Full time

Job summary

Helo.ai by VivaConnect in Mumbai is seeking a Senior Data/Software Engineer to lead design, development, and operation of our data platform and backend services. You will build scalable pipelines, optimize real-time processing, and ensure reliability for enterprise communication analytics.

You will mentor engineers, drive architecture decisions, and collaborate with cross-functional teams to deliver high-impact data solutions.

Qualifications

• Expert-level proficiency in Python and strong working knowledge of Java.
• Hands-on experience with PySpark, Airflow, Kafka, and distributed systems.
• Experience with SQL and NoSQL databases and cloud object storage.

Responsibilities

• Lead the design, development, and operation of Helo.ai's data platform and core backend services.
• Build scalable data pipelines and optimize real-time processing.
• Mentor data engineers and software developers to improve platform scalability and reliability.
• Collaborate with Product, DevOps, Analytics, and Engineering teams to deliver solutions.

Skills

Python

Java

PySpark

Airflow

Kafka

Distributed systems

SQL databases

NoSQL databases

Data modeling

CI/CD

Debugging

Education

B.E./B.Tech./MCA

CS Degree or equivalent

Tools

Docker

Kubernetes

PostgreSQL

MySQL

MongoDB

Redis

Linux

S3/GCS

Spark

AWS

GCP

Job description

Senior Data / Software Engineer

Helo.ai by VivaConnect

• Working Days: Monday to Friday
• Work Mode: Work from Office
• Experience: 7+ Years

About Helo.ai

We enable businesses to connect with their customers through powerful SMS, WhatsApp, RCS, Voice, and Contact Centre solutions.

• 25+ years of industry expertise
• 30+ billion engagements handled annually
• Partnerships with Meta, Google, and leading telecom operators

We power communication infrastructure for businesses that require scale, reliability, and seamless.

Why Build Your Career With Us

• Design and build enterprise-scale data platforms powering billions of customer interactions
• Own architecture decisions for a mature and profitable CPaaS platform
• Work with modern data engineering technologies and distributed systems
• Collaborate with Product, DevOps, Engineering, and Analytics teams
• Contribute directly to product innovation, platform scalability, and business growth

The Role You’ll Play

As a Senior Data / Software Engineer, you will lead the design, development, and operation of Helo.ai's data platform and core backend services. You will build scalable data pipelines, optimize real-time processing, and develop reliable systems that support enterprise communication products and analytics.

In addition to the responsibilities listed below, you should be open to taking up related initiatives that improve platform scalability, engineering efficiency, system reliability, and overall data quality.

What You’ll Be Driving

• Design, develop, and maintain production‑grade data pipelines for messaging events, billing, delivery logs, and campaign analytics
• Ensure scalable, reliable, and efficient data processing across platforms
• Maintain data quality, schema governance, lineage, and storage optimization
• Manage workflow orchestration using Apache Airflow; design and maintain Airflow DAGs, scheduling, monitoring, and recovery processes
• Develop and optimize Apache Spark (PySpark) workloads for batch and near real‑time processing
• Lead Python development standards and shared engineering libraries
• Maintain and enhance Java‑based microservices supporting messaging platforms
• Improve application performance, reliability, and maintainability
• Build analytics and reporting solutions for internal teams and enterprise customers
• Optimize data models and reporting performance
• Support cost optimization across data lakes and warehouse environments
• Implement monitoring, alerting, and observability for data platform health
• Troubleshoot production issues and optimize system performance
• Ensure platform stability and compliance with enterprise SLAs
• Mentor data engineers and software developers
• Collaborate with Product, DevOps, Analytics, and Engineering teams
• Participate in architecture discussions, code reviews, and technical planning

Technical Capability

• Expert‑level proficiency in Python with strong working knowledge of Java
• Hands‑on experience with Apache Spark (PySpark), Apache Airflow, and Apache Kafka
• Strong understanding of distributed systems, stream processing, and event‑driven architecture
• Experience with SQL databases (PostgreSQL, MySQL), NoSQL databases (MongoDB, Redis), and cloud object storage (S3/GCS)
• Proficiency with Docker, Kubernetes, Linux environments, and CI/CD pipelines
• Strong debugging, performance tuning, and data modelling skills

Preferred Expertise

• Experience with CPaaS, telecom, or high‑volume messaging platforms
• Familiarity with Delta Lake, Apache Iceberg, Hudi, and dbt
• Experience with AWS (EMR, Glue, Athena) or GCP (Dataproc, BigQuery, Pub/Sub)
• Knowledge of monitoring tools such as Prometheus, Grafana, and ELK Stack
• Understanding of enterprise SLAs, data privacy, and compliance standards

Professional Strengths

• Strong analytical and problem‑solving skills
• Architecture and systems‑thinking mindset
• Effective cross‑functional collaboration and stakeholder communication
• Mentorship and technical leadership capabilities
• Ability to manage large‑scale production systems with high reliability
• B.E., B.Tech., MCA, or equivalent qualification in Computer Science, Engineering, or a related field
• 7+ years of experience in Data Engineering, Backend Engineering, or Software Engineering
• Demonstrated experience owning end‑to‑end production data platforms and distributed systems

Indicators of Success

• Reliable and scalable data pipelines supporting enterprise‑grade workloads
• High platform availability with optimized performance and observability
• Efficient real‑time and batch data processing across distributed systems
• Strong engineering collaboration resulting in high‑quality, maintainable solutions

Performance & Growth

The role follows defined KPIs and KRAs to ensure clarity in responsibilities, support performance tracking, and recognize contributions toward platform scalability, engineering excellence, and business impact.

At Helo.ai, we celebrate diversity and are committed to building an inclusive and collaborative environment.