Principal Engineer - Data Platform

BuildxPartners; Bengaluru Urban; On-site; INR 2,400,000 - 4,200,000; Full time

Job summary

BuildxPartners is a global talent solutions firm delivering recruitment and workforce solutions across industries. Our client is a cloud security leader enabling zero-trust architectures and compliant, secure digital transformation.

We seek a seasoned Backend Engineer for the Data Platform team to deliver ultra low-latency access to security insights and intelligence data. You will design scalable distributed systems, build real-time pipelines, and collaborate with cross-functional teams across

Qualifications

• BSCS or equivalent required; MSCS or equivalent strongly preferred.
• Experience designing and building distributed data platforms and pipelines.
• Hands-on with Big Data tech (Hadoop, Kafka) and modern data lake architectures.
• Proficiency in Snowflake, BigQuery, and Databricks.
• Cloud exposure on AWS/GCP and distributed storage systems.

Responsibilities

• Build next-generation data pipelines for near real-time ingestion of security insights.
• Design and scale distributed backend systems powering data platforms.
• Collaborate with security, product, and engineering teams to solve complex problems.
• Evaluate open-source technologies and drive architecture initiatives.
• Influence overall system architecture and engineering best practices.

Skills

Backend engineering

Distributed systems

Data platform architecture

Cloud-native data infra

Concurrency and optimization

Go / Java

Education

BSCS or equivalent

MSCS or equivalent preferred

Tools

Snowflake

BigQuery

Databricks

Hadoop

Kafka

S3

GCS

Parquet

Iceberg

gRPC

Job description

Bangalore North, India | Posted on 27/02/2026

BuildxPartners is a global talent solutions firm delivering end-to-end recruitment and workforce solutions across industries and geographies.

BuildxAlpha – Executive & Leadership Search Focused on C-suite, board, and global executive hiring.

BuildxSigma – Comprehensive Talent Across Levels Covering junior, mid-level, and senior professionals.

BuildxGCC – Global Capability Center Solutions Specializing in Build, Operate, Transfer (BOT) model for Global Capability Centers, GCC supports companies in setting up, scaling, and transferring GCCs.

Job Description

About the Company:

Our client is a global leader in cloud security, offering advanced solutions that protect data, users, and applications across cloud and web environments. It focuses on enabling secure digital transformation through visibility, threat prevention, and data protection. The company’s innovative platform supports a zero-trust approach and helps enterprises maintain compliance while improving productivity. It’s known for a strong culture of innovation, collaboration, and employee growth.

Role Overview:

The Data Platform team is uniquely positioned at the intersection of security, big data, and cloud computing. We are responsible for providing ultra low-latency access to global security insights and intelligence data to our customers, enabling them to act in near real-time. We’re looking for a seasoned Backend Engineer with strong distributed systems experience and mandatory Data Platform architecture expertise to help us build next-generation data pipelines that provide near real-time ingestion of security insights and intelligence data using cloud and open-source data technologies.

Key Responsibilities:

• You will be part of a growing team of renowned industry experts in the exciting space of Data and Cloud Analytics.
• Your contributions will have a major impact on our global customer base and across the industry through our market-leading products.
• You will solve complex, interesting challenges and improve the depth and breadth of your technical and business skills.
• Build next-generation data pipelines for near real-time ingestion of security insights and intelligence data.
• Design, architect, and scale distributed backend systems that power high-throughput, low-latency data platforms.
• Drive Data Platform architecture initiatives leveraging technologies such as Snowflake, BigQuery, Databricks, and modern data lake ecosystems.
• Partner with industry experts in security, big data, product, and engineering teams to conceptualize, design, and build innovative solutions for complex customer problems.
• Evaluate open-source technologies to identify the best fit for platform needs and contribute to relevant ecosystems where applicable.
• Collaborate with other teams to architect their systems on top of the data platform and influence overall system architecture and best practices.

Required Skills:

• Strong Backend Engineering background with hands-on experience building and scaling distributed systems.
• Mandatory experience in Data Platform architecture and large-scale data infrastructure design.
• Hands-on exposure to Big Data technologies such as Hadoop, Kafka, and modern data lake architectures.
• Expertise in architecting and designing highly scalable, efficient, and fault-tolerant data pipelines for near real-time and real-time processing.
• Experience with Data Platform technologies such as Snowflake, BigQuery, and Databricks.
• Strong diagnostic and problem-solving skills with a demonstrated ability to simplify complex systems into elegant solutions.
• Cloud-native data infrastructure experience with AWS, GCP, or similar cloud platforms is a strong plus.
• Solid understanding of distributed object storage systems (e.g., S3, GCS), their architectures, consistency models, and scaling characteristics.
• Good to have experience in designing high-throughput, low-latency data services; experience with gRPC/RPC is a plus.
• Deep understanding of data formats such as Parquet and Iceberg, including partitioning, sorting, compression, and read performance optimization.
• Expert-level proficiency in Golang, Java, or similar languages with a strong understanding of concurrency, distributed computing, and system-level optimizations.
• Proven ability to influence technical direction and communicate with clarity.
• Willingness to work with a globally distributed team across different time zones.

Eligibility / Qualifications:

Education: BSCS or equivalent required, MSCS or equivalent strongly preferred