R&D Staff Software Engineer

United States Digital Space LLC; Karnataka; On-site; INR 17,143,000 - 24,762,000; Full time

Job summary

Avi Analytics in Palo Alto, California, is hiring a Staff Engineer to architect high-performance, cloud-scale analytics and security solutions. You will lead distributed microservices for low-latency data processing and design durable data pipelines across OpenSearch, PostgreSQL, Redis, and Neo4j.

You will mentor junior engineers, drive engineering best practices, and collaborate with cross-border teams across India, Germany, and the USA to deliver resilient platforms.

Qualifications

• 12+ years of software development with a backend focus.
• Experience leading end-to-end product lifecycle from design to production.
• Expert in Go and Python; proficient in C++ for performance-critical components.
• Strong API design with gRPC/Protobuf and RESTful interfaces.
• Hands-on with OpenSearch/Elasticsearch, PostgreSQL, Redis, or Neo4j.

Responsibilities

• Architect and build high-performance, cloud-scale analytics and security solutions.
• Lead distributed microservices for low-latency data processing and high availability.
• Design durable data pipelines across polyglot storage with elastic scaling.
• Mentor engineers, conduct deep-dive code reviews, and enforce best practices.
• Collaborate across cross-border teams to deliver resilient platforms.

Skills

Go

Python

C++

Distributed systems

Backend design

Education

BS/MS in Engineering Computer Science

Tools

OpenSearch/Elasticsearch

PostgreSQL

Redis

Neo4j

gRPC & Protobuf

RESTful APIs

Kubernetes

Temporal

Job description

Join the Avi Analytics team to deliver high-scale performance monitoring, security, and intelligence telemetry for global enterprises. Beyond our core charter, this team has a storied history of innovation and an extensive patent portfolio. We foster a culture of intellectual curiosity turning creative ideas into tangible solutions.

You’ll fit right in if you're someone who adopts a first-principles approach to problem-solving, love deep-diving into distributed systems to optimize scale and performance, and enjoy the challenge of making data flow seamlessly at a massive scale.

This on-site position is based in Palo Alto, California. You will join a global, cross-border team of talented engineers operating across India, Germany, and the USA.

Key Responsibilities

As a Staff Engineer, you will be architecting and building high-performance, cloud-scale analytics and security solutions. You will play a critical role in envisioning and delivering highly resilient, microservices-based solutions that process massive streams of telemetry for application performance, security, and intelligence.

• Architectural Leadership: Lead the design and implementation of distributed microservices for low-latency data processing and high availability.
• Scale & Performance: Build and optimize data pipelines capable of handling millions of records, ensuring the platform scales elastically in hybrid environments.
• Tech Stack Orchestration: Leverage a sophisticated stack to build durable, stateful workflows to manage complex backend processes.
• Data Strategy: Design schemas and optimize queries across a polyglot persistence layer (OpenSearch, PostgreSQL, Redis, and Neo4j) to provide time sensistive insights to customers.
• Mentorship: Act as a key technical leader by conducting deep-dive code reviews, driving engineering best practices, and mentoring junior engineers.

Required Skills & Experience

Professional Experience

• Minimum of 12+ years of experience in software development with a focus on backend systems.
• Proven experience leading the end-to-end lifecycle of a product, from initial design to production deployment and maintenance.

Programming Proficiency

• Expert Level (GoLang & Python): Deep mastery of Go (concurrency, profiling, and performance tuning) and Python (data manipulation and backend services).
• Moderate Level (C++): Ability to maintain and optimize performance-critical components or interface with lower-level system libraries.

Cloud-Native Architecture & API Design

• Microservices at Scale: Proven experience designing and delivering production-grade microservices for high-throughput, cloud-scale environments.
• Communication Protocols: Proficiency in gRPC, Google Protocol Buffers (Protobuf), and RESTful API design, with a deep understanding of the HTTP/S stack.
• Data Persistence & Search: Hands-on experience with one or more of the following: OpenSearch/Elasticsearch, PostgreSQL, Redis, or Neo4j (or their equivalents).

Desired Skills & Qualifications

• Networking Domain Expertise: Strong understanding of L4–L7 networking, TCP/IP, HTTP/S protocols, and load-balancing principles.
• Advanced Data Engineering: Background in building data pipelines specifically for security and intelligence platforms (e.g., threat detection, anomaly detection, or predictive analytics).
• Analytics Background: Familiarity with time-series data, stream processing, and large-scale data visualization backend logic.
• Data Science Tools: Experience with data modeling and statistical analysis using Python libraries such as Pandas, NumPy, and Scikit-Learn.
• Orchestration: Working knowledge of Kubernetes and experience with Temporal (or similar workflow engines like Cadence) for managing distributed transactions.
• Education: BS/MS in Engineering Computer Science or a related technical field.

the company is proud to be an equal opportunity employer. We will consider qualified applicants without regard to race, color, creed, religion, sex, sexual orientation, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status or any other characteristic protected by federal, state, or local law. We will also consider qualified applicants with arrest and conviction records consistent with local law.