Real-time Data Platform Software Engineer- Senior/Lead

Leadout Capital; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Leadout Capital is seeking a Senior Software Architect to design the Sales Intelligence Platform (SIP) powering Sales Cloud AI. You will own architecture, reliability, and performance for real-time ingestion and streaming pipelines.

The ideal candidate has 7+ years of distributed systems experience, cloud expertise (AWS/GCP/Azure), and a track record of leading teams and delivering enterprise-grade solutions.

Qualifications

• Degree in Computer Science (B.S. required, M.S. preferred).
• 7+ years architecting and managing durable distributed systems at scale.
• Proven track record in high-availability architectures for enterprise environments.
• Hands-on experience with big data pipelines using Flink.
• Experience as a CI/CD champion, mentoring teams in best practices and automation.
• Extensive knowledge of AWS/GCP/Azure and backend infrastructure.
• Proficiency in Java, Python, Go, or C++.
• Familiarity with infrastructure automation and AI-assisted development methodologies.
• Strong cross-functional leadership and communication.
• Commitment to technical excellence and mentorship.

Responsibilities

• Architect, develop, and operate a high-scale, low-latency SIP.
• Lead real-time ingestion and streaming pipelines for Sales Cloud AI.
• Mentor engineers and drive best practices across teams.

Skills

Distributed systems

High-scale architectures

Flink

Kafka

Java

Python

Go

CI/CD

Cloud platforms

Leadership

Mentorship

Communication

Education

B.S. in Computer Science

M.S. preferred

Tools

Kafka

Flink

Spark

Cassandra

Zookeeper

MongoDB

Docker

Kubernetes

Terraform

Spinnaker

Job description

Sales Cloud AI is revolutionizing how organizations strategize, execute, and refine their lead outreach and pipeline management. We are looking for engineers to develop the Sales Intelligence Platform (SIP) within Sales Cloud. In this role, you will be responsible for the architecture, development, and operation of a high-scale, low-latency platform that manages real-time ingestion and streaming pipelines.

Sales Intelligence Platform (SIP) processes conversational data from voice, video, and email to power various Sales Cloud AI agents. These agents provide tools for lead outreach and pipeline management, significantly boosting sales productivity. By generating intelligent insights from conversational data, the platform empowers sellers to enhance their overall efficiency.

Required skills and experience

• Degree in Computer Science (B.S. required, M.S. preferred) with a solid grasp of object-oriented design and principles.
• Over 7+ years of practical experience architecting, implementing, and managing durable distributed systems at scale for major enterprise cloud providers.
• Proven track record in constructing high-availability, large-scale distributed architectures for client-facing environments.
• Hands-on experience with building big data high availability pipelines with Flink
• Demonstrated experience acting as a CI/CD champion, with a proven ability to uplift and mentor teams in best practices and automation.
• Extensive knowledge of contemporary public cloud frameworks (including AWS, GCP, or Azure) and high-performance backend infrastructure.
• Proficiency in object-oriented programming with mastery in at least one language such as Java, Go, Python, C++, or Ruby.
• Familiarity with infrastructure automation, cloud provisioning, and AI-assisted development methodologies.
• Strong interpersonal and professional communication skills, with a focus on cross-functional collaboration and leadership.
• Commitment to technical excellence through meticulous attention to detail and proactive mentorship of junior engineers.

Preferred qualification

• Proven ability to develop low-latency, large-scale data ingestion pipelines
• Background in creating enterprise-grade, AI-driven sales solutions

• History of architecting distributed real-time streaming systems
• Expertise with message queuing technologies like Kafka
• Hands-on experience with open-source ecosystems including Flink, Spark, Storm, Cassandra, Zookeeper, and MongoDB
• At least 5 years of experience with Java, Spring, microservices, REST APIs, and distributed systems
• Knowledge of deployment architectures and CI/CD tools such as Jenkins, Terraform, and Spinnaker
• Familiarity with container orchestration platforms like Docker, Kubernetes, Helios, Fleet, or Mesos
• Experience managing and monitoring mission-critical infrastructure, including logging, alerting, and reporting services
• Proficiency in using NoSQL and SQL databases such as PostgreSQL and MongoDB
• Deep understanding of high-volume distributed databases, data pipelines, and large-scale systems