Software Engineer

Realmlabs; Sunnyvale (CA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Meaningful equity

Job summary

Realm Labs is building the infrastructure that makes AI safe for enterprises. As a Software Engineer, you will craft production systems that power enterprise AI deployments, spanning backend services, distributed systems, infrastructure, and customer-facing features.

Your work will include designing scalable backend services, APIs, and data models; integrating with cloud providers; and improving reliability with observability while collaborating with product and AI teams to deliver features

Qualifications

• 2+ years of professional software engineering experience.
• Strong programming in Python, Go, Java, or C++.
• Experience with REST or gRPC APIs.
• Experience with relational databases (PostgreSQL/MySQL).
• Knowledge of distributed systems concepts.

Responsibilities

• Build scalable backend services in Python or Go.
• Develop APIs and internal services for enterprise customers.
• Work with distributed systems, queues and asynchronous processing.
• Design efficient database schemas and optimize queries.
• Build integrations with cloud services and AI platforms.
• Drive reliability through debugging and observability.
• Collaborate with product, infra, and AI engineers.
• Participate in code reviews to maintain engineering standards.

Skills

Python/Go/Java/C++

REST/gRPC APIs

Relational Databases

Distributed Systems

Cloud Platforms

Debugging/Problem-Solving

Communication Skills

Tools

Docker

Kubernetes

OpenTelemetry

Prometheus

Grafana

Redis

Kafka

RabbitMQ

PostgreSQL

MySQL

Job description

About Realm Labs

Realm Labs is building the infrastructure that makes AI safe for enterprises. Our platform helps organizations securely deploy, monitor, and govern AI applications through real-time detection, policy enforcement, and security controls.

Our systems process billions of AI tokens across production workloads and solve challenging problems in distributed systems, inference infrastructure, security, and developer tooling.

We’re a small, engineering-driven team where every engineer owns meaningful pieces of the product and works directly with customers.

What You’ll Do

As a Software Engineer at Realm Labs, you’ll build production systems that power enterprise AI deployments. Your work will span backend services, distributed systems, infrastructure, and customer-facing features.

Responsibilities include:

• Design and build scalable backend services in Python or Go.
• Develop APIs and internal services used by enterprise customers.
• Work with distributed systems, asynchronous processing, and message queues.
• Design efficient database schemas and optimize query performance.
• Build reliable integrations with cloud services and AI platforms.
• Debug production issues and improve system reliability and observability.
• Collaborate closely with product, infrastructure, and AI engineers to ship features quickly.
• Participate in code reviews and help maintain a high engineering bar.

What We’re Looking For

Required

• 2+ years of professional software engineering experience.
• Strong programming skills in Python, Go, Java, C++, or a similar language.
• Solid understanding of computer science fundamentals, including:
  • Data structures and algorithms
  • Operating systems
  • Concurrency and multithreading
• Experience designing and consuming REST or gRPC APIs.
• Experience working with relational databases such as PostgreSQL or MySQL.
• Understanding of distributed systems concepts such as replication, consistency, caching, partitioning, queues, and fault tolerance.
• Experience with cloud platforms (AWS, GCP, or Azure).
• Strong debugging and problem-solving skills.
• Excellent communication skills and ability to work in a fast-moving startup.

Nice to Have

• Experience building distributed systems at scale.
• Experience with Docker and Kubernetes.
• Familiarity with Redis, RabbitMQ, Kafka, or similar technologies.
• Experience with observability tools (OpenTelemetry, Prometheus, Grafana).
• Experience with AI/LLM infrastructure.
• Experience working in startups or shipping customer-facing products.

Technologies We Use

You don’t need experience with everything below, but you’ll likely work with many of them:

• Python
• Go
• PostgreSQL
• Redis
• Docker & Kubernetes
• AWS, GCP, Azure
• FastAPI
• Terraform
• GitHub Actions
• OpenTelemetry
• LLM APIs and inference infrastructure

What We Value

We’re looking for engineers who:

• Take ownership from idea to production.
• Care about writing clean, maintainable code.
• Think systematically about reliability and scalability.
• Enjoy learning new technologies.
• Move quickly without sacrificing quality.
• Are excited about building products in the AI infrastructure and security space.

Why Join Realm Labs?

• Build foundational infrastructure for the next generation of AI applications.
• Solve challenging distributed systems and infrastructure problems.
• Work directly with experienced engineers from companies like Google, Apple, Microsoft, and leading security organizations.
• High ownership with significant impact from day one.
• Competitive salary and meaningful equity.
• Opportunity to help define the future of enterprise AI security.