10x Software Engineer

Lucidya | لوسيديا; Riyadh; On-site; SAR 180,000 - 250,000; Full time

Job summary

A leading AI-powered Customer Experience Management platform in Riyadh is seeking an experienced DevOps Engineer to design and operate high-throughput, event-driven pipelines. The role requires hands-on experience with distributed systems and fault tolerance. You will optimize PostgreSQL and Elasticsearch for performance and build observability across large-scale systems. Ideal candidates are proactive in debugging and have experience with Rails or Python in production environments. Join us to make a real impact in a pre-IPO company with billions of events.

Qualifications

• Strong foundation in distributed systems.
• Hands-on experience with event-driven architecture.
• Deep comfort with concurrency and fault tolerance.
• Track record debugging complex production issues.
• Experience with Rails or Python backends at meaningful scale.

Responsibilities

• Design and operate high-throughput, event-driven pipelines.
• Diagnose and resolve complex production issues.
• Build and maintain observability across systems.
• Drive platform decoupling and service isolation.
• Contribute to Kubernetes migration and infrastructure modernization.

Skills

Distributed systems

Event-driven architecture

Concurrency and fault tolerance

Debugging complex issues

Rails or Python backends

Tools

Ruby on Rails

Python

PostgreSQL

Elasticsearch

Redis

RabbitMQ

Kubernetes

AWS

GCP

APISIX

Grafana

Loki

Job description

Lucidya is a leading AI-powered Customer Experience Management (CXM) platform in the MENA region, enabling enterprises to understand, engage, and serve customers across digital channels at scale.

Our Goals

• Extreme reliability (SLO-driven engineering)
• High-scale distributed processing (billions of data points)
• AI-native architecture (LLM + real-time intelligence)

What You Will Work On

Microservices & Distributed Architecture

• Design and operate high-throughput, event-driven pipelines across a 100+ microservice ecosystem handling billions of data points
• Build and scale distributed messaging systems with RabbitMQ, backpressure management, consumer scaling, and queue health
• Develop and maintain API gateway layers with advanced routing (multi-upstream, traffic splitting, environment isolation)
• Architect SSO and identity federation for enterprise clients, supporting multi-IdP routing with zero coupling to core services
• Define clean service boundaries across ingestion, processing, and delivery pipelines spanning Ruby and Python

Performance & Systems

• Diagnose and resolve complex production issues (e.g., deadlocks, queue exhaustion, connection pool saturation) — and eliminate root causes
• Optimize PostgreSQL for heavy write workloads, contention management, schema design, triggers, and connection scaling
• Design and tune Elasticsearch for search, indexing, and real-time Arabic relevance at scale
• Make informed trade-offs between multi-process and async architectures based on workload characteristics

Observability & Reliability

• Build and maintain observability across a large-scale system using Grafana, Loki, distributed tracing, and SLOs
• Own production incidents end-to-end, tracing failures across queues, search systems, and external integrations
• Lead root cause analysis and implement preventative measures across multi-service pipelines
• Build internal tooling that improves engineering velocity, automation, deployment gating, and review enforcement
• Turn architectural principles into enforceable standards and guardrails, not just documentation

Platform Evolution

• Drive platform decoupling and service isolation across the system
• Contribute to Kubernetes migration and infrastructure modernization
• Standardize and improve CI/CD pipelines across services

Stack

• Ruby on Rails
• Python
• PostgreSQL
• Elasticsearch
• Redis
• RabbitMQ
• Kubernetes
• AWS / GCP
• APISIX
• Grafana + Loki

What We Are Looking For

• Strong foundation in distributed systems. You understand failure modes before you write the first line
• Hands-on experience with event-driven architecture and message queues in production
• Deep comfort with concurrency, backpressure, and fault tolerance
• Track record debugging complex production issues — not just fixing them, preventing them
• Experience with Rails or Python backends at meaningful scale
• You improve systems you weren't asked to touch

This Role is a Strong Fit If You...

• Read and understand an existing codebase by week one
• See a broken system and fix it before anyone asks you to
• Have strong opinions about architecture and can back them up with data
• Think in systems: latency, throughput, failure modes, and cost at scale
• Treat documentation, tests, and observability as non-negotiable defaults and not afterthoughts
• Ship fast and without breaking things. Speed and quality are not a trade-off for you
• Consistently exceed expectations where meeting the bar is a floor, not a target
• Are hungry for hard challenges and actively seek problems at the edge of your limits
• Feel a sense of urgency that doesn't require external pressure
• Have rebuilt or stabilised something significant and can talk about it concretely

Why Lucidya

• Real scale with billions of events and not just toy systems
• Direct impact at CTO and executive level
• Pre-IPO with clear trajectory and your work has real impact on clients