Principal Real-Time Big Data Engineer

Xander Talent; California, Northern (MO, KY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Xander Talent Client is expanding its Platform and TLB Team to build a Spark-like, in-memory time-series processing system for terabytes of data with sub-second latency. The Principal Engineer will shape architecture, lead features, and implement scalable services in Scala and Rust on Kubernetes containers.

You will collaborate across a worldwide team, push technology innovation, and deliver high-impact solutions that power multiple verticals and real-time analytics.

Qualifications

• 14+ years of software development experience in data processing products.
• Engineering degree in software or equivalent from a premier institute.
• Proficient in Rust/Scala/Haskell/Erlang with reliable, secure, performant code.
• Experience with actor models (Akka/Actix) and microservice architectures.

Responsibilities

• Design, build and maintain stream processing and time-series analysis system at the core of Xander Talent Client products.
• Own architecture of the platform and its services.
• Develop features and bug fixes in Scala and Rust on a Jenkins-based pipeline deployed as Docker containers on Kubernetes.
• Lead a team to deliver product features and ensure quality.

Skills

Rust

Scala

Haskell

Erlang

Algorithms & Data Structures

Distributed Systems

Functional Programming

Communication Skills

Education

Engineering degree in software

Tools

Akka

Lagom

RxJava/Project Reactor

Spark

Flink

Kafka

Druid

HDFS

Job description

Xander Talent Client is expanding its Platform and TLB Team to build a Spark-like, in-memory time-series processing system for terabytes of data with sub-second latency. The Principal Engineer will shape architecture, lead features, and implement scalable services in Scala and Rust on Kubernetes containers.

You will collaborate across a worldwide team, push technology innovation, and deliver high-impact solutions that power multiple verticals and real-time analytics.