Engineer, Principal (BigData)

Xander Talent; California, Northern (MO, KY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Xander Talent Client is expanding its Platform and TLB Team to build a Spark-like, in-memory time-series processing system for terabytes of data with sub-second latency. The Principal Engineer will shape architecture, lead features, and implement scalable services in Scala and Rust on Kubernetes containers.

You will collaborate across a worldwide team, push technology innovation, and deliver high-impact solutions that power multiple verticals and real-time analytics.

Qualifications

• 14+ years of software development experience in data processing products.
• Engineering degree in software or equivalent from a premier institute.
• Proficient in Rust/Scala/Haskell/Erlang with reliable, secure, performant code.
• Experience with actor models (Akka/Actix) and microservice architectures.

Responsibilities

• Design, build and maintain stream processing and time-series analysis system at the core of Xander Talent Client products.
• Own architecture of the platform and its services.
• Develop features and bug fixes in Scala and Rust on a Jenkins-based pipeline deployed as Docker containers on Kubernetes.
• Lead a team to deliver product features and ensure quality.

Skills

Rust

Scala

Haskell

Erlang

Algorithms & Data Structures

Distributed Systems

Functional Programming

Communication Skills

Education

Engineering degree in software

Tools

Akka

Lagom

RxJava/Project Reactor

Spark

Flink

Kafka

Druid

HDFS

Job description

As Xander Talent Client is expanding, we are building products providing deep insights into end user experience for our customers. We are seeking a Principal Engineer to join the Platform and TLB Team as an Individual Contributor. The vision for the TLB team is to build data processing software that works on terabytes of streaming data in real time. Engineer the next-gen Spark-like system for in-memory computation of large time-series dataset's – both Spark-like backend infra and library based programming model. Build horizontally and vertically scalable system that analyses trillions of events per day within sub second latencies. Utilize the latest and greatest of big data technologies to build solutions for use-cases across multiple verticals. Lead technology innovation and advancement that will have big business impact for years to come. Be part of a worldwide team building software using the latest technologies and the best of software development tools and processes.

Qualifications:

• 14+ years of work experience in software development of data processing products.
• Engineering degree in software or equivalent from a premier institute.
• Excellent knowledge of fundamentals of Computer Science like algorithms and data structures. Hands-on with functional programming and know-how of its concepts
• Excellent programming and debugging skills. Proficient in writing code in Rust/Scala /Haskell/Erlang that is reliable, maintainable, secure, and performant
• Experience/knowledge of actor model of concurrency (Akka in Scala or Actix in Rust) is a big plus. Knowledge of design patterns like event-streaming, CQRS and DDD to build large microservice architectures will be a big plus
• Experience with big data technologies like Spark, Flink, Kafka, Druid, HDFS etc.
• Deep understanding of distributed systems concepts and scalability challenges including multi-threading, concurrency, sharding, partitioning etc.
• Experience/knowledge of Akka/ Lagom framework and/or stream processing technologies like RxJava or Project Reactor will be a big plus. Knowledge of design patterns like event-streaming, CQRS and DDD to build large microservice architectures will be a big plus
• Excellent communication skills. Willingness to work under pressure. Hunger to learn and succeed. Comfortable with ambiguity. Comfortable with complexity Underpinning the Xander Talent Client platform is a rich history of innovation. More than 60 patents represent award-winning technologies and standards, including first-ofits kind innovations like Time-State analytics and AI-automated data modeling, that surface actionable insights. By understanding real-world human experiences and having the ability to act within seconds of observation, our customers can solve business-critical issues and focus on growing their business ahead of the competition. Examples of the brands Xander Talent Client has helped innovate, adapt, and scale at unprecedented speed include: DAZN, Disney+, HBO, Hulu, NBCUniversal, Paramount+, Peacock, Sky, Sling TV, Univision and Warner Bros Discovery.
• Privately held, Xander Talent Client is headquartered in Silicon Valley, California with offices and people around the globe.
• Join us to help extend our leadership position in big data streaming analytics to new audiences and markets!

Key Responsibilities:

• Design, build and maintain the stream processing, time-series analysis system which is at the heart of Xander Talent Clients products
• Responsible for architecture of Xander Talent Client platform
• Build features, enhancements, new services and bug fixing in Scala and Rust on a Jenkins based pipeline to be deployed as Docker containers on Kubernetes
• Own the entire lifecycle of your microservice including early specs, design, technology choice, development, unit-testing, integration-testing, documentation, deployment, troubleshooting, enhancements etc.
• Lead a team to develop a feature or parts of a the product
• Adhere to the Agile model of software development to plan, estimate and ship per business priority