Role overview
Provide technical leadership for a real-time analytics platform supporting high-throughput, low-latency data processing and data-driven applications. The work spans architecture, implementation, and production operations, with a focus on reliability, scalability, performance, and engineering productivity.
Responsibilities
- Design, build, and operate distributed systems for real-time and near-real-time analytics.
- Guide the evolution of stream-processing and analytics platforms, owning critical capabilities from architecture through operations.
- Develop and tune data services using technologies such as Flink, Spark Structured Streaming, ClickHouse, and Druid.
- Connect batch and streaming workloads through interoperable data pipelines and lakehouse architectures.
- Apply AI capabilities to improve engineering workflows, data quality, operations, troubleshooting, and developer productivity.
- Set engineering standards, mentor other engineers, and collaborate across product, infrastructure, security, and data teams.
- Participate in on-call support, lead incident response and root-cause analysis, and recommend platform investments.
Requirements
- A degree in computer science, engineering, or a related field, or equivalent practical experience.
- At least eight years designing and building large-scale distributed systems, with experience in real-time data processing, analytics, or data platforms.
- Strong Python skills and production experience with stream-processing technologies such as Apache Flink or Spark Structured Streaming.
- Experience operating and tuning high-performance analytics databases such as ClickHouse or Apache Druid, or equivalent systems.
- Experience building event-driven pipelines with Kafka, AWS MSK, or similar messaging platforms.
- The available source also cites AI/ML and modern AI tooling experience, though its detailed requirement text is truncated.
Nice to have
- Scala experience for maintaining and extending existing platform components.
Benefits and work setup
- The source mentions medical, dental, and vision coverage, a matching 401(k), paid time off, a wellness program, and employee discounts. A bonus may also be available.