Senior Real-Time Data Platform Architect

CrowdStrike; Austin (TX); On-site; USD 195,000 - 290,000; Full time

Benefits offered by this job

Market-leading compensation

Wellness programs

Generous vacation and holidays

Parental and adoption leaves

Professional development

Employee networks and volunteering

Vibrant office culture

E-Verify and equal opportunity

Job summary

CrowdStrike seeks a senior data platform engineer to shape the Analytics Data Platform, including a Unified Data Catalog and query analysis for diverse data forms. You will build and optimize a platform processing petabytes of data, enabling batch and streaming analytics, ML, and threat hunting through self-service tools.

The role demands deep experience with Spark/Flink, Hadoop ecosystem, and JVM languages.

Qualifications

• 17+ years exp with B.S. in a related field
• 15+ years with M.S. in a related field
• 12+ years with PhD in a related field
• Experience building and supporting very high scale data platform and data storage systems (MINIMUM: 100s of TB/day)
• Significant experience tuning internals (Spark, Flink, Iceberg/Pinot)
• Production experience building Spark- or Flink-based self-service data platforms
• Strong familiarity with Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta Lake, Presto/Trino, Pinot, Druid
• 3+ years coding in Java/Scala/Kotlin
• Production experience with SQL/NoSQL databases (Postgres/MySQL, Cassandra/DynamoDB)
• Expertise with multiple big data frameworks and distributed systems design
• Test driven development discipline
• Linux administration proficiency
• Experience utilizing AI to enhance decision-making
• Ability to work with remote teams

Responsibilities

• Shape the vision of the Analytics Data Platform and Unified Data Catalog
• Design, develop, and maintain a data platform that processes petabytes of data
• Participate in technical reviews and help develop new features and stability
• Improve efficiency of services to delight customers
• Research and implement methods for efficient data querying and flexible data presentation

Skills

Java/Scala/Kotlin

SQL/NoSQL

Spark/Flink

Hadoop ecosystem

Distributed systems

Linux

Remote collaboration

Education

B.S. in related field

M.S. in related field

PhD in related field

Tools

Spark

Flink

Iceberg/Delta Lake

Kafka

Presto/Trino

Druid

Job description

CrowdStrike seeks a senior data platform engineer to shape the Analytics Data Platform, including a Unified Data Catalog and query analysis for diverse data forms. You will build and optimize a platform processing petabytes of data, enabling batch and streaming analytics, ML, and threat hunting through self-service tools.

The role demands deep experience with Spark/Flink, Hadoop ecosystem, and JVM languages.