Principal Data Platform Engineer - Remote

Nucleus Security; Oregon; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Flexible PTO

401k contribution

Education budget

Health insurance

Fully remote work

Job summary

Nucleus Security is seeking a Staff / Principal Data Engineer to define and evolve the architecture of our data platform. This senior role leads design of large-scale data processing pipelines and analytics, driving scalable, reliable systems while mentoring engineers and contributing technically.

Ideal candidates bring 10+ years in data engineering, deep data modeling expertise, and hands-on experience with Spark or Flink, SingleStore/MemSQL, and Python/Java.

Qualifications

• 10+ years in software or data engineering and operating production data systems.
• Deep expertise in relational and analytical data modeling for large-scale workloads.
• Expert-level SQL for complex analytical queries over big data.
• Experience with SingleStore/MemSQL or similar distributed SQL databases.
• Hands-on experience with Spark or Flink.
• Understanding of distributed data processing, partitioning, and performance optimization.
• Experience designing high-throughput batch and streaming pipelines.
• Proficiency in Python or Java for data processing.
• Ability to own ambiguous problems end-to-end.
• Strong cross-team communication across time zones.

Responsibilities

• Own the architecture and evolution of large-scale data processing and analytics systems.
• Design and evolve data models for high-volume analytical workloads.
• Design and optimize complex analytical SQL queries over large datasets.
• Architect distributed and asynchronous job processing systems.
• Design data processing workflows using Spark, Flink or similar tech.
• Drive effective use of SingleStore/MemSQL including indexing and partitioning.
• Establish patterns for batch processing, data transformation, and reprocessing.
• Diagnose performance and scalability issues across databases and services.
• Collaborate with engineering/product teams to translate requirements into scalable architectures.
• Provide technical leadership and mentorship across engineering teams.

Skills

Data engineering

SQL expert

Distributed systems

Leadership

Cross-team communication

Tools

SingleStore/MemSQL

Spark

Flink

Job description

Nucleus Security is seeking a Staff / Principal Data Engineer to define and evolve the architecture of our data platform. This senior role leads design of large-scale data processing pipelines and analytics, driving scalable, reliable systems while mentoring engineers and contributing technically.

Ideal candidates bring 10+ years in data engineering, deep data modeling expertise, and hands-on experience with Spark or Flink, SingleStore/MemSQL, and Python/Java.