Staff Agentic Data Engineer – Data Platform

Nucleus Security

Tallahassee (FL)

Remote

USD 120,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible PTO
401k contribution
Education budget
Company-paid healthcare
Fully remote work

Job summary

Nucleus Security is seeking a Staff/Principal Data Engineer in the United States (remote). You will own the architecture of large-scale data processing and analytics systems, from ingestion to customer-facing analytics, and drive optimization across Spark, Flink, and SingleStore/MemSQL platforms.

The role demands leadership across teams and hands-on implementation. Ideal candidates have 10+ years in data engineering, deep data modeling expertise, and strong SQL skills.

Qualifications

  • 10+ years of professional software/ data engineering or data platform experience.
  • Deep expertise in relational and analytical data modeling for large-scale workloads.
  • Expert-level SQL with complex analytical queries over large datasets.
  • Strong experience with SingleStore/MemSQL or similar distributed SQL databases.
  • Hands-on experience with Spark, Flink, or similar technologies for distributed processing.
  • Understanding of distributed data processing: partitioning, parallelism, data skew, resource use, performance.
  • Experience designing high-throughput job processing systems: scheduling, retries, idempotency, observability.
  • Experience building data pipelines for batch ingestion, transformation, and analytics.
  • Knowledge of DB performance: indexing, partitioning, execution plans, data distribution.

Responsibilities

  • Own architecture and evolution of large-scale data processing and analytics systems.
  • Design data models for high-volume analytical workloads balancing performance and storage.
  • Develop and optimize complex analytical SQL queries over large datasets.
  • Architect distributed and asynchronous job processing systems across workloads.
  • Lead Spark, Flink-based processing workflows for large-scale transformation and enrichment.
  • Drive use of SingleStore/MemSQL: schema design, indexing, partitioning, tuning.
  • Define patterns for batch processing, orchestration, failure recovery and reprocessing.
  • Diagnose performance and scalability issues across databases and services.
  • Translate requirements into scalable technical architectures with product teams.
  • Mentor engineers and influence architecture across teams.

Skills

SQL expert
Data modeling
Spark
Flink
Python
Java
Distributed systems
Query optimization
Pipeline design
Analytics platforms

Tools

SingleStore/MemSQL
Spark
Flink

Job description

Staff / Principal Data Engineer

Are you looking for more in life than just building another data pipeline? Does upending cybersecurity resonate with you? We're a rapidly expanding cybersecurity company revolutionizing vulnerability management for organizations of all sizes. For our customers, vulnerability management has historically been a game of catch-up, with fragmented data, limited asset coverage, and manual processes.

Nucleus' primary mission is to create a fast, scalable platform that brings together large volumes of security data and transforms it into actionable insights, making vulnerability management simple, efficient, and effective.

What You Will Do
  • Own the architecture and evolution of large-scale data processing and analytics systems, from ingestion and normalization through transformation, aggregation, and customer-facing analytics.
  • Design and evolve data models that support high-volume analytical workloads while balancing query performance, storage efficiency, maintainability, and scalability.
  • Design and optimize complex analytical SQL queries operating across large datasets, identifying performance bottlenecks and developing scalable solutions.
  • Architect distributed and asynchronous job processing systems capable of reliably processing large volumes of data across concurrent workloads.
  • Design and evolve Spark, Flink or similar technologies based data processing workflows for large-scale transformation, enrichment, aggregation, and computation.
  • Drive the effective use of SingleStore/MemSQL, including schema design, indexing and partitioning strategies, query optimization, and workload design.
  • Establish architectural patterns for batch processing, data transformation, job orchestration, failure recovery, idempotency, and reprocessing.
  • Diagnose complex performance and scalability issues across databases, distributed processing systems, application services, and infrastructure.
  • Partner with engineering and product teams to translate ambiguous analytical and data-processing requirements into scalable technical architectures.
  • Define technical standards and reusable patterns for data modeling, data processing, and analytical query development.
  • Provide technical leadership across engineering initiatives, influencing architecture and mentoring engineers while remaining deeply hands-on with implementation.
  • Identify architectural limitations before they become operational problems and lead improvements that increase the scalability, reliability, and performance of the platform.
The Following Skills and Experience Are Key to Succeeding in This Role
  • 10+ years of professional software engineering, data engineering, or data platform experience, with significant experience designing and operating production data systems.
  • Deep expertise in relational and analytical data modeling, including designing schemas for large-scale analytical and reporting workloads.
  • Expert-level SQL, with demonstrated experience designing, analyzing, and optimizing complex analytical queries over large datasets.
  • Strong experience with SingleStore/MemSQL or comparable distributed SQL/analytical database technologies.
  • Significant hands-on experience with Spark, Flink or similar technologies, including designing and optimizing distributed data-processing workloads.
  • Strong understanding of distributed data processing, including partitioning, parallelism, data skew, resource utilization, and performance optimization.
  • Experience designing high-throughput job processing systems, including scheduling, concurrency management, retries, failure recovery, idempotency, and observability.
  • Experience designing data pipelines that support batch ingestion, transformation, enrichment, aggregation, and downstream analytics.
  • Strong understanding of database performance characteristics, including indexing, partitioning, query execution plans, data distribution, and memory/compute trade-offs.
  • Experience identifying and resolving performance bottlenecks across application, database, and data-processing layers.
  • Proficiency in Python, Java or another production programming language used to build data-processing and distributed systems.
  • Strong understanding of testing strategies for data-intensive systems, including unit, integration, data-quality, and end-to-end testing.
  • Proven ability to independently own technically ambiguous problems and drive them from investigation through production implementation.
  • Demonstrated ability to influence architecture and technical direction across multiple teams without relying solely on organizational authority.
  • Ability to communicate complex data architecture and performance trade-offs clearly to engineers, product stakeholders, and technical leadership.
  • Ability to collaborate effectively with distributed teams across multiple time zones.
Preferred Qualifications
  • Deep production experience with SingleStore/MemSQL, particularly with large-scale analytical workloads.
  • Advanced experience with pipeline performance tuning, partitioning strategies, memory management, and optimization of large distributed workloads.
  • Experience designing platforms that support a combination of high-volume ingestion and low-latency analytical queries.
  • Experience building or operating distributed job execution and orchestration systems.
  • Experience with large-scale cybersecurity, vulnerability, asset, telemetry, or event datasets.
  • Experience working with vulnerability scanning technologies across the security stack, including SCA, SAST, DAST, IAST, vulnerability scanning, and container security.
  • Experience designing systems for incremental processing, backfills, replay/reprocessing, deduplication, and late-arriving data.
  • Experience with data observability and operational monitoring for large-scale processing workloads.
  • Experience integrating AI/LLM-driven capabilities with data platforms, including preparing and processing large datasets for AI-assisted analytical workflows.
  • Experience operating data-intensive applications on Linux and cloud infrastructure.
  • Familiarity with Agile/Scrum methodologies in a professional engineering environment.
Why You Should Be Excited

Nucleus is a truly unique solution that’s defining a market AND making an actual impact.

We’re biased, but you will get to work with one of the best teams in security. We have a lot to get done and we work extremely hard, but we have fun in the process.

This role has the opportunity to directly influence how Nucleus approaches data architecture, analytical processing, and scalability as the platform and the datasets it processes continue to grow.

Outstanding Benefits
  • Outstanding benefits include flexible PTO, 401k company contribution (not a match, a contribution), generous education and training budget, 100% company-paid healthcare, fully remote work, and more.

At Nucleus we are committed to achieving excellence in our field by combining diversity, collaboration, teamwork, and pride in our work.

All qualified applicants will receive consideration for employment without regard to race, sex, color, religion, sexual orientation, gender identity, national origin, protected veteran status, or disability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Agentic Data Engineer – Data Platform
Staff Agentic Data Engineer – Data Platform

Nucleus Security • Florida

Hybrid
USD 180,000 - 230,000
Flexible PTO
401k company contribution
Education budget
+2
Staff Agentic Data Engineer – Data Platform
Staff Agentic Data Engineer – Data Platform

Nucleus Security, Inc • United States

Remote
USD 180,000 - 260,000
Flexible PTO
401k company contribution
Fully remote work
+2
Staff Agentic Data Engineer – Data Platform
Staff Agentic Data Engineer – Data Platform

Nucleus Security • United States

Remote
USD 140,000 - 210,000
Fully remote work
Health insurance
Education and training budget
+2
Senior Product Manager
Senior Product Manager

Nucleus Security • United States

Remote
USD 120,000 - 180,000
Fully remote
Flexible PTO
401k company contribution
+3
Principal Product Marketing Manager
Principal Product Marketing Manager

Nucleus Security, Inc • Florida

Remote
USD 150,000 - 210,000
Fully remote
Flexible PTO
401k company contribution
+5
Principal Product Marketing Manager
Principal Product Marketing Manager

Nucleus Security, Inc • United States

Hybrid
USD 140,000 - 180,000
Fully remote
Flexible work hours
Generous education and training budget
+1
Senior PMM: Risk & Vulnerability Platform
Senior PMM: Risk & Vulnerability Platform

Nucleus Security, Inc • Florida

Hybrid
USD 150,000 - 210,000
Fully remote
Flexible PTO
401k company contribution
+5
Principal Product Manager, AI & Query Platform
Principal Product Manager, AI & Query Platform

Nucleus Security • Florida

Hybrid
USD 140,000 - 210,000
100% health/dental/vision/life and STD
401k contribution
Flexible PTO + 10 holidays
+3
Customer Success Manager
Customer Success Manager

Nucleus Security, Inc • Florida

Remote
USD 110,000 - 170,000
Company-paid health, dental, vision, "
Flexible PTO + 10 holidays
Equity in a VC-backed startup
+2
Staff Agentic Software Engineer - US Ticketing Team Lead
Staff Agentic Software Engineer - US Ticketing Team Lead

Nucleus Security, Inc • United States

Remote
USD 120,000 - 180,000
Flexible remote work arrangements
Autonomy and innovation