Senior Data Engineer: Lakehouse & Streaming

NinjaOne; Georgia; Hybrid; USD 110,000 - 200,000; Full time

Benefits offered by this job

Hybrid remote work

Medical, dental, and vision insurance

401(k)

Unlimited PTO

Job summary

NinjaOne is seeking a Senior Data Engineer to join the Emerging Products team. You will design and scale lakehouse architectures, build robust streaming and batch pipelines, and ensure reliable data delivery to analysts and data scientists using Kafka, Spark, Iceberg, and Databricks.

You will work on greenfield infrastructure in a flexible remote setup across the USA, with hybrid options and a strong emphasis on collaboration with cross-functional teams.

Qualifications

• Bachelor's degree in a technical field or equivalent work experience.
• 10+ years of data engineering experience with a strong focus on data platform and distributed systems.
• Hands-on experience with lakehouse architectures (Bronze/Silver/Gold).
• Deep Expertise in Kafka, Spark, and Airflow for streaming and batch pipelines.
• Proficiency with Iceberg, Delta Lake, or Hudi for open table formats.

Responsibilities

• Design and implement Medallion-layer lakehouse architectures.
• Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow.
• Manage open table formats like Iceberg, Delta Lake, or Hudi and optimize performance.
• Collaborate with data scientists and analysts to meet data requirements.
• Optimize queries in Trino/Starburst and Databricks environments.

Skills

Lakehouse architecture

Python

SQL

Distributed systems

Kubernetes

Trino/Starburst

Education

Bachelor's degree

Tools

Kafka

Spark

Airflow

Iceberg

Delta Lake

Hudi

Databricks

Job description

NinjaOne is seeking a Senior Data Engineer to join the Emerging Products team. You will design and scale lakehouse architectures, build robust streaming and batch pipelines, and ensure reliable data delivery to analysts and data scientists using Kafka, Spark, Iceberg, and Databricks.

You will work on greenfield infrastructure in a flexible remote setup across the USA, with hybrid options and a strong emphasis on collaboration with cross-functional teams.