Senior Data Engineer | Emerging Products

ninjaone; United States; Hybrid; USD 110,000 - 200,000; Full time

Benefits offered by this job

Hybrid remote

Medical Insurance

Dental Insurance

Vision Insurance

401(k) Plan

Unlimited PTO

Growth Opportunities

Job summary

NinjaOne is seeking a Senior Data Engineer on the Emerging Products team to design and scale our lakehouse architecture and data pipelines. You will drive Medallion-layer designs and build robust streaming and batch workflows across Kafka, Spark, and Airflow, ensuring reliable data delivery to analysts and data scientists.

You will own table formats like Iceberg, Delta Lake, and Hudi, optimize queries in Trino/Starburst and Databricks environments, and collaborate closely with data scientists

Qualifications

• Bachelor's degree in CS/CE/IT or equivalent.
• 10+ years of data engineering experience.
• Hands-on with lakehouse architectures and Medallion patterns.
• Deep expertise in Kafka, Spark, and Airflow for streaming and batch.
• Proficiency in Iceberg, Delta Lake, or Hudi.
• Experience with Databricks for large-scale processing.
• Strong Python and SQL skills.
• Nice to have Trino or Starburst experience.
• Familiarity with hybrid streaming/batch architectures and event-driven systems.

Responsibilities

• Design and implement Medallion-layer lakehouse architectures (Bronze, Silver, Gold).
• Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow.
• Own and manage open table formats Iceberg, Delta Lake, and Hudi.
• Work with Trino/Starburst and Databricks-based environments to optimize analytics queries.
• Monitor pipeline health and improve data platform reliability and efficiency.
• Collaborate with data scientists, analysts, and product teams to meet data requirements.
• Other duties as needed.

Skills

Kafka

Spark

Airflow

Python

SQL

Databricks

Trino

Starburst

Education

Bachelor's degree in Computer Science/Engineering/IT or equivalent

Tools

Iceberg

Delta Lake

Hudi

Job description

About the Role

At NinjaOne, we're looking for a skilled Senior Data Engineer to join our Emerging Products team and help build the foundation of our modern data platform. You'll play a critical role in designing and scaling lakehouse architectures, building robust streaming and batch pipelines, and ensuring data flows reliably to the analysts and data scientists who depend on it. This is an exciting opportunity to work on greenfield infrastructure using a cutting-edge stack — Kafka, Spark, Iceberg, and Databricks — collaborate with cross-functional teams, and help shape how we harness data to power our next generation of products.

Location

We are flexible on remote working from home, if you are located in the USA and reside in one of the following states: CA, CO, CT, FL, GA, *IL, KS, MA, MD, ME, NJ, NC, NY, OR, TN, TX, VA, and WA. We have physical offices in Austin, TX and Tampa, FL, if you prefer a hybrid option.

*Onsite interviews maybe required for this role

We hire the best data engineers, but experience in our stack can't hurt: our data platform is built on Kafka, Spark, Airflow, Iceberg, and Databricks; supporting large-scale distributed workloads across hybrid streaming and batch ecosystems. Knowing lakehouse architecture patterns, distributed query engines, and scalable pipeline design will set you up for success.

What You’ll Be Doing

• Lakehouse Architecture: Design and implement Medallion-layer data architectures (Bronze, Silver, Gold), building structured ingestion pipelines and curated data layers that serve downstream analytics and data science workloads.
• Pipeline Development: Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow, supporting reliable and low-latency data movement across the platform.
• Table Format Management: Own and manage open table formats including Iceberg, Delta, and Hudi — selecting the right format for the workload and maintaining performance and reliability at scale.
• Query Engine Optimization: Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics queries and support platform consumers.
• Platform Reliability: Monitor pipeline health, troubleshoot data quality and performance issues, and continuously improve the reliability and efficiency of the data platform.
• Collaboration: Partner closely with data scientists, analysts, and product teams to understand data requirements and deliver platform solutions that enable data-driven decision-making.
• Other duties as needed.

About You

• Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent work experience preferred.
• 10+ years of experience in data engineering with a strong focus on data platform and distributed systems.
• Hands-on experience building and managing lakehouse architectures, including Medallion (Bronze/Silver/Gold) layering patterns.
• Deep expertise in Apache Kafka, Apache Spark, and Apache Airflow for both streaming and batch pipeline development.
• Proficiency in open table formats — Iceberg, Delta Lake, or Hudi — with the ability to evaluate trade-offs and select the right format for the workload.
• Experience with Databricks for large-scale data processing and analytics workloads.
• Strong proficiency in Python and SQL.
• Experience that will make you a standout candidate:
  • Hands-on experience with Trino or Starburst for distributed query execution.
  • Familiarity with hybrid streaming/batch architectures and event-driven data systems.
  • Experience designing Gold-layer datasets optimized for business intelligence and self-serve analytics.

About Us

NinjaOne unifies IT to simplify work for nearly 40,000 customers in 140+ countries. The NinjaOne Unified IT Operations Platform delivers endpoint management, autonomous patching, backup, and remote access in a single console to improve efficiency, increase resilience, and reduce spend. By automating IT and managing all endpoints, organizations give employees a great technology experience at work. NinjaOne is obsessed with customer success and has retained a 98% customer satisfaction score for more than 5 years.

What You’ll Love

• We are a collaborative, kind, and curious community.
• We honor your flexibility needs with full-time work that is hybrid remote.
• We have you covered with our comprehensive benefits package, which includes medical, dental, and vision insurance.
• We help you prepare for your financial future with our 401(k) plan.
• We prioritize your work-life balance with our unlimited PTO.
• We reward your work with opportunity for growth and advancement.

Additional Information

This position is NOT eligible for Visa sponsorship. Due to federal government security requirements associated with our FedRAMP-authorized environment, candidates must be U.S. citizens or lawful permanent residents.

*Due to operational policies, NinjaOne is unable to hire for this role within the city limits of Chicago. We will consider all qualified candidates who reside outside of the city proper or are willing to self-relocate.

Starting pay for the successful applicant depends on a variety of job-related factors, including but not limited to location, market demands, experience, job-related knowledge, and skills. The benefits available for this position include medical, dental, vision, 401(k) plan, life insurance coverage and PTO. For roles based in California, Colorado, Maryland, New Jersey, or Washington the base salary hiring range for this position is $110,000 to $200,000 per year.

For roles based in New York, the base salary hiring range for this position is $110,000 to $200,000 per year.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, marital status, veteran status, or any other status protected by applicable law. We are committed to providing an inclusive and diverse work environment.