Senior Data Platform Engineer & Data Pipelines Lead

NVIDIA; New York (NY); On-site; USD 140,000 - 224,000; Full time

Job summary

NVIDIA’s DGX Cloud organization is seeking a Senior Data Engineer to join the Navigator data platform team. You will own end‑to‑end data pipelines, build reliable distributed workloads, and collaborate across ingestion, transformation, and data quality to support fleet health and operational decisions.

You will lead architectural tradeoffs, develop scalable data products, and mentor engineers while working with Python, SQL, Spark, and cloud services.

Qualifications

• BS or MS in Computer Science, Engineering, or related field, or equivalent experience.
• 5+ years of experience building and operating production software, data platforms, backend infrastructure, databases, or distributed systems.
• Strong software‑engineering fundamentals and production proficiency in Python or another backend or systems language, with the ability and willingness to work primarily in Python and SQL.
• Deep hands‑on experience in distributed data processing using Spark or a comparable compute framework, relational/distributed/analytical databases, or production ETL/streaming systems.

Responsibilities

• Own systems end to end from needs through architecture, deployment, observability, and support.
• Construct data pipelines and products for fleet, capacity, utilization, cost, and telemetry.
• Build shared libraries, deployment tooling, and data contracts to improve speed and safety.
• Engineer reliable distributed workloads with attention to retries, schema evolution, and partial failures.
• Treat security as part of the build with least privilege and access controls.
• Improve quality with automated tests, data quality checks, lineage, monitoring, and SLOs.
• Deliver consumption experiences via well‑modeled tables, APIs, dashboards, and internal apps.
• Raise the engineering bar by mentoring and improving architecture and testing practices.

Skills

Python

SQL

Distributed systems

Data pipelines

CI/CD

Education

BS/MS in CS/Engineering

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

OpenSearch

Job description

NVIDIA’s DGX Cloud organization is seeking a Senior Data Engineer to join the Navigator data platform team. You will own end‑to‑end data pipelines, build reliable distributed workloads, and collaborate across ingestion, transformation, and data quality to support fleet health and operational decisions.

You will lead architectural tradeoffs, develop scalable data products, and mentor engineers while working with Python, SQL, Spark, and cloud services.