Principal Data Engineer - Spark & Graph Pipeline Lead

Sayari; Washington (District of Columbia); On-site; USD 200,000 - 220,000; Full time

Benefits offered by this job

Health insurance

Time off

Equity

401k match

Life insurance

Parental leave

Job summary

Sayari is seeking a Principal Data Engineer to lead our Data Resolution team. You will split time between hands-on Spark and graph data logic (about 70%) and system architecture, mentorship, and long-term planning (about 30%).

You will evolve graph build pipelines, optimize cloud footprint, and guide major pipeline re-architectures powering global data products. You will influence data strategy, oversee architecture, and collaborate across teams to secure scalable, cost-efficient solutions that

Qualifications

• 8+ years of experience in the big data space with leadership in large-scale features.
• Expert-level mastery of Apache Spark for large-scale data processing.
• Strong experience with orchestration tools (Airflow) and cloud environments.
• Hands-on experience architecting and managing data flows into databases such as Elasticsearch, Memgraph, and Cassandra.
• Demonstrated ability in system architecture, including Infrastructure as Code (IaC) and schema design.
• A builder mindset with experience evolving architectures to meet scale.

Responsibilities

• Design and implement complex Spark data logic, focusing on performance optimization and robust execution.
• Own the architectural design of graph build pipelines, ensuring scalability and resilience.
• Plan and oversee strategic re-architecture of data pipelines to meet evolving needs and scale.
• Optimize infrastructure-as-code and schema designs to reduce cloud costs and latency.
• Act as a technical consultant, fostering collaborative design decisions.
• Support engineering through code reviews, design docs, and best practices.
• Ensure the accuracy of mission-critical data outputs.

Skills

Big data

Apache Spark

Airflow

Cloud computing

Data architecture

IaC

Tools

Elasticsearch

Memgraph

Cassandra

Job description

Sayari is seeking a Principal Data Engineer to lead our Data Resolution team. You will split time between hands-on Spark and graph data logic (about 70%) and system architecture, mentorship, and long-term planning (about 30%).

You will evolve graph build pipelines, optimize cloud footprint, and guide major pipeline re-architectures powering global data products. You will influence data strategy, oversee architecture, and collaborate across teams to secure scalable, cost-efficient solutions that