Senior Data Engineer

Spectraforce Technologies; Oakland (CA); Hybrid; USD 96,000 - 165,000; Full time

Job summary

Spectraforce Technologies, Inc. is seeking a Senior Data Engineer in Oakland, CA for a 6-month contract. The role focuses on designing, building, and maintaining data pipelines, data products, and analytical apps to scale data delivery.

You will collaborate with solution architects, data engineers, analysts, and scientists to ensure timely delivery of analytics products and dashboards. Strong Palantir Foundry experience is a plus.

Qualifications

• Bachelor's degree in computer science, engineering, or related field.
• 5+ years of experience as a Data Engineer.
• Hands-on experience building data pipelines from ingestion to delivery.
• Experience developing analytical apps, reports, and dashboards.
• Strong SQL skills with large data sets and complex structures.
• Proficiency in Python and PySpark.
• Experience with Palantir Foundry tools: Workshop, Quiver, Contour, Slate.
• Experience with Tableau or Power BI.

Responsibilities

• Collaborate with SMEs to design data models and pipelines.
• Implement data transformations to derive datasets for business apps.
• Monitor data quality and data freshness; address issues.
• Optimize pipeline performance and resource use.
• Develop operational apps using Palantir Foundry tools.
• Create data visualizations using Foundry or BI tools.
• Maintain applications as requirements evolve.
• Provide 24x7 operational support as needed.
• Mentor junior data engineers.

Skills

SQL

Python

PySpark

Data pipelines

Data modeling

Tableau/Power BI

Palantir Foundry

Education

Bachelor's degree in CS/Engineering

Tools

Palantir Foundry Workshop

Palantir Foundry Quiver

Palantir Foundry Contour

Palantir Foundry Slate

Job description

Senior Data Engineer

6 months contract

Oakland, CA (Hybrid - 1 day onsite per week)

Job Overview

The Data Analytics and Insights team is seeking an experienced and talented Senior Data Engineer to join its growing team of analytics experts.

As a key member of the team, you will play an essential role in designing, developing, and maintaining data pipelines, data products, and analytical products, including data applications, reports, and dashboards.

The ideal candidate will be proactive, detail-oriented, and motivated, with the ability to thrive in a fast-paced environment and help scale product development to meet evolving business needs.

The Data Engineer will collaborate with cross-functional teams, including solution architects, data pipeline engineers, data analysts, and data scientists, on mission-critical initiatives to ensure optimal delivery of analytical products.

Job Responsibilities

• Work closely with Subject Matter Experts (SMEs) to design and develop data models, data pipelines, and front-end applications.
• Implement data transformations to derive new datasets or create ontology objects required for business applications.
• Monitor and troubleshoot critical issues, including data staleness and data quality.
• Optimize data pipeline performance, including latency and resource utilization.
• Develop operational applications using Palantir Foundry tools (Workshop, Quiver, and Slate).
• Develop data visualizations using Foundry tools (Quiver and Contour).
• Maintain applications as usage increases and business requirements evolve.
• Provide 24x7 operational support as required.
• Mentor junior data engineers.

Minimum Qualifications

• Bachelor's degree in computer science, Engineering, or a related field.
• 5+ years of experience as a Data Engineer.
• Hands-on experience building data pipelines from data ingestion through final object delivery.
• Experience developing analytical applications, reports, and dashboards.
• Strong SQL skills and experience working with large datasets and complex data structures.
• Complete proficiency in Python.
• Complete proficiency in PySpark.
• Excellent problem-solving and analytical skills, with strong attention to detail.
• Experience with the Palantir Foundry platform and its tools:
  • Workshop
  • Quiver
  • Contour
  • Slate
• Experience with Tableau or Power BI.