Data Engineer

Spectraforce Technologies, Inc.

Oakland (CA)

Hybrid

USD 120,000 - 190,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Spectraforce Technologies, Inc. seeks an experienced Palantir Foundry Data Engineer in Oakland for a 12-month hybrid role. You will design scalable data pipelines, build Foundry Ontology models, and implement real-time streaming data processing, APIs, and data-quality governance.

Strong Foundry, PySpark, Python, SQL, and TypeScript skills are required, along with production-grade practices and Agile collaboration across teams.

Qualifications

  • Hands-on experience with Palantir Foundry and Ontology modeling.
  • Strong skills in PySpark, Python, SQL and TypeScript.
  • Experience with real-time/streaming data processing.
  • Proven ability to design scalable data solutions in enterprise environments.

Responsibilities

  • Design end-to-end data pipelines using Palantir Foundry, PySpark, Python and SQL.
  • Build and maintain Foundry Ontology models with types, properties, and relationships.
  • Develop real-time streaming pipelines for operational data.
  • Create business logic via TypeScript and APIs.
  • Develop workflows with Foundry Contour for data exploration.
  • Translate complex ETL into scalable Foundry/PySpark solutions.
  • Implement data quality, schema validation, lineage, and monitoring.
  • Design reusable frameworks and optimize for performance and reliability.
  • Follow production-grade practices: Git, CI/CD, unit/integration testing, code reviews.
  • Work in Agile/Scrum with architects, SMEs, product owners, and engineers.

Skills

Palantir Foundry
Foundry Ontology
PySpark
Python
SQL
TypeScript
Foundry Contour
Spark Streaming
REST APIs
Data modeling
ETL/ELT
Data quality & lineage
Git & CI/CD
Testing & production

Education

Bachelor's/Master's in CS or related

Tools

Contour
Foundry tooling

Job description

Data Engineer

Oakland, CA (Hybrid - 1 day onsite per week)

12 months

Position Overview

We are seeking an experienced Palantir Foundry Data Engineer to design and develop scalable data pipelines, data products, and operational solutions using Palantir Foundry, PySpark, Python, SQL, and TypeScript.

The ideal candidate will have strong hands-on experience with Foundry Ontology, real-time/streaming data processing, Contour, APIs, and enterprise data integration.

Experience in the Energy & Utilities industry is highly preferred.

Key Responsibilities
  • Design and develop end-to-end data pipelines using Palantir Foundry, PySpark, Python, and SQL.
  • Build and maintain Foundry Ontology models, including object types, properties, relationships, and actions.
  • Develop real-time and near-real-time streaming pipelines for operational and event-driven data.
  • Build business and integration logic using TypeScript and APIs.
  • Develop analytical workflows and data exploration solutions using Foundry Contour.
  • Convert complex SQL, stored procedures, triggers, ETL mappings, and business rules into scalable Foundry/PySpark solutions.
  • Implement data-quality checks, schema validation, lineage, metadata management, monitoring, and health checks.
  • Design reusable frameworks and optimize pipelines for performance, scalability, and reliability.
  • Follow production-grade engineering practices, including Git, CI/CD, unit testing, integration testing, and code reviews.
  • Collaborate with architects, business SMEs, product owners, and engineering teams in an Agile/Scrum environment.
Required Skills
  • Palantir Foundry Core Concepts
  • Foundry Ontology
  • PySpark, Python, and SQL
  • TypeScript
  • Foundry Contour
  • Spark Streaming / Real-Time Data Processing
  • REST APIs and enterprise integrations
  • Data modeling and large-scale ETL/ELT
  • Data quality, metadata, and lineage
  • Git and CI/CD
  • Production-grade software engineering and testing
Qualifications
  • 10-15+ years of overall IT/data engineering experience.
  • 5+ years of hands-on data engineering/ETL experience.
  • Strong experience building large-scale, production-grade data solutions.
  • Experience with cloud and distributed data-processing environments.
  • Bachelor's/Master's degree or equivalent experience in Computer Science, Engineering, MIS, or a related field.
Preferred Qualifications
  • Palantir Foundry Data Engineer Certification.
  • Experience with Ontology modeling, TypeScript, Contour, Foundry APIs, and streaming architectures.
  • AWS experience is a plus.
Preferred Industry Experience
Energy & Utilities domain experience

involving the following areas is highly desirable:

  • Outage Management
  • ADMS/OMS
  • Grid Operations
  • ETOR
  • PSPS
  • Customer Communications
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer V: 26-03476
Data Engineer V: 26-03476

Akraya Inc. • Oakland (CA)

Hybrid
USD 103,000 - 106,000
Senior Data Engineer – Palantir Foundry
Senior Data Engineer – Palantir Foundry

TheCorporate LLC • Oakland (CA)

On-site
USD 120,000 - 180,000
Senior Palantir Foundry Data Engineer
Senior Palantir Foundry Data Engineer

Pivot Point Solutions • Oakland (CA)

Hybrid
USD 73,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Spectraforce Technologies, Inc. • Oakland (CA)

Hybrid
USD 96,000 - 165,000
Data Engineer
Data Engineer

TheCorporate LLC • Oakland (CA)

On-site
USD 130,000 - 180,000
Solutions Engineer – Data & AI
Solutions Engineer – Data & AI

Company Confidential • South Carolina

Remote
USD 130,000 - 180,000
Remote work
Dedicated home office
Flexible schedule
Senior Palantir Foundry Data Engineer
Senior Palantir Foundry Data Engineer

Kelly Mitchell • San Francisco (CA)

Hybrid
USD 69,000 - 107,000
Medical insurance
Dental insurance
Vision insurance
+2
Senior Palantir Developer (Forward Deployed Engineer) in Denver
Senior Palantir Developer (Forward Deployed Engineer) in Denver

Energy Jobline ZR • Denver (CO)

On-site
USD 180,000 - 240,000
Data Engineer V
Data Engineer V

Pyramid Consulting, Inc • San Francisco (CA)

Hybrid
USD 103,000 - 110,000
Health insurance
401(k) plan
Paid sick leave
Palantir Data Engineer
Palantir Data Engineer

TechDigital Group • Cary (NC)

On-site
USD 80,000 - 120,000