Data Engineer V

Pyramid Consulting, Inc

San Francisco (CA)

Hybrid

USD 103,000 - 110,000

Part time

20 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) plan
Paid sick leave

Job summary

Pyramid Consulting, Inc. seeks a Data Engineer V for a 6+ month contract in San Francisco, hybrid (1 onsite day/week). You will design end-to-end data pipelines using Palantir Foundry, PySpark, Python and SQL, and build Foundry Ontology models for scalable data solutions.

The role requires 10–15 years in IT/data engineering, 5 years ETL, and experience with cloud and streaming architectures. Energy/Utilities domain knowledge is a plus. Benefits: health, 401(k), paid sick leave.

Qualifications

  • 10-15 years IT/data engineering experience.
  • 5 years hands-on data engineering/ETL experience.
  • Experience with large-scale production data solutions.

Responsibilities

  • Design end-to-end data pipelines using Palantir Foundry, PySpark, Python and SQL.
  • Build and maintain Foundry Ontology models with object types, properties, relations and actions.
  • Develop real-time and near-real-time streaming pipelines for operational data.
  • Implement data-quality checks, schema validation, lineage, metadata, monitoring and health checks.
  • Collaborate in Agile/Scrum environments with architects, SMEs and product owners.

Skills

Data engineering
ETL
PySpark
Python
SQL
TypeScript
Foundry Foundry
Streaming architectures
Ontology modeling
Cloud
Agile
CI/CD

Education

Bachelor’s/Master’s degree in CS/Engineering/MIS

Tools

Palantir Foundry
Foundry Contour
Foundry APIs

Job description

Immediate need for a talented Data Engineer V. This is a 06+months contract opportunity with long-term potential and is located in San Francisco, CA (Hybrid; PST).

Job ID: 26-36015
Pay Range: $75/hr - $80/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Responsibilities:
  • This position requires one day per week onsite in the San Francisco Bay Area, and you must be able to work PST hours
  • Design and develop end-to-end data pipelines using Palantir Foundry, PySpark, Python, and SQL.
  • Build and maintain Foundry Ontology models, including object types, properties, relationships, and actions.
  • Develop real-time and near-real-time streaming pipelines for operational and event-driven data.
  • Build business and integration logic using TypeScript and APIs.
  • Develop analytical workflows and data exploration solutions using Foundry Contour.
  • Convert complex SQL, stored procedures, triggers, ETL mappings, and business rules into scalable Foundry/PySpark solutions.
  • Implement data-quality checks, schema validation, lineage, metadata management, monitoring, and health checks.
  • Design reusable frameworks and optimize pipelines for performance, scalability, and reliability.
  • Follow production-grade engineering practices including Git, CI/CD, unit testing, integration testing, and code reviews.
  • Collaborate with architects, business SMEs, product owners, and engineering teams in an Agile/Scrum environment.
Key Requirements and Technology Experience:
  • 10-15 years of overall IT/data engineering experience.
  • 5 years of hands-on data engineering/ETL experience.
  • Strong experience building large-scale, production-grade data solutions.
  • Experience with cloud and distributed data-processing environments.
  • Bachelor’s/Master’s degree or equivalent experience in Computer Science, Engineering, MIS, or related field.
  • Experience with Ontology modeling, TypeScript, Contour, Foundry APIs, and streaming architectures.
  • AWS experience is a plus.
  • Energy & Utility domain experience involving outage management, ADMS/OMS, grid operations, ETOR, PSPS, or customer communications is highly desirable.

Our client is a leading Utilities Industry, and we are currently interviewing to fill this and other similar contract positions.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Spectraforce Technologies, Inc. • Oakland (CA)

Hybrid
USD 120,000 - 190,000
Data Engineer V: 26-03476
Data Engineer V: 26-03476

Akraya Inc. • Oakland (CA)

Hybrid
USD 103,000 - 106,000
Senior Data Engineer: Foundry/PySpark, Hybrid SF
Senior Data Engineer: Foundry/PySpark, Hybrid SF

Pyramid Consulting, Inc • San Francisco (CA)

Hybrid
USD 103,000 - 110,000
Health insurance
401(k) plan
Paid sick leave
Data Engineer
Data Engineer

Pyramid Consulting, Inc • Merrimack (NH)

Hybrid
USD 92,299 - 99,187
Health insurance (medical, dental, vision)
401(k) plan
Paid sick leave
Data Engineer 3
Data Engineer 3

Pyramid Consulting, Inc • Plano (TX)

On-site
USD 87,000 - 125,000
Health insurance (medical, dental, etc
401(k) plan
Paid sick leave
Data Engineer
Data Engineer

Pyramid Consulting, Inc • Columbus (OH)

On-site
USD 62,000 - 76,000
Health insurance
401(k) plan
Paid sick leave
Senior Palantir Foundry Data Engineer
Senior Palantir Foundry Data Engineer

Pivot Point Solutions • Oakland (CA)

Hybrid
USD 73,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Pyramid Consulting, Inc • Chandler (AZ)

Hybrid
USD 77,000 - 110,000
Health insurance
401(k) plan
Paid sick leave
Senior Data Engineer
Senior Data Engineer

Spectraforce Technologies, Inc. • Oakland (CA)

Hybrid
USD 96,000 - 165,000
Senior Palantir Foundry Data Engineer
Senior Palantir Foundry Data Engineer

Kelly Mitchell • San Francisco (CA)

Hybrid
USD 69,000 - 107,000
Medical insurance
Dental insurance
Vision insurance
+2