Senior Software Engineer, Data Science

Procore Technologies

Auckland

On-site

NZD 92,000 - 127,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity compensation
Bonus incentive

Job summary

Procore Technologies in Auckland is seeking a Senior Software Engineer for its Data Science team to own the accuracy of LLM-powered features that convert drone and robotics data into actionable insights.

You will collaborate with engineering, product, and AI teams to build data, tooling, and evaluation infrastructure, using Python, SQL, and LLM evaluation to improve product quality and reliability. This role reports to the Director of Engineering and is based in our Auckland office.

Qualifications

  • Strong Python and SQL experience with data manipulation and tooling.
  • Background in data science with focus on LLM accuracy and evaluation.
  • Experience building evaluation datasets and error analysis tools.
  • Familiarity with ground-truth labeling and data quality checks.
  • Knowledge of prompt engineering and ontology/schema design.

Responsibilities

  • Build and maintain dataset and evaluation infrastructure with quality controls.
  • Diagnose gaps between offline evals and production accuracy.
  • Own prompt optimization across lifecycle from candidate selection to production.
  • Automate eval pipelines and scalable tooling for multiple AI products.
  • Create internal tooling for error analysis and experiments.
  • Iterate on labeling frameworks and schema propagation analyses.
  • Prioritize work by likely impact and align with teams.

Skills

Python
SQL
LLM evaluation
Data analysis
Prompt engineering
Ontology design
Team collaboration

Tools

Braintrust
Langfuse

Job description

We're looking for a Senior Software Engineer to join Procore's Data Science team. In this role, you'll own the accuracy of the LLM-powered features at the core of our platform, which turn drone and robotics data into trustworthy insights. Your primary goal is to make our AI measurably better by building the systems that measure model quality, diagnosing where accuracy breaks down, and taking prompts and models from candidate selection through to production.

As a Senior Software Engineer, you'll partner with engineering, product, and AI teams to build the data, tooling, and evaluation infrastructure that make accuracy work repeatable. Use your Python, SQL, and LLM evaluation skills to prioritize by likely impact and raise the quality of every AI product we ship. Join a company trusted by users across industries to transform how they collect, manage, and analyze worksite data.

This position reports into the Director of Engineering and will be based in our Auckland office. We're looking for someone to join us immediately.

What you'll do:
  • Build and maintain robust dataset and evaluation infrastructure, including ground-truth quality controls.
  • Diagnose and fix measurement-path issues between offline evals and production accuracy.
  • Own prompt optimization across its full lifecycle, from candidate selection through production rollout and post-launch validation.
  • Automate eval pipelines and build the tooling to run them at scale across multiple AI products.
  • Create reusable internal tooling for error analysis, audits, and experimentation.
  • Iterate on and scale existing labeling frameworks and knowledge capture systems.
  • Analyze how changes to our ontology and schema propagate across models and infrastructure.
  • Prioritize work by likely impact.
What we're looking for:
  • Strong professional experience with Python for data manipulation, analysis, and tooling (for example, pandas and NumPy).
  • Solid SQL and database experience, including querying, data modeling, and working with large datasets.
  • A data science background with knowledge of LLM accuracy, particularly visual reasoning.
  • Experience building evaluation datasets, running and debugging evals with tools such as Braintrust or Langfuse, and conducting error analysis.
  • Experience designing ground-truth and labeling systems, and measuring label agreement and data quality.
  • Familiarity with prompt engineering and the full prompt lifecycle, plus the ability to reason about ontology and schema design and its downstream impact.
  • A collaborative, ownership-driven mindset with a preference for iterative, team-oriented development. Construction or industrial inspection domain knowledge is a plus.
  • Location in Auckland, with at least 2 days per week in the office, good overlap with our 9-5 schedule, occasional on-call support, and occasional domestic and international travel.
Additional Information

Base Pay Range:

92,000.00 - 126,500.00 NZD Annual

This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate's job-related skills, experience, education or training, and location.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Data Science
Senior Software Engineer, Data Science

Procore Technologies • New Zealand

Hybrid
NZD 92,000 - 127,000
Equity compensation
Bonus incentive
Senior Software Engineer, Data Science
Senior Software Engineer, Data Science

DroneDeploy New Zealand Limited • Auckland

On-site
NZD 92,000 - 127,000
Senior Software Engineer, Data Science
Senior Software Engineer, Data Science

DroneDeploy, Inc. • Auckland

Hybrid
NZD 92,000 - 127,000
Equity compensation
Bonus incentive compensation
Senior Software Engineer, Data Science
Senior Software Engineer, Data Science

Procore Technologies, Inc. • Auckland

On-site
NZD 92,000 - 127,000
Equity compensation
Bonus incentive compensation
Senior Software Engineer, Data Science
Senior Software Engineer, Data Science

Procore • New Zealand

Hybrid
NZD 92,000 - 127,000
Equity compensation
Bonus incentive
Senior AI Evaluation Engineer — LLM Quality & Pipelines (Auckland)
Senior AI Evaluation Engineer — LLM Quality & Pipelines (Auckland)

Procore Technologies • New Zealand

Hybrid
NZD 92,000 - 127,000
Equity compensation
Bonus incentive
Senior AI Data Science Engineer for LLM Evaluation
Senior AI Data Science Engineer for LLM Evaluation

Procore • New Zealand

Hybrid
NZD 92,000 - 127,000
Equity compensation
Bonus incentive
Senior LLM Evaluation & Data Quality Engineer
Senior LLM Evaluation & Data Quality Engineer

Procore Technologies • Auckland

On-site
NZD 92,000 - 127,000
Equity compensation
Bonus incentive
Associate Operations Manager - DroneDeploy
Associate Operations Manager - DroneDeploy

Procore Technologies, Inc. • Auckland

Hybrid
NZD 60,000 - 83,000
Equity compensation
Bonus incentive
Senior AI Evaluation & Data Infra Engineer - Auckland
Senior AI Evaluation & Data Infra Engineer - Auckland

DroneDeploy, Inc. • Auckland

Hybrid
NZD 92,000 - 127,000
Equity compensation
Bonus incentive compensation
Top locations