Hybrid AI Tooling & Evaluation Engineer

ScOp Venture Capital LLC.

New York (NY)

Hybrid

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Downtown Brooklyn office
Occasional remote work

Job summary

Pangram Labs is seeking a Software Engineer to join the AI Tooling and Evaluation team in Brooklyn. You will build internal tools, web apps, and data pipelines to support the model development lifecycle from data collection to evaluation and deployment monitoring.

You will work closely with AI researchers and engineers, applying ML concepts while delivering robust software solutions and dashboards for model assessments and usage tracking.

Qualifications

  • BS/MS in CS or related field.
  • 3+ years as a software engineer with full‑stack skills.
  • Proficiency in Python and at least one modern frontend framework.
  • Experience building internal tools, admin panels, dashboards.
  • Comfortable with databases, REST APIs, and basic DevOps.
  • Familiarity with ML concepts.

Responsibilities

  • Build evaluation infrastructure for standardized model assessments and dashboards.
  • Develop research support systems to monitor platform usage.
  • Improve synthetic data generation workflows and toolchains.

Skills

Python
Full-stack
REST APIs
Databases
ML concepts
Frontend framework
DevOps
Data visualization

Education

B.S./M.S. in Computer Science

Tools

Weights & Biases
Label Studio
Data visualization libraries

Job description

Pangram Labs is seeking a Software Engineer to join the AI Tooling and Evaluation team in Brooklyn. You will build internal tools, web apps, and data pipelines to support the model development lifecycle from data collection to evaluation and deployment monitoring.

You will work closely with AI researchers and engineers, applying ML concepts while delivering robust software solutions and dashboards for model assessments and usage tracking.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer (AI Tooling and Evaluation)
Software Engineer (AI Tooling and Evaluation)

ScOp Venture Capital LLC. • New York (NY)

Hybrid
USD 120,000 - 160,000
Downtown Brooklyn office
Occasional remote work
Full-Stack Engineer — AI Product Builder (Hybrid NYC)
Full-Stack Engineer — AI Product Builder (Hybrid NYC)

Pangram • New York (NY)

Hybrid
USD 120,000 - 160,000
Browser extensions experience
Mobile apps experience
Startup experience
+1
Full-Stack Engineer - Build AI Detection Apps (Hybrid NYC)
Full-Stack Engineer - Build AI Detection Apps (Hybrid NYC)

Pangram Labs Inc. • New York (NY)

Hybrid
USD 120,000 - 170,000
Hybrid schedule
Office in NYC
Senior AI & Cloud Software Engineer (Hybrid)
Senior AI & Cloud Software Engineer (Hybrid)

Opentrons Labworks Inc. • New York (NY)

Hybrid
USD 150,000 - 180,000
Senior AI Evaluation & Benchmark Engineer (Hybrid)
Senior AI Evaluation & Benchmark Engineer (Hybrid)

Glean • San Francisco (CA)

Hybrid
USD 200,000 - 280,000
Medical, Vision, Dental
Generous time-off
401k plan
+4
Senior AI Tooling & Testing Engineer
Senior AI Tooling & Testing Engineer

Palo Alto Networks, Inc. • Santa Clara (CA)

On-site
USD 147,000 - 237,500
Senior AI Evaluation Engineer (Hybrid: Bay Area)
Senior AI Evaluation Engineer (Hybrid: Bay Area)

Glean • Mountain View (CA)

Hybrid
USD 200,000 - 280,000
Medical, Vision, Dental
401k plan
Home office stipend
+3
Full-Stack Engineer
Full-Stack Engineer

Pangram • New York (NY)

On-site
USD 120,000 - 160,000
Browser extensions experience
Mobile apps experience
Startup experience
+1
Full-Stack Engineer
Full-Stack Engineer

Pangram Labs • New York (NY)

Hybrid
USD 120,000 - 170,000
Hybrid schedule
Office in NYC
Lead AI Evaluation & Benchmarking Engineer (Hybrid)
Lead AI Evaluation & Benchmarking Engineer (Hybrid)

Thomson Reuters Corp. • New York (NY)

Hybrid
USD 127,000 - 237,000
Hybrid Work Model
Tuition Reimbursement
Mental Health Days