Member of Technical Staff

Wintermeyer Ventures; Verona (NJ); On-site; USD 230,000 - 400,000; Full time

Job summary

Wintermeyer Ventures in Verona, USA, seeks an experienced software engineer to join an early-stage AI risk team. You will lead end-to-end red-teaming and evaluation for customer AI agents, from scoping through remediation and certification.

The role emphasizes building test tooling, improving evaluation workflows, and turning frontier adversarial attacks into repeatable product capabilities. You will work with Python and TypeScript, own customer engagements, and contribute at scale in a hands-on

Qualifications

• At least 5 years of software engineering experience with end-to-end ownership of high-stakes technical work.
• Proficiency in Python and TypeScript with production deployments.
• Experience with AI agents or related evaluation frameworks and regular use of agentic AI tools.
• Startup experience, especially early-stage, is valued and experience in larger tech orgs is beneficial.
• Experience applying product management practices and working with customers and cross-functional stakeholders.

Responsibilities

• Refine the core engine that runs red-teaming evaluations.
• Own technical scoping, reconnaissance, test execution, remediation, and certification for customer AI agents.
• Turn frontier adversarial attacks into repeatable product capabilities.
• Review and calibrate evaluations to maintain a high quality bar.
• Use agentic tools to productize and improve your workflow.
• Develop evaluation approaches for new agent capabilities, including computer use.

Skills

Python

TypeScript

End-to-end ownership

AI agents

Customer engagement

Education

Bachelor's degree in Computer Science or equivalent

Tools

CI/CD

Git

Testing frameworks

Job description

About the Role

Join an early-stage team in AI risk and insurance, helping enterprises adopt AI agents with greater confidence. You will lead end-to-end red-teaming and evaluation work, from scoping through remediation and certification, while improving the systems used to test agent security and reliability.

What You'll Do

• Refine the core engine that runs red-teaming evaluations.
• Own technical scoping, reconnaissance, test execution, remediation, and certification for customer AI agents.
• Turn frontier adversarial attacks into repeatable product capabilities.
• Review and calibrate evaluations to maintain a high quality bar.
• Use agentic tools to productize and improve your workflow.
• Develop evaluation approaches for new agent capabilities, including computer use.

What We're Looking For

• At least 5 years of software engineering experience, with a record of owning high-stakes technical work end to end.
• Proficiency in Python and TypeScript, and experience shipping user-facing features to production.
• Experience with AI agents, agentic frameworks, evaluations, or a closely related domain, and regular use of agentic AI tools in your daily work.
• Early-stage startup experience alongside experience in a larger technology organization; founder, founding engineer, or early-hire experience is valued.
• Experience applying product management practices and working directly with customers and cross-functional stakeholders.
• A computer science degree or equivalent technical background, strong communication skills, and an individual-contributor track record.
• Interest in a hands-on individual-contributor role, with a record of growing responsibility and evidence of technical excellence.

Compensation & Benefits

Base salary range: $230,000 to $400,000 annually. Visa sponsorship is available.

Location

On-site in Verona, Veneto, United States.