Software Engineer - AI Products

Herald

New York (NY)

Hybrid

USD 140,000 - 200,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Hybrid work in Northeast
Relocation stipend
Health, dental, vision insurance
401K plan
Home office stipend

Job summary

Herald in New York is seeking an experienced Software Engineer to join the Babbix product team. You will design, build, and scale backend systems, data pipelines, and model orchestration to deliver AI-driven workflows for brokers.

You’ll work with product and client services to turn ideas into production features, ensuring transparency, accuracy, and reliability in the AI output while improving internal tooling and deployment processes.

Qualifications

  • 2+ years building backend or full-stack systems from design to production.
  • Fluent in at least one modern language (Python, TS, Go, Rust) and quick to adapt.
  • Hands-on with LLMs and vector databases or similar AI tech.
  • Experience with relational or NoSQL databases (Postgres, MySQL, MongoDB, Redis).
  • Experience with Docker and major cloud providers (GCP, AWS, Azure).
  • Experience shaping products at fast-growing startups.

Responsibilities

  • Build core AI-product features for enterprise brokers across APIs and data pipelines.
  • Improve developer experience, tooling, testing infrastructure, and CI/CD.
  • Collaborate with clients and cross-functional teams to gather feedback and translate it into features.

Skills

Backend systems design
Programming languages
AI/LLMs familiarity
Databases (Postgres/MySQL/MongoDB/0)
Cloud platforms (AWS/GCP/Azure)
Startup product experience

Tools

Docker
Cloud providers

Job description

About Us

Herald is transforming how commercial insurance gets sold. We combine modern API infrastructure with industry-specific AI that can read emails, extract data, generate quotes, and guide brokers through submission workflows end-to-end. The result: faster placement, cleaner operations, and meaningful revenue growth. The market is huge, the need is obvious, and the product we’re building doesn’t exist yet. If you want to help shape the operating system for modern insurance, we’d love to work with you.

We’re a team of insurtech veterans with experience at At-Bay, Kin, and Insurify. We’ve raised our Series A funding from top-tier VCs Lightspeed, Brewer Lane, Afore, Underscore along with a panel of insurtech founders At-Bay, Marble, insurance executives CRC, and early employees of other successful API infrastructure companies Plaid, Alloy.

The role

Herald is building Babbix, an AI-native platform that commercial insurance brokers use to create submissions and get quotes directly from their inbox. It orchestrates broker workflows end-to-end by combining classification pipelines, data extraction models, and a broker-facing web interface. Delivering high-quality product experiences and shipping new AI-driven capabilities are core to our success.

As a Software Engineer on the Babbix product, you’ll drive major product initiatives from inception to delivery. You’ll design, build, and scale the systems that power our AI workflows, from APIs and data pipelines to model orchestration and integration with external partners. You’ll collaborate closely with brokers and internal teams to turn ideas into production-ready features that make our AI output transparent, accurate, and trustworthy.

Why This Role Matters

Commercial insurance is one of the last major industries still powered by email. Every submission, quote, and policy must be manually processed by brokers, slowing them down and costing them deals.

By building new product and AI capabilities, you will:

  • Transform messy email submissions into structured, actionable data with minimal friction.
  • Help brokers move from inbox to quote-ready submissions in minutes instead of hours.
  • Enable rapid iteration on new workflows and AI features alongside our product and client services teams.
  • Lay the foundation for scaling Babbix across lines of business, carriers, and broker organizations.

Your work will directly impact how brokers work — transforming an industry that has been failed by modern software until now.

You will
  • Build Core AI-Product Features for Enterprise Brokers
    - Own large new areas within our product
    - Drive the development of backend systems (APIs, data pipelines, and model orchestration), working closely with product teams to bring new capabilities to life.
    - Deliver experiments at a high velocity and level of quality to engage our customers
    - Work across the entire product lifecycle from conceptualization through production
    - Be able, and willing, to multi-task and learn new technologies quickly
  • Improve Developer Experience & Internal Tools
    - Contribute to internal tooling, testing infrastructure, and CI/CD to improve velocity and reliability.
    - Help evolve our Google Cloud Platform-based architecture as new product features are launched.
  • Collaborate Directly with Clients
    - Gather feedback from pilot users and translate it into product improvements and feature priorities.
    - Work closely with customer success and integrations teams to ensure smooth rollouts and a great user experience.
What you bring
  • 2+ years of experience building backend or full-stack systems from design through production
  • Fluent in at least one modern programming language (Python, TypeScript, Go, Rust, etc.) and quick to adapt to new technologies.
  • Hands-on experience with LLMs, vector databases, or other emerging AI technologies.
  • Experience with relational or NoSQL databases (e.g., Postgres, MySQL, MongoDB, Redis, etc.).
  • Experience with Docker and major cloud providers (Google Cloud Platform, Amazon Web Services, or Microsoft Azure).
  • Experience shaping products at fast-growing startups.
Nice to Have
  • Background in insurance, fintech, or other data-heavy SaaS products.
  • Experience with model evaluation, benchmarking, or human-in-the-loop review workflows.
What we bring
  • Competitive compensation packages based on experience
  • Company equity
  • Hybrid-flexible company focussed in the Northeast (NYC and Boston)
  • Relocation stipend (if you want to join us in the Northeast)
  • Quarterly in-person meetups (on the company)
  • 20 days of PTO (that roll over) + 12 company holidays + 5 sick days
  • Quality health, vision, and dental insurance
  • Pre-tax commuter benefits to be used towards parking & transit costs for those working hybrid in our offices
  • 401K plan
  • $500 additional home office stipend (beyond the standard equipment)
  • Parental leave for all kinds of parents (including adoption and foster care)
  • An agile and motivated team

Full compensation packages are determined based on candidate experience. Please note that some roles may include variable compensation such as commission, bonuses, and/or equity that are not outlined here. This range is depicting base pay only. Any variable compensation will be discussed throughout the hiring process.

New York Pay Range: $140,000 — $200,000 USD

Additional information

Diversity, equity, and inclusion are featured prominently in our company's values which you can read about below. Please reach out if you would benefit from any assistance throughout the application or have suggestions about how we can make our process more accessible and inclusive to all people.

One more note: We want to build an incredible team. As a result, we make a point of being open to surprising candidates who are the right person even though their experience doesn't exactly match up to our job description. Our job descriptions are gestures, not strict criteria. If you think you would be a great addition to our team, but might not fit the criteria perfectly, we still encourage you to apply! We recognize there are many transferable skills and traits that we may not have captured in this description and welcome all interested candidates to apply.

Life at Herald

We're just getting started and building our culture with purpose every day. One of the joys of joining a small company early is that you get to build that culture too. Come join us and help us make Herald an (even more) amazing place to work!

Actions we value

There are many actions that we hope for and even demand from members of our team: communicating honestly, working hard, behaving with integrity. These are expectations. But we value these five actions above and beyond the level of "baseline expectation." We believe that if we excel at these, our business will thrive. We’re betting the company on it.

Build trust

We always lead with empathy. We publicly own and learn from our mistakes just as we are confident and transparent in explaining our decisions. And we help get the work done because we recognize that no job is too small.

Create a shared reality

We each articulate the facts, assumptions, questions, and fears we hold about our business. We listen to and learn from others. We create a shared set of information before making decisions.

Get better every day.

We constantly seek ways to improve ourselves. We provide each other candid feedback coupled with support to elevate those around us. We refine how we work together to become more effective as a team.

Build a diverse, equitable, and inclusive community.

We thrive when our team has a variety of lived experiences, values each other for their unique perspectives, and shares equitably in our mutual success. We invest in building an inclusive community for people who are oppressed because of their race, ethnicity, age, religion, gender expression, sexual orientation, physical ability, or socio-economic class.

(Remember that) we make the rules.

We once created the ways we work and therefore can change them. We do not default to momentum. We challenge ourselves to deconstruct the status quo and create a better future.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer -AI Products
Senior Software Engineer -AI Products

Herald • New York (NY)

Hybrid
USD 200,000 - 230,000
Company equity
Hybrid-flexible work arrangement
Relocation stipend
+2
Solutions Consultant
Solutions Consultant

Herald • New York (NY)

On-site
USD 150,000 - 170,000
Competitive compensation packages
Company equity
Hybrid-flexible work environment
+9
Frontend Engineer - AI Products
Frontend Engineer - AI Products

Herald • New York (NY)

On-site
USD 140,000 - 200,000
Product Manager - Markets
Product Manager - Markets

Herald • New York (NY)

On-site
USD 140,000 - 180,000
Product Manager
Product Manager

Harper • San Francisco (CA)

On-site
USD 125,000 - 170,000
Health, dental, and vision insurance
Commuter benefits
Team meals and snacks
Member of Technical Staff
Member of Technical Staff

Harbor • San Francisco (CA)

On-site
USD 180,000 - 260,000
Competitive salary
Early-stage equity
Medical, dental and vision
+3
Member of Technical Staff
Member of Technical Staff

Harbor Behavioral Health • San Francisco (CA)

On-site
USD 190,000 - 270,000
Early-stage equity
Medical, dental & vision for you and 3
Flexible paid time off
+2
Growth
Growth

Harbor • San Francisco (CA)

On-site
USD 150,000 - 230,000
Competitive salary
Early-stage equity
Medical, dental and vision insurance
+3
Head of Agentic Field Engineering
Head of Agentic Field Engineering

Hyperexponential • New York (NY)

On-site
USD 250,000 - 300,000
$6,000 training budget
Medical, dental, and vision
Mental health support
+3
Senior Software Engineer - Dev Tools
Senior Software Engineer - Dev Tools

Meanwhile • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Fully covered health, dental, vision
Meals provided in office
Two annual company off sites