Backend Engineer, Agents NYC

Hebbia, Inc.; New York (NY); On-site; USD 160,000 - 300,000; Full time

Benefits offered by this job

Unlimited PTO

Medical, Dental, and Vision Insurance

Catered lunches

Doordash dinner credit

Generous parental leave policy

$15k lifetime fertility benefits

Competitive equity package

Job summary

Hebbia, Inc. is looking for a skilled backend engineer to enhance its AI platform for investors and bankers. You will be responsible for building efficient solutions that integrate powerful distributed systems. Ideal candidates should have over 5 years of experience and a solid background in software development.

The role offers a competitive salary range of $160,000 to $300,000, along with benefits including unlimited PTO, medical insurance, and an equity package. Join a team that values innovation!

Qualifications

• 5+ years software development experience at a technology firm.
• Ability to analyze complex problems and propose solutions.
• Experience leading software development projects and collaborating.

Responsibilities

• Own critical system components and build robust solutions.
• Unlock O(1) universal indexing for high-scale document systems.
• Drive performance optimization for efficient operations.
• Mentor junior engineers and foster a culture of learning.

Skills

Backend software engineering expertise

Proficiency in Python

Experience with cloud platforms (AWS)

Experience with Kafka

Knowledge of ElasticSearch

Proficiency in PostgreSQL

Familiarity with Redis

Education

Bachelor's or Master's degree in Computer Science

Job description

About Hebbia

The AI platform for investors and bankers that generates alpha and drives upside.

Founded in 2020 by George Sivulka and backed by Peter Thiel and Andreessen Horowitz, Hebbia powers investment decisions for BlackRock, KKR, Carlyle, Centerview, and 40% of the world’s largest asset managers. Our flagship product, Matrix, delivers industry-leading accuracy, speed, and transparency in AI-driven analysis. It is trusted to help manage over $30 trillion in assets globally.

We deliver the intelligence that gives finance professionals a definitive edge. Our AI uncovers signals no human could see, surfaces hidden opportunities, and accelerates decisions with unmatched speed and conviction. We do not just streamline workflows. We transform how capital is deployed, how risk is managed, and how value is created across markets.

Hebbia is not a tool. Hebbia is the competitive advantage that drives performance, alpha, and market leadership.

The Team

Hebbia enables leading finance and legal firms with advanced reasoning, copiloting and retrieval capabilities - unlocking meaningful insights for meaningful use cases. The Agents team builds everything from core document understanding capabilities to co-piloting experiences for Matrix and deep, multi-source research. We’ve built our own agentic frameworks powered by distributed systems built for scale.

We don’t build for one-off success. We build steerable, reliable and explainable agentic systems. And we build these systems for the scale of data our customers bring to the table. Our goal is to unlock the unknowable unknown for customers all over the world.

We want to build a product that becomes indisposable to our customers and as delightful as your favorite consumer product. We move fast and build first of their kind systems.

What we’ve built:

1. A custom multi-agent framework powering everything from deep research capabilities to copiloting interfaces paired with distributed systems infrastructure for long running agentic tasks.
2. The world’s most powerful and scalable LLM inference engine - a distributed, asynchronous DAG orchestrator capable of incorporating live graph mutations, cooperating in tandem with our LLM throughput management capabilities.
3. Elastically scaling data representation and metadata generation, powering the most effective private data retrieval systems.
4. Industry leading agents solving problems from buy side company diligence to multi billion dollar M&A.

The Role

A backend engineer at Hebbia blends expertise in systems, application layer software, and data modeling to build highly efficient software solutions. You will be responsible for leveraging the latest software and agentic solutions and integrating product experience with powerful distributed systems. You’ll help protect Hebbia’s technical edge via elegant software design, efficient data communication, and sophisticated integrations. We value engineers who move fast, hold themselves accountable to quality, and are detail-oriented.

Responsibilities

1. Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.
2. Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.
3. Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.
4. Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.

Who You Are

• Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.
• 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering.
• Proficiency in building backend and API systems using technologies such as Python, Java, or Go.
• Extensive experience with cloud platforms (e.g., AWS).
• Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis.
• Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.
• Proven experience in leading software development projects and collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.
• Enthusiasm for continuous learning and professional growth. A passion for exploring new technologies, frameworks, and software development methodologies.
• Embraces rapid prototyping with an emphasis on user feedback.
• Autonomous and excited about taking ownership over major initiatives.
• Bonuses:
  • Experience building agentic systems or LLM enabled products.
  • Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).

Compensation

The salary range for this role is $160,000 to $300,000. This range may be inclusive of several career levels at Hebbia and will be narrowed during the interview process based on the candidate’s experience and qualifications. Adjustments outside of this range may be considered for candidates whose qualifications significantly differ from those outlined in the job description.

Life @ Hebbia

PTO: Unlimited

Insurance: Medical + Dental + Vision + 401K

Eats: Catered lunch daily + doordash dinner credit if you ever need to stay late

Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent

Fertility benefits: $15k lifetime benefit

New hire equity grant: competitive equity package with unmatched upside potential