Backend Engineer (Agents)

Hebbia

San Francisco (CA)

On-site

USD 160,000 - 300,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Unlimited PTO
Medical, Dental, and Vision insurance
Catered lunch daily
Doordash dinner credit
Parental leave policy
$15k fertility benefits
Equity package

Job summary

A leading technology firm is seeking a Backend Engineer with 5+ years of experience to develop scalable systems and optimize performance. The ideal candidate will have expertise in backend development, proficiency in Python, Java, or Go, and a strong background in cloud platforms. This role offers a competitive salary range from $160,000 to $300,000, with benefits including unlimited PTO and health insurance.

Qualifications

  • 5+ years software development experience at a startup or tech firm.
  • Experience with building backend and API systems.
  • Ability to analyze complex problems and communicate solutions.

Responsibilities

  • Own critical system components to address customer needs.
  • Build a high-scale document build system.
  • Drive performance optimization across systems.
  • Mentor junior engineers.

Skills

Backend software development
Cloud platforms (AWS)
Proficiency in Python, Java, or Go
Data structures and algorithms
Performance optimization

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Kafka
ElasticSearch
PostgreSQL
Redis

Job description

The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.

Designed to be generally capable– it can tackle even the most complex tasks, citing answers over any amount of sources. By showing its work, Hebbia empowers users to collaborate with AI on each step and validate responses instead of blindly trusting them. Our mission is to put capable AI in the hands of 1 billion people by 2030.

The Team

Hebbia enables leading finance and legal firms with advanced reasoning, copiloting and retrieval capabilities - unlocking meaningful insights for meaningful use cases. The Agents team builds everything from core document understanding capabilities to co-piloting experiences for matrix and deep, multi-source research. We’ve built our own agentic frameworks powered by distributed systems built for scale.

We don’t build for one-off success. We build steerable, reliable and explainable agentic systems. And we build these systems for the scale of data our customers bring to the table. Our goal is to unlock the unknowable unknown for customers all over the world.

We want to build a product that becomes indisposable to our customers and as delightful as your favorite consumer product. We move fast and build first of their kind systems.

What we’ve built:

  • A custom multi-agent framework powering everything from deep research capabilities to copiloting interfaces paired with distributed systems infrastructure for long running agentic tasks.
  • The world’s most powerful and scalable LLM inference engine - a distributed, asynchronous DAG orchestrator capable of incorporating live graph mutations, cooperating in tandem with our LLM throughput management capabilities.
  • Elastically scaling data representation and metadata generation → powering the most effective private data retrieval systems.

A backend engineer at Hebbia blends expertise in systems, application layer software, and data modeling to build highly efficient software solutions. You will be responsible for leveraging the latest software and agentic solutions and integrating product experience with powerful distributed systems. You’ll help protect Hebbia’s technical edge via elegant software design, efficient data communication, and sophisticated integrations. We value engineers who move fast, hold themselves accountable to quality, and are detail-oriented.

Responsibilities
  • Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.
  • Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.
  • Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.
  • Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.
Who You Are
  • Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.
  • 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering.
  • Proficiency in building backend and API systems using technologies such as Python, Java, or Go.
  • Extensive experience with cloud platforms (e.g., AWS)
  • Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
  • Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.
  • Proven experience in leading software development projects and collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.
  • Enthusiasm for continuous learning and professional growth. A passion for exploring new technologies, frameworks, and software development methodologies.
  • Embraces rapid prototyping with an emphasis on user feedback
  • Autonomous and excited about taking ownership over major initiatives
  • Experience building agentic systems or LLM enabled products.
  • Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).
Compensation

The salary range for this role is $160,000 to $300,000, covering levels from junior to principal. Final leveling is determined through our assessment process, and exceptions to this range may be made for candidates with qualifications that fall outside our standard framework.

PTO: Unlimited

Insurance: Medical + Dental + Vision + 401K

Eats: Catered lunch daily + doordash dinner credit if you ever need to stay late

Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent

Fertility benefits: $15k lifetime benefit

New hire equity grant: competitive equity package with unmatched upside potential

#LI-Onsite

Create a Job Alert

Interested in building your career at Hebbia? Get future opportunities sent straight to your email.

Apply for this job

*

First Name *

Last Name *

Preferred First Name

Email *

Phone *

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Hebbia’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305

Page 1 of 1

OMB Control Number 1250-0005

Expires 04/30/2026

Voluntary Self-Identification of Disability
Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026
Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp .

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury

Disability Status Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Platform Engineer, Document Intelligence
Platform Engineer, Document Intelligence

Hebbia • San Francisco (CA), New York (NY)

On-site
USD 160,000 - 300,000
Unlimited PTO
Medical, Dental, and Vision Insurance
Catered lunch daily
+3
Applied Research Engineer, Agents
Applied Research Engineer, Agents

Hebbia • New York (NY), San Francisco (CA)

On-site
USD 160,000 - 300,000
Unlimited PTO
Daily catered lunch
Remote work options
+2
Staff or Sr. Staff Software Engineer (AI Insurance Tech)
Staff or Sr. Staff Software Engineer (AI Insurance Tech)

EvolutionIQ • New York (NY)

On-site
USD 275,000 - 330,000
Medical insurance
Dental insurance
Vision insurance
+11
Staff Software Engineer
Staff Software Engineer

Peregrine Technologies • New York (NY)

On-site
USD 130,000 - 250,000
Benefits package
Equity options
AI Enablement Strategist — Remote, Impact at Scale
AI Enablement Strategist — Remote, Impact at Scale

CodePath, Inc. • Northern (KY)

Hybrid
USD 110,000 - 150,000
Health & Wellness benefits
401(k)
Generous PTO
+2
Senior Software Engineer
Senior Software Engineer

Peregrine Technologies • New York (NY)

On-site
USD 130,000 - 250,000
Benefits
Equity options
Bonus potential
Senior Forward Deployed Software Engineer, GenAI
Senior Forward Deployed Software Engineer, GenAI

Scale AI • New York (NY)

Hybrid
USD 188,000 - 226,000
Comprehensive health, dental, and vision coverage
Retirement benefits
Learning and development stipend
+2
Senior Software Engineer
Senior Software Engineer

Peregrine • New York (NY)

On-site
USD 130,000 - 250,000
Staff+ Software Engineer, Databases
Staff+ Software Engineer, Databases

Anthropic • San Francisco (CA)

On-site
USD 405,000 - 485,000
Competitive compensation
Flexible working hours
Generous vacation and parental leave
+2
Software Engineering Manager
Software Engineering Manager

ZipRecruiter • Santa Monica (CA)

On-site
USD 180,000 - 250,000
Competitive compensation
Exceptional benefits package
Flexible Vacation & Paid Time Off
+1