Senior/Staff Engineer - RAG Platform

Pallet; Deutschland; Remote; EUR 166.000 - 227.000; Vollzeit

Zusammenfassung

A dynamic tech startup is looking for an experienced engineer to lead the development of a Retrieval-Augmented Generation (RAG) platform. You will be responsible for designing core infrastructure and building scalable data pipelines. This role requires collaboration with product teams and offers significant opportunities for professional growth. Competitive compensation and top-tier benefits are included.

Leistungen

Health, Vision, and Dental benefits

Flexible PTO

401k option

Daily catered lunches

Yearly learning and development stipend

Qualifikationen

• Backend-focused engineer experienced in building LLM-powered features.
• Skilled in building APIs and data pipelines.
• Comfortable working with complex enterprise data.

Aufgaben

• Lead the architecture and development of the RAG platform.
• Design and maintain core infrastructure for AI agents.
• Build scalable, efficient data pipelines supporting millions of events.

Kenntnisse

Backend architecture ownership

Data pipeline development

API creation

Collaboration

Tools

Node.js

TypeScript

PostgreSQL

Google Cloud Platform

React

Jobbeschreibung

You could be an engineer anywhere, why us?

• Join a well-funded, high-growth startup on the path to IPO ($50M raised, 700% revenue growth in 2 years, targeting a $11T market)

• Work directly with our Head of Platform Engineering,Aren Patel (ex-Google and Finch)

• Help transform a massive industry and scale us toward a $10 B+ business

About the opportunity:

Given recent economic shifts, logistics providers and shippers want to capitalize on generative AI to drive business efficiency. As a result, many of them are turning to CoPallet, the first end-to-end service of AI agents and logistics experts, to automate their back-office operations. If we can capture this momentum effectively, we’re on track to build the next $10 billion tech company in logistics.

About the Role You’ll lead the architecture and development of our Retrieval-Augmented Generation (RAG) platform, powering AI agents that learn and operate in challenging real-world logistics environments. This isn’t about being a RAG expert day one, but owning backend architecture and navigating tradeoffs in LLM workflows.

You’ll build tooling for transparency and debugging of AI tool calls, develop discovery mechanisms for agents to find and use tools effectively, and create memory systems that retain context across weeks. You’ll also shape Pallet’s technical roadmap.

What You’ll Do

• Design and maintain core infrastructure for AI agents on our RAG platform

• Build scalable, efficient data pipelines supporting millions of events

• Create debugging and inspection tooling for LLM-based workflows

• Develop memory systems that surface relevant context dynamically

• Collaborate across product and engineering teams on architecture and design decisions

• Potential to lead a team as a product lead

Tech Stack

• Backend: Node.js + TypeScript, Encore framework

• Database: PostgreSQL

• Infrastructure: Google Cloud Platform

• AI/ML: OpenAI, Anthropic, Google Foundation Models

• Frontend: React + TypeScript

Preferred Experience

• Backend-focused engineer experienced in building LLM-powered features

• Skilled in building APIs, data pipelines, and scalable infrastructure

• Comfortable working with complex enterprise data and large user bases

• Experienced with GCP and PostgreSQL

• Bonus: Familiarity with RAG pipelines

Who you are:

• You own the outcome: taking full responsibility to deliver impact end to end, no excuses.

• You move fast but with quality: shipping quickly while maintaining sustainable craftsmanship.

• You experiment relentlessly: embrace a growth mindset, learn from failures, and iterate faster.

• You push beyond limits: no coasting; you raise the bar for yourself and the team.

• You thrive in collaboration: value face-to-face teamwork and contribute actively in our in-office culture.

Interview Process

1. Intro Chat with Head of Talent (30 mins)

2. Technical Screen + Meet and Greet with Hiring Manager (60 mins)

3. Executive Chat - Sushanth, CEO and Founder (30-45 mins)

4. Final Interview, visit our Fidi office, and deep dive into technical and behavioral interviews (~3.5 hours)

Location:

Since we're a small team building 0-1 products, we prefer for candidates to be comfortable working in an in office environment in San Francisco. We typically come into the office 4 days a week. Relocation assistance can be provided for interested candidates.

Compensation:

The estimated salary range for this role is $195,000 – $265,000, depending on experience and skill set. In addition to base salary, we offer competitive equity, benefits, and opportunities for growth. Final compensation will be determined based on a combination of factors, including experience, qualifications, and location.

Top-Tier Benefits

???? Health, Vision, and Dental benefits

️ Flexible PTO

Life Insurance and Accidental Insurance

️???? Short-Term Disability Coverage

Generous salary and equity for all staff

???? 401k option; helping you save for the future

Yearly learning and development stipend

Commuter benefits for Bay Area employees

Uber ride stipend if you ever have to work late in the office

Remote office home stipend to get you comfy in your space

Daily catered lunches provided by Sharebite (every meal you order, one meal gets donated)

️ Onboarding trip to San Francisco HQ if you work remotely

Monthly happy hours

Annual Company Offsites; our last one was in Napa Wine Country