Software Engineer, Applied AI
Shepherd
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Qualifications
- Strong backend engineering experience building scalable APIs and distributed systems.
- Hands-on experience shipping AI-powered products into production.
- Familiarity with LLMs, RAG architectures, embeddings, and vector databases.
Responsibilities
- Partner with teams to identify high-leverage AI opportunities.
- Design, build, and deploy LLM-powered features.
- Develop AI agents and retrieval-augmented systems.
Skills
Tools
Job description
San Francisco
Full time
On-site
EPD Engineering
- Zone 1 Estimated Base $170K – $220K • Offers Equity
Actual salaries will vary depending on factors including but not limited to location, experience, and performance. The range(s) listed is just one component of Shepherd's total compensation package for employees. Other benefits include stock options, an unlimited paid time off policy, and 100% coverage on medical, vision and dental insurance.
Shepherd is a technology-driven Managing General Underwriter (MGU) transforming commercial Property & Casualty insurance for high-hazard industries. Our mission is to make risk frictionless for the builders and operators shaping the physical world — protecting progress from concept through construction and into decades of operation.
We’re building the fastest, smartest commercial risk platform, where underwriting expertise, data, and automation work together to deliver:
- Faster decisions
- Smarter, more accurate pricing
- Better risk outcomes
With Shepherd, safety, speed, and quality no longer trade off against one another — they compound. We’re not just modernizing insurance products. We’re building the risk infrastructure for the next generation of financial services, where technology, underwriting, and partnerships operate in harmony to support the world’s most important industries — and the progress they make possible.
To date, Shepherd has raised over $20M from leading investors, including:
- Spark Capital
- Costanoa Ventures
- Y Combinator
- Susa Ventures
- Intact Ventures
- And several others
We're a team of technologists and insurance enthusiasts, bridging the two worlds together. Check out our About page to learn more.
We are hiring a Software Engineer focused on Applied AI to build intelligent systems that directly power our underwriting and pricing engine. This role sits at the intersection of product engineering, AI infrastructure, and real-world insurance workflows.
You will design and ship production AI systems that meaningfully improve how we evaluate risk, price policies, and operate our business.
- Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities
- Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling
- Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data
- Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring
- Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions
- Establish best practices for prompt engineering, evaluation frameworks, and model reliability
- Own AI features end-to-end from ideation to production
- Strong backend engineering experience building scalable APIs and distributed systems
- Hands-on experience shipping AI-powered products into production
- Familiarity with LLMs, RAG architectures, embeddings, and vector databases
- Experience integrating AI systems into user-facing or workflow-driven applications
- Comfort with cloud infrastructure and deploying AI workloads at scale
- A product mindset and the ability to translate ambiguous business problems into concrete AI systems
- Experience building AI agents or multi-step reasoning systems
- Background in applied machine learning beyond generative AI
- Experience with pricing systems, financial infrastructure, or risk modeling
- Interest in transforming legacy industries with modern AI systems
Insurance is one of the largest industries in the world, yet much of underwriting and pricing remains manual and fragmented. At Shepherd, AI is not a side project – it is core to how we build durable competitive advantage.
You will help define how applied AI transforms risk evaluation in high-hazard industries and shape the future of AI-native insurance infrastructure.
Frontend
- React & Next.js
- Typescript
- GraphQL w/ Apollo
Backend
- Node.js
- Postgres & Redis
- Typescript
- GraphQL APIs
🏥 Premium Healthcare 100% contribution to top-tier health, dental, and vision
🏖️ Unlimited PTO Flexibility to take the time off, recharge, and perform
🥗 Daily lunches, dinners, and snacks We work together, and enjoy meals together too
🖥️ SF, NYC, or Dallas-Fort Worth Offices Premium office spaces on both coasts with daily lunches provided
📚 Professional Development Access to premium coaching, including leadership development
🏦 401(k) Plan Competitive 401(k) plan offered
🐶 Dog-friendly office Plenty of dogs to play with and make friends with in the SF office
Compensation Range: $170K - $220K
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
