Senior AI Engineer

Orion

Philadelphia (Philadelphia County)

On-site

USD 141,000 - 227,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health and dental benefits
Disability coverage on day one

Job summary

Orion is building AI-enabled financial services infrastructure in the US. This Senior AI Engineer role is hands-on and product-facing, owning end-to-end AI feature delivery from architecture to production.

You will design and maintain RAG/agentic pipelines, integrate LLMs into products, and optimize for cost, latency, and reliability in a fintech context. Production-ready software skills are essential.

Qualifications

  • Hands-on experience building and optimizing RAG systems and agentic pipelines for multi-step reasoning.
  • Experience designing agentic pipelines and loop architectures with tool use and autonomous retrieval.
  • Knowledge of vector databases and indexing/query optimization for large data workloads.
  • Ability to evaluate LLMs for cost, latency, and real-world performance in enterprise contexts.

Responsibilities

  • Own AI features end-to-end: design, build, and ship to production
  • Architect and maintain RAG and agentic pipelines across data sources
  • Integrate LLMs and generative AI into products and workflows
  • Apply prompt engineering and fine-tuning to optimize performance in fintech
  • Instrument and monitor AI features in production: quality, latency, regressions
  • Manage AWS infrastructure with Terraform to support reliable AI services

Skills

RAG systems
agentic workflows
LangGraph/LangChain
vector databases
data preprocessing/vectorization
LLMs evaluation
Terraform/AWS IaC
API design
C#/.NET
data pipelines/architecture
production-grade software

Tools

Pinecone
Weaviate
FAISS
LlamaIndex
Haystack
LangGraph
LangChain

Job description

At Orion, we're building the intelligent infrastructure that powers modern financial advisory, unifying planning, investing, and client engagement for thousands of advisors and millions of investor accounts. We're looking for a Senior AI Engineer who ships, not just experiments. This is a hands-on, product-facing role. You'll own the end-to-end delivery of AI-powered features, from architecture to production — working alongside product managers, designers, and engineers to move fast and build things that matter.

Technical Skills
  • Hands-on experience building and optimizing RAG systems and agentic workflows using frameworks such as LangGraph, LangChain, LlamaIndex, or Haystack.
  • Experience designing agentic pipelines and loop architectures, including multi-step reasoning, tool use, and autonomous retrieval systems
  • Working knowledge of at least one vector database (Pinecone, Weaviate, FAISS, or similar) including indexing and query optimization
  • Experience building and maintaining data preprocessing, chunking, and vectorization pipelines
  • Ability to evaluate and select LLMs (GPT-4o, Claude, LLaMA, Mistral, etc.) based on cost, latency, and real-world performance
  • AWS infrastructure experience with infrastructure-as-code tooling (Terraform)
  • Strong API design and service development skills.
  • Strong experience developing enterprise applications using C# and .NET, with the ability to integrate AI/ML solutions into existing business systems.
  • Experience designing and maintaining data pipelines and data architectures that support AI, analytics, and machine learning workloads.
  • Ability to build scalable, production-ready AI solutions while leveraging strong software engineering fundamentals across the Microsoft technology stack.
Responsibilities
  • Own AI features end-to-end: design, build, and ship to production
  • Architect and maintain RAG and agentic pipelines across internal and external data sources
  • Integrate LLMs and generative AI into products and workflows
  • Apply prompt engineering, fine-tuning, and custom embeddings to optimize performance in a financial services context
  • Instrument and monitor AI features in production: quality, latency, regressions, and user impact
  • Manage cloud infrastructure on AWS using Terraform to support reliable AI service deployment

Most companies say they're serious about AI. At Orion, it's the expectation, built into how every engineer on our team works, at every level, every day. Not a tool you reach for occasionally. Not a line on your resume. A force multiplier embedded in the craft. Our CTO put it plainly: AI is not a trend to get ahead of. It is embedded at every level, expected of every engineer, every day. We measure by the leverage we create.

At Orion, we build the technology that powers independent financial advisors — the professionals who help everyday people plan for retirement, protect their families, and build financial security. Our platform touches billions in assets under management, which means the software we ship must be fast, reliable, and always getting better. We're not a startup chasing hype. We're a scaled business deliberately building an engineering culture that will take us to the next level — and we're doing it now.

Here's what people who've been here a while tend to say: they noticed the informality first and missed the intensity until it caught up with them. Both are real. Nobody is going to make you feel small for not knowing something. And we move fast, care deeply about outcomes, and hold each other to a high standard. The team works hard for each other, which means showing up and contributing at pace isn't just a performance expectation — it's a form of respect.

You will own everything you commit. Full stop. Whether you wrote it line by line or shaped it with AI assistance, the standard is the same: you understand it, you can defend it, and it ships with your name on it. AI accelerates execution. It does not replace system design, architectural thinking, or the judgment required to build software that holds up under real load.

We operate in fintech, which adds an important layer: client data is sacred and compliance guardrails are non-negotiable. The engineers who cut corners here are not the engineers who last here. You are not threatened by change — you cause it. You ask \"why not?\" before you default to the familiar. You experiment, share what you learn, and close gaps fast. You are already using AI tools in your daily workflow. Not as a curiosity. As a practice.

Recommended Skills

Artificial Intelligence (AI), Data Processing, Large Language Models (LLMs), Modeling Languages, Software Development, Standard ML (Programming Language)

Salary Range

$140,935.00 - $226,905.00

The pay listed in this posting indicates the estimated pay at the time of this posting; however, may vary depending on geographic location, job-related knowledge, skills, and experience. In addition, Orion offers a competitive benefits package which includes health, dental, vision, and disability coverage on day one, 401(k) plan with employer match, paid parental leave, pet benefits including pawternity leave and pet insurance, student loan repayment and more.

About Us

At Orion, we achieve our best work when we support one another, staying personally accountable to each other and the clients we serve. We create a welcoming environment where everyone is respected, valued, and heard. Our commitment to create raving fans ensures we consistently exceed client expectations. Thinking differently is in our DNA—we innovate always, push boundaries, and reject the status quo to deliver transformative outcomes. Together, we support one another and see it through to success, driving our collective achievements and those of our clients.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer
Senior AI Engineer

Orion • Lehi (UT)

On-site
USD 141,000 - 227,000
Senior AI Engineer
Senior AI Engineer

Orion • California

On-site
USD 141,000 - 227,000
Health, dental, vision benefits
Disability coverage
401(k) with employer match
+3
Senior AI Engineer
Senior AI Engineer

Orion Advisor Technology • Omaha (NE)

Hybrid
USD 141,000 - 227,000
Health insurance
Dental coverage
Vision coverage
+4
Senior Staff Software Engineer
Senior Staff Software Engineer

Orion • Omaha (NE)

Hybrid
USD 140,935 - 226,905
Health, dental, and vision coverage
401(k) plan with employer match
Paid parental leave
+2
Software Engineering Manager
Software Engineering Manager

Orion • Philadelphia

On-site
USD 123,000 - 196,000
Health insurance
Dental coverage
Vision coverage
+4
Senior Staff Software Engineer
Senior Staff Software Engineer

Orion • Jacksonville (FL)

Hybrid
USD 140,935 - 226,905
Health coverage
401(k) with employer match
Paid parental leave
+2
Software Engineering Manager
Software Engineering Manager

Orion Advisor Solutions • Omaha (NE)

On-site
USD 123,000 - 196,000
Health insurance
401(k) plan with employer match
Paid parental leave
+2
Senior Program Manager, Wealth Strategy & Operations
Senior Program Manager, Wealth Strategy & Operations

Orion Advisor Technology • Omaha (NE)

On-site
USD 95,000 - 147,000
Senior Program Manager, Wealth Strategy & Operations
Senior Program Manager, Wealth Strategy & Operations

Orion • Omaha (NE)

On-site
USD 95,000 - 147,000
Client Relationship Specialist
Client Relationship Specialist

Orion Advisor Solutions • Lehi (UT)

Hybrid
USD 34,000 - 50,000