Senior Backend Software Engineer, Case Intelligence

The Expert Institute Group; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Expert Institute in New York is seeking a Senior Backend Software Engineer to join Case Intelligence. You will design and operate scalable data pipelines, build document-processing systems, and implement LLM workflows that power Radar and MRR for lawyers.

You will work with product, evaluation, and engineering leadership to turn unstructured records into reliable structured data, optimize performance and cost, and maintain production-grade reliability and security for sensitive information.

Qualifications

• 5+ years of professional software engineering experience, including substantial work on backend systems or data pipelines.
• Strong Python skills, including typing, Pydantic, and automated testing, plus solid SQL.
• Production experience with AWS serverless or container services and event-driven systems.
• Experience building with LLM APIs beyond prototypes, with attention to output quality, latency, and cost.
• Experience processing PDFs, scans, OCR output, or other unstructured documents at scale.
• The ability to investigate ambiguous problems, make sound technical decisions, and move work forward independently.
• Clear written communication with technical and nontechnical partners.

Responsibilities

• Design, build, and operate pipelines using AWS services such as SQS, Lambda, ECS/Fargate, Step Functions, S3, and EventBridge.
• Turn large volumes of unstructured documents into reliable, structured data.
• Build production LLM workflows using Bedrock, OpenAI, and Gemini, including batch inference, structured outputs, model routing, and long-document processing.
• Develop retrieval and ML components using embeddings, OpenSearch, reranking, classifiers, and entity resolution where they improve results.
• Work with our evaluation team to turn QA findings into measurable improvements in output quality.
• Model and maintain data in PostgreSQL, DynamoDB, OpenSearch, and S3/Athena.
• Make pipelines resilient to bad inputs and unreliable upstream systems through retries, dead-letter queues, idempotency, and backfills.
• Own the infrastructure, deployment, access controls, and observability for the systems you build.
• Reduce processing time and cost without compromising quality.
• Handle sensitive medical and legal information responsibly, and keep technical documentation current.

Skills

Python typing/Pydantic

Automated testing

SQL

AWS serverless

Event-driven systems

LLM APIs

PDF/OCR processing

Data pipelines

Troubleshooting

Tools

OpenSearch/Elasticsearch

PostgreSQL

DynamoDB

S3

Bedrock/OpenAI/Gemini

SQS/Lambda/ECS/Fargate/Step Functions

OpenAI

Job description

# Senior Backend Software Engineer, Case IntelligenceApply* New York* Full-time* Information Technology## Company DescriptionAt Expert Institute, we are pioneers and disruptors in the legal space. Simply put, we pair attorneys with the perfect expert witnesses to win high-stakes cases and be the hero for the people, families, and businesses they serve.In our history, we have had a helping hand in billions of dollars in settlements and verdicts for our clients. We have helped all kinds of litigators work on all types of cases including many national headline cases involving well-known brands like Google, Uber, Microsoft, Facebook, the NFL, the MLB and many others.We have an entrepreneurial mindset the same as our clients which means our business model is calculated, fast-paced, and highly efficient. Once an attorney speaks with us, we immediately help them consult with industry specialists and key opinion leaders to educate and inform them while navigating through any theory of liability, causation, and damages.## Job DescriptionThe RoleExpert Institute is hiring a Senior Software Engineer to join our Case Intelligence team. The team builds Radar and MRR, turning court records, expert reports, depositions, and medical records into information attorneys can use.This is a backend and data engineering role with a strong applied AI component. You will build document-processing pipelines, retrieval systems, and LLM workflows that run in production at scale. The work calls for sound judgment about output quality, reliability, privacy, and cost.You will work directly with Product, our evaluation team, and engineering leadership. You should be comfortable taking an ambiguous problem from investigation through deployment and production support.What You’ll Work On* Event-driven pipelines behind Radar and MRR* PDF parsing, OCR, classification, and entity extraction* LLM inference, retrieval, and evaluation* Court-record and third-party data integrations* Data quality, entity resolution, and deduplication* Processing cost, performance, and production reliabilityResponsibilities* Design, build, and operate pipelines using AWS services such as SQS, Lambda, ECS/Fargate, Step Functions, S3, and EventBridge.* Turn large volumes of unstructured documents into reliable, structured data.* Build production LLM workflows using Amazon Bedrock, OpenAI, and Gemini, including batch inference, structured outputs, model routing, and long-document processing.* Develop retrieval and ML components using embeddings, OpenSearch, reranking, classifiers, and entity resolution where they improve results.* Work with our evaluation team to turn QA findings into measurable improvements in output quality.* Model and maintain data in PostgreSQL, DynamoDB, OpenSearch, and S3/Athena.* Make pipelines resilient to bad inputs and unreliable upstream systems through retries, dead-letter queues, idempotency, and backfills.* Own the infrastructure, deployment, access controls, and observability for the systems you build.* Reduce processing time and cost without compromising quality.* Handle sensitive medical and legal information responsibly, and keep technical documentation current.How We Define This LevelA Senior Software Engineer owns complex projects from technical design through production operation. You are expected to identify failure modes, make practical tradeoffs, improve quality over time, and communicate risks early. You will contribute to the team’s technical direction and help other engineers make better decisions.Success Looks Like* Radar and MRR process documents reliably, with failures visible and recoverable.* Output quality improves through measured changes informed by evaluation and QA.* Processing costs and latency improve as volume grows.* The systems you build are secure, observable, and supportable in production.* Product and business partners understand what the systems can do, where they fall short, and what you are improving next.Equal Employment Opportunity (EEO) StatementOur company does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or other non-merit factor.## QualificationsWhat We’re Looking For* At least five years of professional software engineering experience, including substantial work on backend systems or data pipelines.* Strong Python skills, including typing, Pydantic, and automated testing, plus solid SQL.* Production experience with AWS serverless or container services and event-driven systems.* Experience building with LLM APIs beyond prototypes, with attention to output quality, latency, and cost.* Experience processing PDFs, scans, OCR output, or other unstructured documents at scale.* The ability to investigate ambiguous problems, make sound technical decisions, and move work forward independently.* Clear written communication with technical and nontechnical partners.Helpful Experience* Amazon Bedrock, RAG, vector search, reranking, or LLM evaluation tools such as Langfuse, pydantic-evals, or Label Studio* Classic ML or NLP in production, including classifiers, embeddings, or entity resolution* OpenSearch/Elasticsearch, Logstash, or Salesforce data integration* Infrastructure as code, GitHub Actions, Datadog, and CloudWatch* dbt, Athena, or Looker* TypeScript, NestJS, GraphQL, or Angular* HIPAA or other regulated data environments* Legal technology or healthcare* Productive use of AI coding agents such as Claude Code or Codex## Additional InformationAll your information will be kept confidential according to EEO guidelines.