Senior Backend Engineer, AI-Driven Case Intelligence

The Expert Institute Group; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Expert Institute in New York is seeking a Senior Backend Software Engineer to join Case Intelligence. You will design and operate scalable data pipelines, build document-processing systems, and implement LLM workflows that power Radar and MRR for lawyers.

You will work with product, evaluation, and engineering leadership to turn unstructured records into reliable structured data, optimize performance and cost, and maintain production-grade reliability and security for sensitive information.

Qualifications

• 5+ years of professional software engineering experience, including substantial work on backend systems or data pipelines.
• Strong Python skills, including typing, Pydantic, and automated testing, plus solid SQL.
• Production experience with AWS serverless or container services and event-driven systems.
• Experience building with LLM APIs beyond prototypes, with attention to output quality, latency, and cost.
• Experience processing PDFs, scans, OCR output, or other unstructured documents at scale.
• The ability to investigate ambiguous problems, make sound technical decisions, and move work forward independently.
• Clear written communication with technical and nontechnical partners.

Responsibilities

• Design, build, and operate pipelines using AWS services such as SQS, Lambda, ECS/Fargate, Step Functions, S3, and EventBridge.
• Turn large volumes of unstructured documents into reliable, structured data.
• Build production LLM workflows using Bedrock, OpenAI, and Gemini, including batch inference, structured outputs, model routing, and long-document processing.
• Develop retrieval and ML components using embeddings, OpenSearch, reranking, classifiers, and entity resolution where they improve results.
• Work with our evaluation team to turn QA findings into measurable improvements in output quality.
• Model and maintain data in PostgreSQL, DynamoDB, OpenSearch, and S3/Athena.
• Make pipelines resilient to bad inputs and unreliable upstream systems through retries, dead-letter queues, idempotency, and backfills.
• Own the infrastructure, deployment, access controls, and observability for the systems you build.
• Reduce processing time and cost without compromising quality.
• Handle sensitive medical and legal information responsibly, and keep technical documentation current.

Skills

Python typing/Pydantic

Automated testing

SQL

AWS serverless

Event-driven systems

LLM APIs

PDF/OCR processing

Data pipelines

Troubleshooting

Tools

OpenSearch/Elasticsearch

PostgreSQL

DynamoDB

S3

Bedrock/OpenAI/Gemini

SQS/Lambda/ECS/Fargate/Step Functions

OpenAI

Job description

Expert Institute in New York is seeking a Senior Backend Software Engineer to join Case Intelligence. You will design and operate scalable data pipelines, build document-processing systems, and implement LLM workflows that power Radar and MRR for lawyers.

You will work with product, evaluation, and engineering leadership to turn unstructured records into reliable structured data, optimize performance and cost, and maintain production-grade reliability and security for sensitive information.