Senior DevOps Engineer

181 SEI Global Services, Inc.; Oaks (PA); Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

Health care options

401(k) match

Education assistance

Paid volunteer days

Paid parental leave

Job summary

181 SEI Global Services, Inc. is seeking a Senior DevOps Engineer for our Enterprise AI team in Oaks, Pennsylvania. This role involves building and operating cloud‑based systems, focusing on automation, reliability, and security.

The ideal candidate will have significant experience in software/ML engineering, strong skills in Python and Azure, plus a creative approach to problem-solving. Applicants should thrive in a hybrid work environment.

Qualifications

• Minimum of 8 years of work experience with software/ML engineering.
• Ability to design for regulated industries with PII handling.

Responsibilities

• Design AI architectures end‑to‑end.
• Architect Document Intelligence as a Service.
• Prototype fast: build rapid POCs in Python.

Skills

Python

RAG expertise

Agentic AI frameworks

Azure services

Lifecycles of LLMs

Education

BA/BS in a related technical field

Tools

OpenAI

Azure Functions

Python

Job description

SEI is looking for a Senior DevOps Engineer to join our Enterprise AI team. This role is about building and operating reliable cloud‑based systems by writing code, automating infrastructure and delivery workflows, and reducing friction for developers and users. You will work closely with InfoSec, Cloud engineers and business stakeholders to design, deploy, and operate systems with clear ownership and practical engineering judgment. We expect you to use modern tooling, including AI‑assisted tools where appropriate, to speed up automation, troubleshooting, and operations while remaining accountable for correctness, security, and reliability.

Responsibilities

• Design AI architectures end‑to‑end: RAG pipelines, agentic orchestration (multi‑agent, tool use, MCP), retrieval strategies, grounding, and structured outputs.
• Architect Document Intelligence as a Service: ingestion, OCR/vision, extraction, verification, multi‑tenant design, and sensitive‑data handling.
• Define enterprise patterns: prompt governance, model routing, security envelopes, HITL gates, plugin/MCP integration, fallback/verification flows.
• Prototype fast: build rapid POCs in Python to validate architecture, derisk decisions, and accelerate delivery.
• Drive TrustAI: hallucination testing, bias/fairness evals, lineage, scoring, drift monitoring, and compliance alignment.
• Design robust telemetry: retrieval/prompt tracing, eval feedback loops, guardrail instrumentation (OpenTelemetry, Langfuse, App Insights).
• Interface with InfoSec & Cloud Enablement: private networking, identity boundaries, policy‑as‑code, DLP, model‑risk governance.
• Publish reference architectures, reusable modules, decision playbooks; lead design reviews and mentor engineers.

Qualifications

• BA/BS, in a related technical field; or equivalent in education and work experience.
• Minimum of 8 years prior work experience with software/ML engineering.
• Strong Python (APIs, services, production).
• Deep RAG expertise: embeddings, hybrid search, chunking, reranking, evals, guardrails.
• Agentic AI: multi‑step agents, tool calling, orchestration frameworks (LangChain/LlamaIndex or custom).
• MCP / plugin patterns, tool‑server integration, context protocol design.
• Azure: OpenAI/Models, AI Search, ML, AKS, Functions, Key Vault, VNET/private endpoints.
• Solid grasp of LLM lifecycle: prompting, structured outputs, token/cost management, fine‑tuning concepts.
• Ability to design for regulated industries: PII handling, isolation, audit, governance readiness.

Preferred Qualifications

• LLM fine‑tuning (LoRA/QLoRA), evaluation frameworks (RAGAS, pairwise).
• Vector databases (Milvus, Pinecone, Weaviate).
• TrustAI implementation: safety evals, governance dashboards, drift monitoring.
• TypeScript/Node for plugins or front‑end integrations.
• Excellent analytical, organizational, and problem‑solving skills.
• Self‑starter who works efficiently in a fast‑paced environment with changing priorities and a geographically distributed team.
• Creative, solution‑oriented approach with the ability to translate loosely defined concepts into tangible results.
• Diagnostic skills to analyze technical, business, and financial options.
• Action‑oriented, quick to adapt to change.

Work Arrangement

This team follows a hybrid schedule and works three days in the office.

Benefits

• Health care (medical, dental, vision, prescription, wellness, EAP, FSA).
• Life and disability insurance with premiums paid for base coverage.
• 401(k) match.
• Education assistance.
• Commuter benefits.
• Up to 11 paid holidays per year.
• 21 days PTO per year pro‑rated for new hires with increasing PTO over time.
• Paid parental leave.
• Back‑up childcare arrangements.
• Paid volunteer days.
• Discounted stock purchase plan.
• Investment options.
• Access to employee networks.

Equal Opportunity Employer

SEI is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability status, protected veteran status, or any other characteristic protected by law.