Senior AI Engineer

Automatic Data Processing, Inc.; United States; Remote; USD 140,000 - 180,000; Full time

Job summary

Accertify is seeking a Senior AI Engineer to lead end-to-end AI solutions, set technical direction, and mentor teams across ML, LLMs, retrieval systems, and data layers feeding them.

You will own deployment patterns across on-prem and cloud, drive operational excellence, and collaborate with product managers, data scientists, and engineers to align AI with business needs. Remote-friendly US role.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience).
• 5+ years of production software experience.
• Strong proficiency with AI/ML frameworks (OpenAI SDK, FastMCP, agentic orchestration frameworks).
• Strong Python AND strong SQL; both are first-class requirements. Comfortable with query optimization, indexing strategy, and data modeling.

Responsibilities

• AI Architecture: Architect AI systems end-to-end. Set technical direction. Review and mentor on others’ designs.
• LLM Strategy: Define how we use LLMs, routing, agentic orchestration, prompt patterns, fine-tune vs. prompt trade-offs, model selection.
• Production Ownership: Own deployment patterns across on-prem and cloud (Kubernetes, container infrastructure, secure integration). Drive operational excellence.
• Data Architecture: Consult on the data layer, medallion design (bronze/silver/gold), RAG retrieval stores, schema evolution, drift detection, and query performance at scale.
• Evaluation Framework: Define how we measure AI quality, golden datasets, judge-based eval, production observability (OpenTelemetry, Phoenix or similar), behavior testing.
• Technical Leadership: Mentor AI Engineers, lead code and design reviews, set engineering standards for the AI team, and drive cross-team initiatives with Data Science and Data Engineering teams.
• Security & PII: Set the bar for handling sensitive customer data, secure system design, authentication, PII safety, and compliance-aware patterns.
• Collaboration: Partner with product managers, data scientists, engineers, and stakeholders to align AI solutions with business needs.

Skills

AI/ML frameworks

Python

SQL

LLM deployment

RAG

Vector databases

OpenTelemetry

Security & PII

Mentoring

Distributed systems

Education

Bachelor’s or Master’s degree in CS/DS/Engineering

Tools

OpenAI SDK

pgvector

Pinecone

Weaviate

Kubernetes

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Full Time Corporate - Virtual

Salary Range: $140,000.00 To $180,000.00 Annually

Accertify enables commerce by doing one thing extraordinarily well: pinpointing fraud. The company's Predictive Yes Platform helps businesses say yes to more - more good customers, more revenue, and more growth - without getting burned. It's a precise, confident, data-backed yes, made possible by joining signals across the entire customer lifecycle through unmatched data volume, layered AI-powered models, and a consortium approach that protects clients from bad actors spotted anywhere in the network while unlocking business with good actors verified anywhere in the network. With more than 10 billion transactions and over $1 trillion in commerce processed in 2025 alone, Accertify delivers the intelligence and precision that fraud and payments teams need to say yes confidently and enable growth. That's the More Yes difference.

We are seeking an experienced Senior AI Engineer to lead the design, development, and deployment of intelligent systems that drive business impact. You will own end-to-end AI solutions, set technical direction, and mentor other engineers, working across machine learning, LLMs, retrieval systems, agentic workflows, and the data layers that feed them. This role requires deep technical expertise and a track record of shipping production AI systems at scale.

• AI Architecture: Architect AI systems end-to-end. Set technical direction. Review and mentor on others’ designs.
• LLM Strategy: Define how we use LLMs, routing, agentic orchestration, prompt patterns, fine-tune vs. prompt trade-offs, model selection.
• Production Ownership: Own deployment patterns across on-prem and cloud (Kubernetes, container infrastructure, secure integration). Drive operational excellence.
• Data Architecture: Consult on the data layer, medallion design (bronze/silver/gold), RAG retrieval stores, schema evolution, drift detection, and query performance at scale.
• Evaluation Framework: Define how we measure AI quality, golden datasets, judge-based eval, production observability (OpenTelemetry, Phoenix or similar), behavior testing.
• Technical Leadership: Mentor AI Engineers, lead code and design reviews, set engineering standards for the AI team, and drive cross-team initiatives with Data Science and Data Engineering teams.
• Security & PII: Set the bar for handling sensitive customer data, secure system design, authentication, PII safety, and compliance-aware patterns.
• Collaboration: Partner with product managers, data scientists, engineers, and stakeholders to align AI solutions with business needs.

Skills & Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience).
• 5+ years of production software experience.
• Strong proficiency with AI/ML frameworks (OpenAI SDK, FastMCP, agentic orchestration frameworks).
• Strong Python AND strong SQL; both are first-class requirements. Comfortable with query optimization, indexing strategy, and data modeling.
• Demonstrated experience designing and operating medallion architectures (bronze/silver/gold) at scale.
• Production LLM experience, prompt engineering, retrieval (RAG), agentic orchestration, fine-tuning trade-offs.
• Experience with vector databases (pgvector, Pinecone, Weaviate, etc.) and production RAG patterns.
• Experience with AI observability and evaluation frameworks, OpenTelemetry, Phoenix or equivalent, golden-set eval, judge-based eval methodology.
• Strong understanding of secure system design, authentication, API integrations, and handling PII-sensitive data.
• Track record of mentoring engineers and shipping cross-team initiatives.
• Strong problem-solving skills and ability to explain technical solutions to non-technical audiences.

Preferred Skills

• Hands-on experience with Model Context Protocol (MCP), building tools, OAuth flows, or MCP server integrations.
• Experience leading data engineering or data platform initiatives end-to-end.
• Experience with agentic AI frameworks (e.g., the OpenAI Agents SDK) in production.
• Experience deploying production systems across both cloud (AWS, GCP, Azure) and on-prem environments.
• Experience in fraud detection, financial services, or other PII-sensitive domains.
• Knowledge of MLOps tools and CI/CD for AI.
• Open-source contributions, conference talks, or technical writing in the AI/ML space.
• Competitive base salary with performance-based incentives. Potential Salary Range: $140-180k. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations.
• This role is eligible for remote US-based (work-from-home) locations. Chicago-based candidates would work in a hybrid capacity from the Accertify HQ located in Itasca, IL.
• Visa Sponsorship: Employment eligibility to work for Accertify in the U.S. is required, as Accertify will not pursue Visa sponsorship for this position.

Why Join Accertify?

At Accertify, we offer more than just a paycheck-we invest in our people through competitive rewards, meaningful benefits, professional development opportunities, flexible ways of working, and programs that support your overall well-being. Join a team that values growth, collaboration, and innovation, and empower you to make an impact and build a rewarding career.