Senior AI Engineer

Accertify, Inc.; Burlington; Remote; CAD 196,000 - 252,000; Full time

Benefits offered by this job

Remote work option

Job summary

Accertify, Inc. seeks an experienced Senior AI Engineer to lead end-to-end AI solutions, mentor engineers, and shape technical direction across ML, LLMs, retrieval, and data layers. You’ll own deployments, drive architecture decisions, and ensure security and privacy in production systems.

You will collaborate with product managers and data teams to deliver scalable AI capabilities that enable business growth, while maintaining robust observability and compliance.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or related field.
• 5+ years of production software experience.
• Strong proficiency with AI/ML frameworks (OpenAI SDK, FastMCP, agentic orchestration).
• Strong Python and SQL; data modeling and query optimization.
• Experience with medallion architectures (bronze/silver/gold) at scale.
• Production LLM experience, retrieval (RAG), agentic orchestration.

Responsibilities

• AI Architecture: design end-to-end AI systems and set technical direction.
• LLM Strategy: define LLM usage, routing and prompt patterns.
• Production Ownership: deploy patterns across on-prem and cloud (Kubernetes).
• Data Architecture: advise on medallion design and data stores.
• Evaluation Framework: define AI quality metrics and observability.
• Technical Leadership: mentor engineers and drive cross-team initiatives.

Skills

Python

SQL

AI/ML frameworks

LLMs

Vector databases

Medallion architecture

Education

Bachelor’s or Master’s in CS/DS/Engineering

Tools

OpenAI SDK

OpenTelemetry

Job description

Accertify enables commerce by doing one thing extraordinarily well: pinpointing fraud. The company's Predictive Yes Platform helps businesses say yes to more - more good customers, more revenue, and more growth - without getting burned. It's a precise, confident, data-backed yes, made possible by joining signals across the entire customer lifecycle through unmatched data volume, layered AI-powered models, and a consortium approach that protects clients from bad actors spotted anywhere in the network while unlocking business with good actors verified anywhere in the network. With more than 10 billion transactions and over $1 trillion in commerce processed in 2025 alone, Accertify delivers the intelligence and precision that fraud and payments teams need to say yes confidently and enable growth. That's the More Yes difference.

We are seeking an experienced Senior AI Engineer to lead the design, development, and deployment of intelligent systems that drive business impact. You will own end-to-end AI solutions, set technical direction, and mentor other engineers, working across machine learning, LLMs, retrieval systems, agentic workflows, and the data layers that feed them. This role requires deep technical expertise and a track record of shipping production AI systems at scale.

Essential Duties & Responsibilities

• AI Architecture: Architect AI systems end-to-end. Set technical direction. Review and mentor on others’ designs.
• LLM Strategy: Define how we use LLMs, routing, agentic orchestration, prompt patterns, fine-tune vs. prompt trade-offs, model selection.
• Production Ownership: Own deployment patterns across on-prem and cloud (Kubernetes, container infrastructure, secure integration). Drive operational excellence.
• Data Architecture: Consult on the data layer, medallion design (bronze/silver/gold), RAG retrieval stores, schema evolution, drift detection, and query performance at scale.
• Evaluation Framework: Define how we measure AI quality, golden datasets, judge-based eval, production observability (OpenTelemetry, Phoenix or similar), behavior testing.
• Technical Leadership: Mentor AI Engineers, lead code and design reviews, set engineering standards for the AI team, and drive cross-team initiatives with Data Science and Data Engineering teams.
• Security & PII: Set the bar for handling sensitive customer data, secure system design, authentication, PII safety, and compliance-aware patterns.
• Collaboration: Partner with product managers, data scientists, engineers, and stakeholders to align AI solutions with business needs.

Skills & Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience).
• 5+ years of production software experience.
• Strong proficiency with AI/ML frameworks (OpenAI SDK, FastMCP, agentic orchestration frameworks).
• Strong Python AND strong SQL; both are first-class requirements. Comfortable with query optimization, indexing strategy, and data modeling.
• Demonstrated experience designing and operating medallion architectures (bronze/silver/gold) at scale.
• Experience handling data at scale, partitioning, batch pipeline design, query performance, schema evolution.
• Production LLM experience, prompt engineering, retrieval (RAG), agentic orchestration, fine-tuning trade-offs.
• Experience with vector databases (pgvector, Pinecone, Weaviate, etc.) and production RAG patterns.
• Experience with AI observability and evaluation frameworks, OpenTelemetry, Phoenix or equivalent, golden-set eval, judge-based eval methodology.
• Strong understanding of secure system design, authentication, API integrations, and handling PII-sensitive data.
• Track record of mentoring engineers and shipping cross-team initiatives.
• Strong problem-solving skills and ability to explain technical solutions to non-technical audiences.

Preferred Skills

• Hands-on experience with Model Context Protocol (MCP), building tools, OAuth flows, or MCP server integrations.
• Experience leading data engineering or data platform initiatives end-to-end.
• Experience with agentic AI frameworks (e.g., the OpenAI Agents SDK) in production.
• Experience deploying production systems across both cloud (AWS, GCP, Azure) and on-prem environments.
• Experience in fraud detection, financial services, or other PII-sensitive domains.
• Knowledge of MLOps tools and CI/CD for AI.
• Open-source contributions, conference talks, or technical writing in the AI/ML space.

Additional Details

• Competitive base salary with performance-based incentives. Potential Salary Range: $140-180k. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations.
• This role is eligible for remote US-based (work-from-home) locations. Chicago-based candidates would work in a hybrid capacity from the Accertify HQ located in Itasca, IL.
• Visa Sponsorship: Employment eligibility to work for Accertify in the U.S. is required, as Accertify will not pursue Visa sponsorship for this position.

Why Join Accertify?

At Accertify, we offer more than just a paycheck—we invest in our people through competitive rewards, meaningful benefits, professional development opportunities, flexible ways of working, and programs that support your overall well-being. Join a team that values growth, collaboration, and innovation, and empowers you to make an impact and build a rewarding career.