AI Engineer

Synergis; Atlanta (GA); Remote; Full time

Job summary

A leading company is seeking an AI Engineer to monitor AI models and ensure their performance and fairness. This remote role involves leveraging tools like Fiddler AI and Lumenova to analyze data, detect biases, and create visualizations. The ideal candidate will have extensive experience with AI model metrics and cloud platforms. Join a diverse team committed to equal opportunity employment and contribute to innovative AI solutions.

Benefits

Medical Insurance

Dental Insurance

Vision Insurance

Disability Insurance

Life Insurance

401k

Commuter Benefits

Qualifications

• 3-5 years experience with Fiddler AI.
• 3-5 years experience with Lumenova.
• 3-5 years experience with Azure/cloud platforms.

Responsibilities

• Monitor AI models focusing on performance metrics.
• Analyze data for patterns and biases.
• Create visualizations and dashboards.

Skills

Data Analysis

Bias Detection

Prompt Engineering

Model Explainability

Visualization

Cloud Skills

Tools

Fiddler AI

Lumenova

Azure

Job description

TITLE: AI Engineer

LOCATION: 100% Remote

ANTICIPATED DURATION: Until the end of 2025

Job Overview

We are seeking an AI Engineer to monitor AI models using Fiddler AI or Lumenova tools. Key skills include understanding AI model metrics, data analysis, statistical knowledge, bias detection techniques, prompt engineering, LLM monitoring, visualization, and interpreting model explanations to identify issues like hallucinations, safety violations, and data drift. The role involves leveraging Fiddler AI's or Lumenova's features for comprehensive monitoring across various AI applications.

Responsibilities

1. Monitoring AI Models: Focus on model performance metrics such as accuracy, precision, recall, F1-score, perplexity, BLEU score, and tracking their changes over time to detect model drift.
2. Data Analysis: Identify patterns and anomalies in input data and outputs, analyze data distributions for potential biases.
3. Bias Detection: Understand protected attributes, assess bias across demographic groups, utilize Fiddler's fairness metrics like disparate impact and equal opportunity.
4. Prompt Engineering: Craft prompts to test model behavior and identify issues, understand prompt influence on responses.
5. LLM Monitoring: Detect hallucinations, safety violations, prompt injection attacks, and mitigate these issues.
6. Visualization: Create dashboards and visualizations, use tools like 3D UMAP to identify data clusters and patterns.
7. Model Explainability: Interpret explanations from Fiddler to understand model decisions and identify areas for improvement.
8. Platform Knowledge: Familiarity with Fiddler's and Lumenova's features, including data ingestion, model monitoring, bias detection, and root cause analysis.
9. Azure/Cloud Skills: Maintain and debug cloud platform stacks, collaborate with cloud engineers, and work with vendors on software upgrades and issue resolution.

Requirements

• 3-5 years experience with Fiddler AI
• 3-5 years experience with Lumenova
• 3-5 years experience with Azure/cloud platforms
• 3-5 years experience implementing AI use cases

Compensation and Benefits

The hourly pay rate ranges from $80 to $83, depending on experience, client requirements, and other factors. Benefits include medical, dental, vision, disability, life insurance, 401k, and commuter benefits.

Equal Opportunity Employment

Synergis is an Equal Opportunity Employer that values diversity and does not discriminate based on race, ethnicity, gender, or other protected statuses. We consider qualified applicants with arrest or conviction records in accordance with applicable laws.

Application Process

Please send your resume to [e-mail]. For assistance or accommodations, contact us at the same email.

Learn more about Synergis at www.synergishr.com.