AI Multimedia Generation Product Evaluator

ICONMA; Myrtle Point (OR); Remote; USD 60,000 - 80,000; Full time

Job summary

A digital media company is seeking an AI Multimedia Generation Product Evaluator to support media foundational models. Responsibilities include running model inference, collaborating with teams, and auditing data. Ideal candidates should have Python knowledge, data handling abilities, and experience in the image and video domain. This role offers health benefits and growth opportunities.

Benefits

Health Benefits

Referral Program

Growth and advancement opportunities

Qualifications

• 2+ years of basic Python knowledge for managing data and working with image and video data.
• Experience in SQL and handling large data tables.
• Ability to adapt to new code.

Responsibilities

• Fine tune and productionize media foundational models in the GenAI space.
• Set up Halo tasks and run model inference.
• Collaborate with model development teams to connect offline metrics with online user behavior.

Skills

Basic Python knowledge

Data management

Image/video data handling

SQL experience

Education

Bachelor's degree preferred

Job description

Overview

Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.

Responsibilities

• The Multimedia Generation team focuses on fine tuning and productionizing media foundational models in the GenAI space.
• The team consists of AI applied scientists, each responsible for different products like videos, image editing, and developing evaluation metrics.
• Set up Halo tasks and run model inference.
• Enqueue new queues to Halo.
• Audit annotations from vendors.
• Build tooling for managing evaluation datasets.
• Collaborate with model development teams to conduct offline evaluations and automate pipelines.
• Facilitate, set up queues, manage image data, and audit results.
• Ensure consistency and accuracy in measurements, involving programming and auditing tasks.
• Collaborate with model development teams to connect offline metrics with online user behavior and ensure offline metrics predict online user engagement.
• Support engineers in ensuring consistency and accuracy in measurements, involving programming and auditing tasks.

Requirements

• 2+ years of basic Python knowledge, specifically for managing data and working with image and video data.
• 1-2 years of Python knowledge, particularly in working with image/video data and JSON.
• Experience in SQL and handling large data tables.
• Experience in the image and video domain.
• Ability to adapt to new code.
• General know-how.
• Bachelor’s degree preferred, not required.

Nice-to-Have Skills

• Experience as a GenAI user in the image and video domain.
• Basic shell script knowledge.

Why Should You Apply?

• Health Benefits
• Referral Program
• Excellent growth and advancement opportunities

As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, gender, sexual orientation, gender identity or expression, ethnicity, national origin, age, disability status, political affiliation, genetics, marital status, protected veteran status, or any other characteristic protected by federal, state, or local laws.