AI Data Specialist

SGS Consulting; Sacramento (CA); On-site; USD 90,000 - 150,000; Full time

Job summary

SGS Consulting in Sacramento, CA seeks a data-focused engineer/scientist to manage data labeling workflows and build robust data pipelines for ML models. You will annotate data, use LLMs for labeling and evaluation, and work with engineers to summarize model gaps for retraining.

Ideal candidates have experience with Python/SQL, ETL, and basic computer vision concepts, with a collaborative mindset and strong attention to detail.

Qualifications

• Associate's degree or equivalent in CS/Engineering/Physics/Bioinformatics or STEM.
• Industrial software development/testing or HCI research preferred.
• MAANG experience preferred.

Responsibilities

• Data Curation: Manage labeling workflows and extract labels into datasets.
• Data Engineering (Pipelines): Maintain large-scale data processing pipelines.
• Data Governance: Govern access, retention, and privacy of datasets.
• Annotations: Manually annotate training data per modeling needs.
• LLMs and models: Use LLMs to annotate or evaluate data and audit model performance.
• Analysis: Collaborate to identify model gaps and mine data for retraining.

Skills

Communication skills

Problem solving

Interpersonal skills

Attention to details

Experimental investigations

Independent work

Time management

Python

SQL

Unix

Computer vision

Generative models

ETL pipelines

LLM data labeling

Education

Associate's degree or equivalent in STEM

Experience in software development or HCI

MAANG experience preferred

Job description

Job Responsibilities

• Data Curation: Manage data labeling workflows, including data enqueueing for labeling, UI for labeling, and extracting labels into datasets for the modeling team.
• Data Engineering (Pipelines): Maintain large-scale, efficient, and reliable data processing pipelines (billions of images). This includes data sourcing, running machine learning models to understand content, and using LLMs to clean data.
• Data Engineering (Governance): Maintain our portfolio of datasets, ensuring governance of access, retention, and privacy compliance.
• Annotations: Spend time manually annotating training data based on modeling team requirements.
• Use of LLMs and other models to annotate training data or to evaluate generated content. Then apply auditing to understand this model performance.
• Analysis: Collaborate with engineers to identify and summarize model gaps based on evaluations. Utilize these findings to identify necessary data, and then mine and prepare that data for subsequent model training iterations.

Skills

• Verbal and written communication skills, problem solving skills, and interpersonal skills.
• Attention to details and an aptitude to experimental investigations
• Basic ability to work independently and manage one’s time.
• Basic knowledge of Python, and SQL.
• Basic knowledge of computer vision and generative models.
• Basic knowledge with data ETL workflows & pipelines.
• Usage of LLM for data labeling related work.
• Verbal and written communication skills, problem solving skills, and interpersonal skills.
• Basic knowledge of Python, Unix, and SQL.
• Basic knowledge of computer vision and generative models.

Education / Experience

• Associate's degree or equivalent training required in Computer Science, Electronic Engineering, Physics, Bioinformatics, or other STEM subjects.
• Prior industrial experience in software development and testing and / or research experience in human computer interaction are preferred.
• Worked at MAANG before is preferred1-2 years experience